Jul 02 19:34:32 devstack cinder-volume[75556]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Jul 02 19:34:32 devstack cinder-volume[75556]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Jul 02 19:34:32 devstack cinder-volume[75556]: we strongly recommend against using it for new projects.
Jul 02 19:34:32 devstack cinder-volume[75556]: If you are already using Eventlet, we recommend migrating to a different
Jul 02 19:34:32 devstack cinder-volume[75556]: framework.  For more detail see
Jul 02 19:34:32 devstack cinder-volume[75556]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Jul 02 19:34:32 devstack cinder-volume[75556]:   import eventlet  # noqa
Jul 02 19:34:35 devstack cinder-volume[75556]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75556) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jul 02 19:34:35 devstack cinder-volume[75556]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75556) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jul 02 19:34:35 devstack cinder-volume[75556]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75556) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jul 02 19:34:36 devstack cinder-volume[75556]: INFO dbcounter [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] Registered counter for database cinder
Jul 02 19:34:36 devstack cinder-volume[75556]: DEBUG oslo_db.sqlalchemy.engines [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75556) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 02 19:34:36 devstack cinder-volume[75556]: DEBUG dbcounter [-] [75556] Writer thread running {{(pid=75556) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Jul 02 19:34:36 devstack cinder-volume[75556]: INFO cinder.rpc [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Jul 02 19:34:36 devstack cinder-volume[75556]: INFO cinder.rpc [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Jul 02 19:34:37 devstack cinder-volume[75556]: DEBUG oslo_db.sqlalchemy.engines [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75556) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 02 19:34:37 devstack cinder-volume[75556]: INFO cinder.volume.manager [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] Determined volume DB was empty at startup.
Jul 02 19:34:37 devstack cinder-volume[75556]: DEBUG cinder.volume.manager [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75556) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Jul 02 19:34:37 devstack cinder-volume[75556]: INFO cinder.volume.manager [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] Service not found for updating active_backend_id, assuming default for driver init.
Jul 02 19:34:37 devstack cinder-volume[75556]: WARNING stevedore.named [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jul 02 19:34:37 devstack cinder-volume[75556]: WARNING castellan.key_manager [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jul 02 19:34:37 devstack cinder-volume[75556]: WARNING cinder.keymgr.conf_key_mgr [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jul 02 19:34:37 devstack cinder-volume[75556]: DEBUG cinder.volume.drivers.lvm [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75556) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}}
Jul 02 19:34:37 devstack cinder-volume[75556]: DEBUG oslo_concurrency.processutils [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75556) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:34:37 devstack cinder-volume[75556]: DEBUG oslo_concurrency.processutils [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] CMD "cinder-rtstool verify" returned: 0 in 0.532s {{(pid=75556) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:34:37 devstack cinder-volume[75556]: DEBUG oslo_db.sqlalchemy.engines [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75556) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 02 19:34:37 devstack cinder-volume[75556]: INFO cinder.rpc [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version.
Jul 02 19:34:37 devstack cinder-volume[75556]: INFO cinder.rpc [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version.
Jul 02 19:34:37 devstack cinder-volume[75556]: WARNING stevedore.named [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jul 02 19:34:37 devstack cinder-volume[75556]: WARNING castellan.key_manager [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jul 02 19:34:37 devstack cinder-volume[75556]: INFO cinder.volume.manager [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] Image-volume cache enabled for host devstack@lvmdriver-1.
Jul 02 19:34:37 devstack cinder-volume[75556]: DEBUG oslo_db.sqlalchemy.engines [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75556) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 02 19:34:37 devstack cinder-volume[75556]: INFO oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] Starting 1 workers
Jul 02 19:34:37 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] Started child 75710 {{(pid=75556) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Jul 02 19:34:37 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] Full set of CONF: {{(pid=75556) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Jul 02 19:34:37 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] ******************************************************************************** {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}}
Jul 02 19:34:37 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] Configuration options gathered from: {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}}
Jul 02 19:34:37 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}}
Jul 02 19:34:37 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}}
Jul 02 19:34:37 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] ================================================================================ {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}}
Jul 02 19:34:37 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] allow_availability_zone_fallback = False {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:34:37 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] allow_compression_on_image_upload = False {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:34:37 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] allowed_direct_url_schemes     = [] {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:34:37 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] api_rate_limit                 = True {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:34:37 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] auth_strategy                  = keystone {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:34:37 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] az_cache_duration              = 3600 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:34:37 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] backend_availability_zone      = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:34:37 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] backend_host                   = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:34:37 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] backend_name                   = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:34:37 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] backend_stats_polling_interval = 60 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:34:37 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] backup_api_class               = cinder.backup.api.API {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:34:37 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:34:37 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] backup_name_template           = backup-%s {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:34:37 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] backup_use_same_host           = False {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:34:37 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] backup_use_temp_snapshot       = False {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:34:37 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] chap_password                  = **** {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:34:37 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] chap_username                  =  {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:34:37 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:34:37 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] cinder_internal_tenant_project_id = 00fb7bd2636f4f118a3c900d218fbad9 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:34:37 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] cinder_internal_tenant_user_id = 262938f490114b7f8275a8a6f8a8d644 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:34:37 devstack cinder-volume[75710]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Jul 02 19:34:37 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] cloned_volume_same_az          = True {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:34:37 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] cluster                        = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:34:37 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] compression_format             = gzip {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:34:37 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] compute_api_class              = cinder.compute.nova.API {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:34:37 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] config_dir                     = [] {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:34:37 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:34:37 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] config_source                  = [] {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:34:37 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:34:37 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] control_exchange               = openstack {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:34:37 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] debug                          = True {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:34:37 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] default_availability_zone      = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:34:37 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] default_group_type             = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:34:37 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:34:37 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] default_volume_type            = lvmdriver-1 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:34:37 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] disk_geometry                  = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:34:37 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] driver_client_cert             = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:34:37 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] driver_client_cert_key         = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:34:37 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] driver_data_namespace          = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:34:37 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] driver_ssl_cert_path           = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:34:37 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] driver_ssl_cert_verify         = False {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:34:37 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] driver_use_ssl                 = False {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:34:37 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] enable_force_upload            = False {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:34:37 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] enable_new_services            = True {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:34:37 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] enable_unsupported_driver      = False {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:34:37 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] enabled_backends               = ['lvmdriver-1'] {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:34:37 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] enforce_multipath_for_image_xfer = False {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:34:37 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] filter_function                = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:34:37 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] glance_api_insecure            = False {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:34:37 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] glance_api_servers             = ['http://192.168.122.181/image'] {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:34:37 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] glance_api_ssl_compression     = False {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:34:37 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] glance_ca_certificates_file    = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:34:37 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] glance_catalog_info            = image:glance:publicURL {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:34:37 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] glance_certfile                = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:34:37 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:34:37 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] glance_keyfile                 = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:34:37 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] glance_num_retries             = 3 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:34:37 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] glance_request_timeout         = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:34:37 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] goodness_function              = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:34:37 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] graceful_shutdown_timeout      = 5 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:34:37 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] group_api_class                = cinder.group.api.API {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:34:37 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] host                           = devstack {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:34:37 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] image_compress_on_upload       = True {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:34:37 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] image_conversion_address_space_limit = 1 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:34:37 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] image_conversion_cpu_limit     = 60 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:34:37 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:34:37 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] image_conversion_disable       = False {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:34:37 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] image_upload_use_cinder_backend = False {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:34:37 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] image_upload_use_internal_tenant = False {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:34:37 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] image_volume_cache_enabled     = False {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:34:37 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] image_volume_cache_max_count   = 0 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:34:37 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] image_volume_cache_max_size_gb = 0 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:34:37 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] init_host_max_objects_retrieval = 0 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:34:37 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] instance_format                = [instance: %(uuid)s]  {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:34:37 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:34:37 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] iscsi_target_flags             =  {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:34:37 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] iscsi_write_cache              = on {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:34:37 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] iser_helper                    = tgtadm {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:34:37 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] iser_ip_address                = 192.168.122.181 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:34:37 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] iser_port                      = 3260 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:34:37 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:34:37 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] log_color                      = False {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:34:37 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] log_config_append              = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:34:37 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:34:37 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] log_dir                        = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:34:37 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] log_file                       = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:34:37 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] log_options                    = True {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:34:37 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] log_rotate_interval            = 1 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:34:37 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] log_rotate_interval_type       = days {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:34:37 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] log_rotation_type              = none {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:34:37 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:34:37 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:34:37 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:34:37 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:34:37 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:34:37 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] max_age                        = 0 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:34:37 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] max_logfile_count              = 30 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:34:37 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] max_logfile_size_mb            = 200 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:34:37 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] max_over_subscription_ratio    = 20.0 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:34:37 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] message_reap_interval          = 86400 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:34:37 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] message_ttl                    = 2592000 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:34:37 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] migration_create_volume_timeout_secs = 300 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:34:37 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] monkey_patch                   = False {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:34:37 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] monkey_patch_modules           = [] {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:34:37 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] my_ip                          = 192.168.122.181 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:34:37 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] no_snapshot_gb_quota           = False {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:34:37 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] num_iser_scan_tries            = 3 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:34:37 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] num_shell_tries                = 3 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:34:37 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] num_volume_device_scan_tries   = 3 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:34:37 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] nvmeof_conn_info_version       = 1 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:34:37 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] nvmet_ns_id                    = 10 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:34:37 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] nvmet_port_id                  = 1 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:34:37 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] osapi_max_limit                = 1000 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:34:37 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] osapi_volume_ext_list          = [] {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:34:37 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:34:37 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:34:37 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] osapi_volume_listen_port       = 8776 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:34:37 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] osapi_volume_use_ssl           = False {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:34:37 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] osapi_volume_workers           = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:34:37 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] per_volume_size_limit          = -1 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:34:37 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] periodic_fuzzy_delay           = 60 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:34:37 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] periodic_interval              = 60 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:34:37 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:34:37 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] public_endpoint                = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:34:37 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] publish_errors                 = False {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] quota_backup_gigabytes         = 1000 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] quota_backups                  = 10 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:34:38 devstack cinder-volume[75710]: INFO cinder.volume.manager [None req-b9ce6a5a-2caf-4d9d-8986-1c4c2b7973d6 None None] Starting volume driver LVMVolumeDriver (3.0.0)
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] quota_gigabytes                = 1000 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:34:38 devstack cinder-volume[75710]: DEBUG oslo_concurrency.processutils [None req-b9ce6a5a-2caf-4d9d-8986-1c4c2b7973d6 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75710) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] quota_groups                   = 10 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] quota_snapshots                = 10 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] quota_volumes                  = 10 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] rate_limit_burst               = 0 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] rate_limit_except_level        = CRITICAL {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] rate_limit_interval            = 0 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] reinit_driver_count            = 3 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] replication_device             = **** {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] report_discard_supported       = False {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] report_interval                = 120 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] reservation_clean_interval     = 86400 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] reservation_expire             = 86400 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] reserved_image_namespaces      = [] {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] reserved_percentage            = 0 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] rpc_response_timeout           = 120 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] run_external_periodic_tasks    = True {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] scst_target_driver             = iscsi {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] scst_target_iqn_name           = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] service_down_time              = 720 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] shell_completion               = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] snapshot_name_template         = snapshot-%s {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] snapshot_same_host             = True {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] split_loggers                  = False {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] state_path                     = /opt/stack/data/cinder {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] storage_availability_zone      = nova {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] storage_protocol               = iSCSI {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] syslog_log_facility            = LOG_USER {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] target_helper                  = lioadm {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] target_ip_address              = 192.168.122.181 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] target_port                    = 3260 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] target_protocol                = iscsi {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] target_secondary_ip_addresses  = [] {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] trace_flags                    = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] transport_url                  = **** {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] until_refresh                  = 0 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] use_chap_auth                  = False {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] use_default_quota_class        = True {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] use_journal                    = False {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] use_json                       = False {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] use_multipath_for_image_xfer   = False {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] use_stderr                     = False {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] use_syslog                     = False {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] verify_glance_signatures       = enabled {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] volume_api_class               = cinder.volume.api.API {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] volume_backend_name            = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] volume_clear                   = zero {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] volume_clear_ionice            = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] volume_clear_size              = 0 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] volume_copy_bps_limit          = 0 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] volume_dd_blocksize            = 1M {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] volume_name_template           = volume-%s {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] volume_service_inithost_offload = False {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] volume_usage_audit_period      = month {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] zoning_mode                    = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] oslo_concurrency.disable_process_locking = False {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75710]: DEBUG oslo_concurrency.processutils [None req-b9ce6a5a-2caf-4d9d-8986-1c4c2b7973d6 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.034s {{(pid=75710) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75710]: DEBUG oslo_concurrency.processutils [None req-b9ce6a5a-2caf-4d9d-8986-1c4c2b7973d6 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75710) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] keystone_authtoken.auth_section = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] keystone_authtoken.auth_type   = password {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] keystone_authtoken.auth_version = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] keystone_authtoken.cache       = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] keystone_authtoken.certfile    = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] keystone_authtoken.delay_auth_decision = False {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] keystone_authtoken.http_connect_timeout = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] keystone_authtoken.include_service_catalog = True {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] keystone_authtoken.insecure    = False {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] keystone_authtoken.interface   = public {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] keystone_authtoken.keyfile     = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] keystone_authtoken.memcache_password =  {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] keystone_authtoken.memcache_username =  {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] keystone_authtoken.region_name = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] keystone_authtoken.service_token_roles_required = True {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] keystone_authtoken.service_type = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] keystone_authtoken.token_cache_time = 300 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.181/identity {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] cache.backend                  = dogpile.cache.null {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] cache.backend_argument         = **** {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] cache.backend_expiration_time  = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] cache.config_prefix            = cache.oslo {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] cache.debug_cache_backend      = False {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] cache.enable_retry_client      = False {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] cache.enable_socket_keepalive  = False {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] cache.enabled                  = False {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] cache.expiration_time          = 600 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] cache.hashclient_retry_attempts = 2 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] cache.memcache_dead_retry      = 300 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] cache.memcache_pool_maxsize    = 10 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] cache.memcache_sasl_enabled    = False {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] cache.password                 = **** {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] cache.proxies                  = [] {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] cache.redis_db                 = 0 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] cache.redis_sentinel_service_name = mymaster {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] cache.redis_server             = localhost:6379 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] cache.retry_attempts           = 2 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] cache.retry_delay              = 0.0 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] cache.socket_keepalive_count   = 1 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] cache.socket_keepalive_idle    = 1 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] cache.socket_keepalive_interval = 1 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] cache.socket_timeout           = 1.0 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] cache.tls_allowed_ciphers      = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] cache.tls_cafile               = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] cache.tls_certfile             = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] cache.tls_enabled              = False {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] cache.tls_keyfile              = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75710]: DEBUG oslo_concurrency.processutils [None req-b9ce6a5a-2caf-4d9d-8986-1c4c2b7973d6 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.051s {{(pid=75710) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] cache.username                 = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] coordination.backend_url       = **** {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75710]: DEBUG oslo_concurrency.processutils [None req-b9ce6a5a-2caf-4d9d-8986-1c4c2b7973d6 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75710) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] database.asyncio_connection    = **** {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] database.asyncio_slave_connection = **** {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] database.backend               = sqlalchemy {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] database.connection            = **** {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] database.connection_debug      = 0 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] database.connection_parameters =  {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] database.connection_recycle_time = 3600 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] database.connection_trace      = False {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] database.db_inc_retry_interval = True {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] database.db_max_retries        = 20 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] database.db_max_retry_interval = 10 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] database.db_retry_interval     = 1 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] database.max_overflow          = 50 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] database.max_pool_size         = 5 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] database.max_retries           = 10 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] database.mysql_wsrep_sync_wait = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] database.pool_timeout          = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] database.retry_interval        = 10 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] database.slave_connection      = **** {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] database.sqlite_synchronous    = True {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] database.synchronous_reader    = True {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] database.use_db_reconnect      = False {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] profiler.connection_string     = messaging:// {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] profiler.enabled               = False {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] profiler.es_doc_type           = notification {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] profiler.es_scroll_size        = 10000 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] profiler.es_scroll_time        = 2m {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] profiler.filter_error_trace    = False {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] profiler.hmac_keys             = **** {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] profiler.sentinel_service_name = mymaster {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] profiler.socket_timeout        = 0.1 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] profiler.trace_requests        = False {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] profiler.trace_sqlalchemy      = False {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] profiler_jaeger.process_tags   = {} {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] profiler_jaeger.service_name_prefix = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] profiler_otlp.service_name_prefix = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] oslo_policy.enforce_new_defaults = False {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] oslo_policy.enforce_scope      = False {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] oslo_policy.policy_default_rule = default {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] oslo_policy.policy_file        = policy.yaml {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] privsep_osbrick.group          = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] privsep_osbrick.helper_command = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] privsep_osbrick.user           = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] cinder_sys_admin.group         = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] cinder_sys_admin.helper_command = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] cinder_sys_admin.user          = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] service_user.auth_section      = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] service_user.auth_type         = password {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] service_user.cafile            = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] service_user.certfile          = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] service_user.collect_timing    = False {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] service_user.insecure          = False {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] service_user.keyfile           = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] service_user.send_service_user_token = True {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] service_user.split_loggers     = False {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] service_user.timeout           = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] glance.auth_section            = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] glance.auth_type               = password {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] glance.certfile                = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] glance.collect_timing          = False {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] glance.insecure                = False {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] glance.keyfile                 = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] glance.region_name             = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] glance.split_loggers           = False {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] glance.timeout                 = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] backend_defaults.backend_availability_zone = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] backend_defaults.chap_password = **** {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] backend_defaults.chap_username =  {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] backend_defaults.disk_geometry = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] backend_defaults.driver_client_cert = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] backend_defaults.driver_client_cert_key = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] backend_defaults.driver_data_namespace = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] backend_defaults.driver_use_ssl = False {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] backend_defaults.enable_unsupported_driver = False {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] backend_defaults.extra_capabilities = {} {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] backend_defaults.filter_function = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] backend_defaults.goodness_function = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75710]: DEBUG oslo_concurrency.processutils [None req-b9ce6a5a-2caf-4d9d-8986-1c4c2b7973d6 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.061s {{(pid=75710) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75710]: DEBUG oslo_concurrency.processutils [None req-b9ce6a5a-2caf-4d9d-8986-1c4c2b7973d6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=75710) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] backend_defaults.iscsi_target_flags =  {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] backend_defaults.iscsi_write_cache = on {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] backend_defaults.iser_helper   = tgtadm {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] backend_defaults.iser_ip_address = 192.168.122.181 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] backend_defaults.iser_port     = 3260 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] backend_defaults.lvm_mirrors   = 0 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] backend_defaults.lvm_share_target = False {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] backend_defaults.lvm_type      = auto {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] backend_defaults.num_shell_tries = 3 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] backend_defaults.nvmet_port_id = 1 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] backend_defaults.replication_device = **** {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] backend_defaults.report_discard_supported = False {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] backend_defaults.reserved_percentage = 0 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] backend_defaults.scst_target_driver = iscsi {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] backend_defaults.scst_target_iqn_name = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] backend_defaults.storage_protocol = iSCSI {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] backend_defaults.target_helper = tgtadm {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] backend_defaults.target_ip_address = 192.168.122.181 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] backend_defaults.target_port   = 3260 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] backend_defaults.target_protocol = iscsi {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] backend_defaults.trace_flags   = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] backend_defaults.unique_fqdn_network = True {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] backend_defaults.use_chap_auth = False {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] backend_defaults.volume_backend_name = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] backend_defaults.volume_clear  = zero {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] backend_defaults.volume_clear_ionice = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] backend_defaults.volume_clear_size = 0 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] backend_defaults.volume_group  = cinder-volumes {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] oslo_reports.file_event_handler = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] oslo_reports.log_dir           = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] lvmdriver-1.backend_availability_zone = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] lvmdriver-1.backend_host       = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] lvmdriver-1.chap_password      = **** {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] lvmdriver-1.chap_username      = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] lvmdriver-1.chiscsi_conf       = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] lvmdriver-1.disk_geometry      = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] lvmdriver-1.driver_client_cert = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] lvmdriver-1.driver_data_namespace = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] lvmdriver-1.driver_use_ssl     = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] lvmdriver-1.extra_capabilities = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] lvmdriver-1.filter_function    = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] lvmdriver-1.goodness_function  = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] lvmdriver-1.iscsi_write_cache  = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] lvmdriver-1.iser_helper        = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] lvmdriver-1.iser_ip_address    = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] lvmdriver-1.iser_port          = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] lvmdriver-1.iser_target_prefix = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] lvmdriver-1.lvm_conf_file      = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] lvmdriver-1.lvm_mirrors        = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] lvmdriver-1.lvm_share_target   = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] lvmdriver-1.lvm_type           = auto {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack sudo[75715]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] lvmdriver-1.num_shell_tries    = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] lvmdriver-1.nvmet_ns_id        = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] lvmdriver-1.nvmet_port_id      = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] lvmdriver-1.replication_device = **** {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack sudo[75715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] lvmdriver-1.report_discard_supported = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] lvmdriver-1.reserved_percentage = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] lvmdriver-1.scst_target_driver = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] lvmdriver-1.storage_protocol   = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] lvmdriver-1.target_helper      = lioadm {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] lvmdriver-1.target_ip_address  = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] lvmdriver-1.target_port        = 3260 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] lvmdriver-1.target_prefix      = iqn.2010-10.org.openstack: {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] lvmdriver-1.target_protocol    = iscsi {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] lvmdriver-1.trace_flags        = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] lvmdriver-1.use_chap_auth      = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] lvmdriver-1.volume_clear       = zero {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] lvmdriver-1.volume_clear_size  = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] lvmdriver-1.volume_driver      = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] lvmdriver-1.volume_group       = stack-volumes-lvmdriver-1 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] lvmdriver-1.volumes_dir        = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] oslo_messaging_rabbit.ssl      = False {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] oslo_messaging_notifications.driver = [] {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] oslo_messaging_notifications.retry = -1 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] oslo_messaging_notifications.transport_url = **** {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] key_manager.fixed_key          = **** {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] barbican.barbican_api_version  = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] barbican.barbican_endpoint     = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] barbican.barbican_endpoint_type = public {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] barbican.barbican_region_name  = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] barbican.cafile                = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] barbican.certfile              = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] barbican.collect_timing        = False {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] barbican.insecure              = False {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] barbican.keyfile               = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] barbican.number_of_retries     = 60 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] barbican.retry_delay           = 1 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] barbican.send_service_user_token = False {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] barbican.split_loggers         = False {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] barbican.timeout               = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] barbican.verify_ssl            = True {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] barbican.verify_ssl_path       = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] barbican_service_user.auth_section = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] barbican_service_user.auth_type = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] barbican_service_user.cafile   = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] barbican_service_user.certfile = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] barbican_service_user.collect_timing = False {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] barbican_service_user.insecure = False {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] barbican_service_user.keyfile  = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] barbican_service_user.split_loggers = False {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] barbican_service_user.timeout  = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] vault.approle_role_id          = **** {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] vault.approle_secret_id        = **** {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] vault.kv_mountpoint            = secret {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] vault.kv_path                  = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] vault.kv_version               = 2 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] vault.namespace                = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] vault.root_token_id            = **** {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] vault.ssl_ca_crt_file          = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] vault.timeout                  = 60.0 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] vault.use_ssl                  = False {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:34:38 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] ******************************************************************************** {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}}
Jul 02 19:34:39 devstack sudo[75715]: pam_unix(sudo:session): session closed for user root
Jul 02 19:34:39 devstack cinder-volume[75710]: DEBUG oslo_concurrency.processutils [None req-b9ce6a5a-2caf-4d9d-8986-1c4c2b7973d6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.927s {{(pid=75710) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:34:39 devstack cinder-volume[75710]: DEBUG oslo_concurrency.processutils [None req-b9ce6a5a-2caf-4d9d-8986-1c4c2b7973d6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75710) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:34:39 devstack sudo[75788]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 02 19:34:39 devstack sudo[75788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:34:40 devstack sudo[75788]: pam_unix(sudo:session): session closed for user root
Jul 02 19:34:40 devstack cinder-volume[75710]: DEBUG oslo_concurrency.processutils [None req-b9ce6a5a-2caf-4d9d-8986-1c4c2b7973d6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.930s {{(pid=75710) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:34:40 devstack cinder-volume[75710]: DEBUG oslo_concurrency.processutils [None req-b9ce6a5a-2caf-4d9d-8986-1c4c2b7973d6 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=75710) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 02 19:34:40 devstack cinder-volume[75710]: INFO cinder.brick.local_dev.lvm [None req-b9ce6a5a-2caf-4d9d-8986-1c4c2b7973d6 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool
Jul 02 19:34:40 devstack cinder-volume[75710]: DEBUG oslo_concurrency.processutils [None req-b9ce6a5a-2caf-4d9d-8986-1c4c2b7973d6 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75710) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:34:40 devstack cinder-volume[75710]: DEBUG oslo_concurrency.processutils [None req-b9ce6a5a-2caf-4d9d-8986-1c4c2b7973d6 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.024s {{(pid=75710) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:34:40 devstack cinder-volume[75710]: DEBUG oslo_concurrency.processutils [None req-b9ce6a5a-2caf-4d9d-8986-1c4c2b7973d6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75710) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:34:40 devstack sudo[76027]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jul 02 19:34:40 devstack sudo[76027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:34:40 devstack sudo[76027]: pam_unix(sudo:session): session closed for user root
Jul 02 19:34:40 devstack cinder-volume[75710]: DEBUG oslo_concurrency.processutils [None req-b9ce6a5a-2caf-4d9d-8986-1c4c2b7973d6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.918s {{(pid=75710) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:34:40 devstack cinder-volume[75710]: DEBUG cinder.brick.local_dev.lvm [None req-b9ce6a5a-2caf-4d9d-8986-1c4c2b7973d6 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=75710) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}}
Jul 02 19:34:40 devstack cinder-volume[75710]: DEBUG oslo_concurrency.processutils [None req-b9ce6a5a-2caf-4d9d-8986-1c4c2b7973d6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75710) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:34:40 devstack sudo[76282]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 02 19:34:40 devstack sudo[76282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:34:42 devstack sudo[76282]: pam_unix(sudo:session): session closed for user root
Jul 02 19:34:42 devstack cinder-volume[75710]: DEBUG oslo_concurrency.processutils [None req-b9ce6a5a-2caf-4d9d-8986-1c4c2b7973d6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.228s {{(pid=75710) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:34:42 devstack cinder-volume[75710]: DEBUG oslo_concurrency.processutils [None req-b9ce6a5a-2caf-4d9d-8986-1c4c2b7973d6 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75710) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:34:42 devstack cinder-volume[75710]: DEBUG oslo_concurrency.processutils [None req-b9ce6a5a-2caf-4d9d-8986-1c4c2b7973d6 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.039s {{(pid=75710) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:34:42 devstack cinder-volume[75710]: DEBUG oslo_concurrency.processutils [None req-b9ce6a5a-2caf-4d9d-8986-1c4c2b7973d6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75710) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:34:42 devstack sudo[76465]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 02 19:34:42 devstack sudo[76465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:34:43 devstack sudo[76465]: pam_unix(sudo:session): session closed for user root
Jul 02 19:34:43 devstack cinder-volume[75710]: DEBUG oslo_concurrency.processutils [None req-b9ce6a5a-2caf-4d9d-8986-1c4c2b7973d6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.866s {{(pid=75710) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:34:43 devstack cinder-volume[75710]: DEBUG oslo_concurrency.processutils [None req-b9ce6a5a-2caf-4d9d-8986-1c4c2b7973d6 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75710) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:34:43 devstack cinder-volume[75710]: DEBUG oslo_concurrency.processutils [None req-b9ce6a5a-2caf-4d9d-8986-1c4c2b7973d6 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.022s {{(pid=75710) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:34:43 devstack cinder-volume[75710]: DEBUG oslo_concurrency.processutils [None req-b9ce6a5a-2caf-4d9d-8986-1c4c2b7973d6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=75710) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:34:43 devstack sudo[76495]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster
Jul 02 19:34:43 devstack sudo[76495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:34:43 devstack sudo[76495]: pam_unix(sudo:session): session closed for user root
Jul 02 19:34:44 devstack cinder-volume[75710]: DEBUG oslo_concurrency.processutils [None req-b9ce6a5a-2caf-4d9d-8986-1c4c2b7973d6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.880s {{(pid=75710) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:34:44 devstack cinder-volume[75710]: DEBUG oslo_concurrency.processutils [None req-b9ce6a5a-2caf-4d9d-8986-1c4c2b7973d6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75710) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:34:44 devstack sudo[76499]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jul 02 19:34:44 devstack sudo[76499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:34:44 devstack sudo[76499]: pam_unix(sudo:session): session closed for user root
Jul 02 19:34:44 devstack cinder-volume[75710]: DEBUG oslo_concurrency.processutils [None req-b9ce6a5a-2caf-4d9d-8986-1c4c2b7973d6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.910s {{(pid=75710) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:34:44 devstack cinder-volume[75710]: DEBUG oslo_concurrency.processutils [None req-b9ce6a5a-2caf-4d9d-8986-1c4c2b7973d6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75710) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:34:44 devstack sudo[76508]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jul 02 19:34:44 devstack sudo[76508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:34:45 devstack sudo[76508]: pam_unix(sudo:session): session closed for user root
Jul 02 19:34:45 devstack cinder-volume[75710]: DEBUG oslo_concurrency.processutils [None req-b9ce6a5a-2caf-4d9d-8986-1c4c2b7973d6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.818s {{(pid=75710) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:34:45 devstack cinder-volume[75710]: DEBUG oslo_concurrency.processutils [None req-b9ce6a5a-2caf-4d9d-8986-1c4c2b7973d6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75710) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:34:45 devstack sudo[76519]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 02 19:34:45 devstack sudo[76519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:34:46 devstack sudo[76519]: pam_unix(sudo:session): session closed for user root
Jul 02 19:34:46 devstack cinder-volume[75710]: DEBUG oslo_concurrency.processutils [None req-b9ce6a5a-2caf-4d9d-8986-1c4c2b7973d6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.774s {{(pid=75710) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:34:46 devstack cinder-volume[75710]: DEBUG oslo_concurrency.processutils [None req-b9ce6a5a-2caf-4d9d-8986-1c4c2b7973d6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75710) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:34:46 devstack sudo[76523]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 02 19:34:46 devstack sudo[76523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:34:47 devstack sudo[76523]: pam_unix(sudo:session): session closed for user root
Jul 02 19:34:47 devstack cinder-volume[75710]: DEBUG oslo_concurrency.processutils [None req-b9ce6a5a-2caf-4d9d-8986-1c4c2b7973d6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.672s {{(pid=75710) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:34:47 devstack cinder-volume[75710]: DEBUG oslo_concurrency.processutils [None req-b9ce6a5a-2caf-4d9d-8986-1c4c2b7973d6 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75710) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:34:47 devstack cinder-volume[75710]: DEBUG oslo_concurrency.processutils [None req-b9ce6a5a-2caf-4d9d-8986-1c4c2b7973d6 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=75710) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:34:47 devstack cinder-volume[75710]: DEBUG oslo_concurrency.processutils [None req-b9ce6a5a-2caf-4d9d-8986-1c4c2b7973d6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75710) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:34:47 devstack sudo[76527]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 02 19:34:47 devstack sudo[76527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:34:47 devstack cinder-volume[75556]: DEBUG dbcounter [-] [75556] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75556) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 02 19:34:47 devstack sudo[76527]: pam_unix(sudo:session): session closed for user root
Jul 02 19:34:47 devstack cinder-volume[75710]: DEBUG oslo_concurrency.processutils [None req-b9ce6a5a-2caf-4d9d-8986-1c4c2b7973d6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.776s {{(pid=75710) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:34:47 devstack cinder-volume[75710]: INFO cinder.volume.drivers.lvm [None req-b9ce6a5a-2caf-4d9d-8986-1c4c2b7973d6 None None] Enabling LVM thin provisioning by default because a thin pool exists.
Jul 02 19:34:47 devstack cinder-volume[75710]: DEBUG oslo_concurrency.processutils [None req-b9ce6a5a-2caf-4d9d-8986-1c4c2b7973d6 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75710) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:34:48 devstack cinder-volume[75710]: DEBUG oslo_concurrency.processutils [None req-b9ce6a5a-2caf-4d9d-8986-1c4c2b7973d6 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.037s {{(pid=75710) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:34:48 devstack cinder-volume[75710]: DEBUG oslo_concurrency.processutils [None req-b9ce6a5a-2caf-4d9d-8986-1c4c2b7973d6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75710) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:34:48 devstack sudo[76537]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 02 19:34:48 devstack sudo[76537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:34:48 devstack sudo[76537]: pam_unix(sudo:session): session closed for user root
Jul 02 19:34:48 devstack cinder-volume[75710]: DEBUG oslo_concurrency.processutils [None req-b9ce6a5a-2caf-4d9d-8986-1c4c2b7973d6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.922s {{(pid=75710) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:34:48 devstack cinder-volume[75710]: DEBUG cinder.volume.drivers.lvm [None req-b9ce6a5a-2caf-4d9d-8986-1c4c2b7973d6 None None] Updating volume stats {{(pid=75710) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Jul 02 19:34:48 devstack cinder-volume[75710]: DEBUG oslo_concurrency.processutils [None req-b9ce6a5a-2caf-4d9d-8986-1c4c2b7973d6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75710) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:34:48 devstack sudo[76650]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jul 02 19:34:48 devstack sudo[76650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:34:49 devstack sudo[76650]: pam_unix(sudo:session): session closed for user root
Jul 02 19:34:49 devstack cinder-volume[75710]: DEBUG oslo_concurrency.processutils [None req-b9ce6a5a-2caf-4d9d-8986-1c4c2b7973d6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.866s {{(pid=75710) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:34:49 devstack cinder-volume[75710]: DEBUG oslo_concurrency.processutils [None req-b9ce6a5a-2caf-4d9d-8986-1c4c2b7973d6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75710) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:34:49 devstack sudo[76794]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 02 19:34:49 devstack sudo[76794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:34:50 devstack sudo[76794]: pam_unix(sudo:session): session closed for user root
Jul 02 19:34:50 devstack cinder-volume[75710]: DEBUG oslo_concurrency.processutils [None req-b9ce6a5a-2caf-4d9d-8986-1c4c2b7973d6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.778s {{(pid=75710) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:34:50 devstack cinder-volume[75710]: DEBUG oslo_concurrency.processutils [None req-b9ce6a5a-2caf-4d9d-8986-1c4c2b7973d6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75710) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:34:50 devstack sudo[76797]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 02 19:34:50 devstack sudo[76797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:34:51 devstack sudo[76797]: pam_unix(sudo:session): session closed for user root
Jul 02 19:34:51 devstack cinder-volume[75710]: DEBUG oslo_concurrency.processutils [None req-b9ce6a5a-2caf-4d9d-8986-1c4c2b7973d6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.705s {{(pid=75710) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:34:51 devstack cinder-volume[75710]: DEBUG oslo_concurrency.processutils [None req-b9ce6a5a-2caf-4d9d-8986-1c4c2b7973d6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75710) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:34:51 devstack sudo[76800]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 02 19:34:51 devstack sudo[76800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:34:52 devstack sudo[76800]: pam_unix(sudo:session): session closed for user root
Jul 02 19:34:52 devstack cinder-volume[75710]: DEBUG oslo_concurrency.processutils [None req-b9ce6a5a-2caf-4d9d-8986-1c4c2b7973d6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.746s {{(pid=75710) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:34:52 devstack cinder-volume[75710]: INFO cinder.volume.driver [None req-b9ce6a5a-2caf-4d9d-8986-1c4c2b7973d6 None None] Driver hasn't implemented _init_vendor_properties()
Jul 02 19:34:52 devstack cinder-volume[75710]: DEBUG cinder.volume.driver [None req-b9ce6a5a-2caf-4d9d-8986-1c4c2b7973d6 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=75710) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Jul 02 19:34:52 devstack cinder-volume[75710]: DEBUG oslo_db.sqlalchemy.engines [None req-b9ce6a5a-2caf-4d9d-8986-1c4c2b7973d6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75710) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 02 19:34:52 devstack cinder-volume[75710]: DEBUG dbcounter [-] [75710] Writer thread running {{(pid=75710) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Jul 02 19:34:52 devstack cinder-volume[75710]: DEBUG cinder.db.api [None req-b9ce6a5a-2caf-4d9d-8986-1c4c2b7973d6 None None] Building query based on filter {{(pid=75710) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}}
Jul 02 19:34:52 devstack cinder-volume[75710]: DEBUG cinder.image.image_utils [None req-b9ce6a5a-2caf-4d9d-8986-1c4c2b7973d6 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=75710) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}}
Jul 02 19:34:52 devstack cinder-volume[75710]: INFO cinder.keymgr.migration [None req-d862de22-34ca-4a6c-a2e0-784dc9f2b1dd None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Jul 02 19:34:52 devstack cinder-volume[75710]: DEBUG cinder.volume.drivers.lvm [None req-b9ce6a5a-2caf-4d9d-8986-1c4c2b7973d6 None None] Updating volume stats {{(pid=75710) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Jul 02 19:34:52 devstack cinder-volume[75710]: DEBUG oslo_concurrency.processutils [None req-b9ce6a5a-2caf-4d9d-8986-1c4c2b7973d6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75710) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:34:52 devstack sudo[76805]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jul 02 19:34:52 devstack sudo[76805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:34:52 devstack sudo[76805]: pam_unix(sudo:session): session closed for user root
Jul 02 19:34:52 devstack cinder-volume[75710]: DEBUG oslo_concurrency.processutils [None req-b9ce6a5a-2caf-4d9d-8986-1c4c2b7973d6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.781s {{(pid=75710) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:34:52 devstack cinder-volume[75710]: DEBUG oslo_concurrency.processutils [None req-b9ce6a5a-2caf-4d9d-8986-1c4c2b7973d6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75710) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:34:53 devstack sudo[76809]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 02 19:34:53 devstack sudo[76809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:34:53 devstack sudo[76809]: pam_unix(sudo:session): session closed for user root
Jul 02 19:34:53 devstack cinder-volume[75710]: DEBUG oslo_concurrency.processutils [None req-b9ce6a5a-2caf-4d9d-8986-1c4c2b7973d6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.732s {{(pid=75710) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:34:53 devstack cinder-volume[75710]: DEBUG oslo_concurrency.processutils [None req-b9ce6a5a-2caf-4d9d-8986-1c4c2b7973d6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75710) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:34:53 devstack sudo[76815]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 02 19:34:53 devstack sudo[76815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:34:54 devstack sudo[76815]: pam_unix(sudo:session): session closed for user root
Jul 02 19:34:54 devstack cinder-volume[75710]: DEBUG oslo_concurrency.processutils [None req-b9ce6a5a-2caf-4d9d-8986-1c4c2b7973d6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.683s {{(pid=75710) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:34:54 devstack cinder-volume[75710]: DEBUG oslo_concurrency.processutils [None req-b9ce6a5a-2caf-4d9d-8986-1c4c2b7973d6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75710) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:34:54 devstack sudo[76818]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 02 19:34:54 devstack sudo[76818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:34:55 devstack sudo[76818]: pam_unix(sudo:session): session closed for user root
Jul 02 19:34:55 devstack cinder-volume[75710]: DEBUG oslo_concurrency.processutils [None req-b9ce6a5a-2caf-4d9d-8986-1c4c2b7973d6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.848s {{(pid=75710) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:34:55 devstack cinder-volume[75710]: DEBUG cinder.manager [None req-b9ce6a5a-2caf-4d9d-8986-1c4c2b7973d6 None None] Notifying Schedulers of capabilities ... {{(pid=75710) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 19:34:55 devstack cinder-volume[75710]: INFO cinder.volume.manager [None req-b9ce6a5a-2caf-4d9d-8986-1c4c2b7973d6 None None] Driver initialization completed successfully.
Jul 02 19:34:55 devstack cinder-volume[75710]: INFO cinder.manager [None req-b9ce6a5a-2caf-4d9d-8986-1c4c2b7973d6 None None] Initiating service 2 cleanup
Jul 02 19:34:55 devstack cinder-volume[75710]: INFO cinder.manager [None req-b9ce6a5a-2caf-4d9d-8986-1c4c2b7973d6 None None] Service 2 cleanup completed.
Jul 02 19:34:55 devstack cinder-volume[75710]: DEBUG cinder.service [None req-b9ce6a5a-2caf-4d9d-8986-1c4c2b7973d6 None None] Creating RPC server for service cinder-volume {{(pid=75710) start /opt/stack/cinder/cinder/service.py:231}}
Jul 02 19:34:55 devstack cinder-volume[75710]: DEBUG cinder.service [None req-b9ce6a5a-2caf-4d9d-8986-1c4c2b7973d6 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=75710) start /opt/stack/cinder/cinder/service.py:237}}
Jul 02 19:34:55 devstack cinder-volume[75710]: INFO cinder.volume.manager [None req-b9ce6a5a-2caf-4d9d-8986-1c4c2b7973d6 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0)
Jul 02 19:34:55 devstack cinder-volume[75710]: DEBUG cinder.volume.drivers.lvm [None req-b9ce6a5a-2caf-4d9d-8986-1c4c2b7973d6 None None] Updating volume stats {{(pid=75710) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Jul 02 19:34:55 devstack cinder-volume[75710]: DEBUG oslo_concurrency.processutils [None req-b9ce6a5a-2caf-4d9d-8986-1c4c2b7973d6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75710) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:34:55 devstack sudo[76824]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jul 02 19:34:55 devstack sudo[76824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:34:56 devstack sudo[76824]: pam_unix(sudo:session): session closed for user root
Jul 02 19:34:56 devstack cinder-volume[75710]: DEBUG oslo_concurrency.processutils [None req-b9ce6a5a-2caf-4d9d-8986-1c4c2b7973d6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.829s {{(pid=75710) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:34:56 devstack cinder-volume[75710]: DEBUG oslo_concurrency.processutils [None req-b9ce6a5a-2caf-4d9d-8986-1c4c2b7973d6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75710) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:34:56 devstack sudo[76828]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 02 19:34:56 devstack sudo[76828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:34:57 devstack sudo[76828]: pam_unix(sudo:session): session closed for user root
Jul 02 19:34:57 devstack cinder-volume[75710]: DEBUG oslo_concurrency.processutils [None req-b9ce6a5a-2caf-4d9d-8986-1c4c2b7973d6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.839s {{(pid=75710) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:34:57 devstack cinder-volume[75710]: DEBUG oslo_concurrency.processutils [None req-b9ce6a5a-2caf-4d9d-8986-1c4c2b7973d6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75710) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:34:57 devstack sudo[76831]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 02 19:34:57 devstack sudo[76831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:34:57 devstack sudo[76831]: pam_unix(sudo:session): session closed for user root
Jul 02 19:34:57 devstack cinder-volume[75710]: DEBUG oslo_concurrency.processutils [None req-b9ce6a5a-2caf-4d9d-8986-1c4c2b7973d6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.811s {{(pid=75710) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:34:57 devstack cinder-volume[75710]: DEBUG oslo_concurrency.processutils [None req-b9ce6a5a-2caf-4d9d-8986-1c4c2b7973d6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75710) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:34:57 devstack sudo[76891]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 02 19:34:57 devstack sudo[76891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:34:58 devstack sudo[76891]: pam_unix(sudo:session): session closed for user root
Jul 02 19:34:58 devstack cinder-volume[75710]: DEBUG oslo_concurrency.processutils [None req-b9ce6a5a-2caf-4d9d-8986-1c4c2b7973d6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.789s {{(pid=75710) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:34:58 devstack cinder-volume[75710]: INFO cinder.volume.manager [None req-b9ce6a5a-2caf-4d9d-8986-1c4c2b7973d6 None None] Driver post RPC initialization completed successfully.
Jul 02 19:35:00 devstack cinder-volume[75710]: DEBUG oslo_service.periodic_task [None req-18958d1c-13e3-49d3-b736-d970db00053e None None] Running periodic task VolumeManager._thread_info {{(pid=75710) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 02 19:35:00 devstack cinder-volume[75710]: DEBUG cinder.volume.manager [None req-18958d1c-13e3-49d3-b736-d970db00053e None None] thread count: 6 {{(pid=75710) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 02 19:35:00 devstack cinder-volume[75710]: DEBUG cinder.volume.manager [None req-18958d1c-13e3-49d3-b736-d970db00053e None None] thread info: [<_MainThread(MainThread, started 135931135373440)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 135931023591808)>, <Thread(Thread-3 (stat_writer), started daemon 135931023463872)>, <Thread(Rabbit-heartbeat, started daemon 135931022955584)>, <Thread(Thread-5 (_runner), started daemon 135931023107136)>, <Thread(Thread-7 (_runner), started daemon 135931023174912)>] {{(pid=75710) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 02 19:35:08 devstack cinder-volume[75710]: DEBUG dbcounter [-] [75710] Writing DB stats cinder:SELECT=4 {{(pid=75710) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 02 19:35:08 devstack cinder-volume[75710]: DEBUG dbcounter [-] [75710] Writing DB stats cinder:SELECT=10,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=75710) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 02 19:36:00 devstack cinder-volume[75710]: DEBUG oslo_service.periodic_task [None req-18958d1c-13e3-49d3-b736-d970db00053e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75710) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 02 19:36:00 devstack cinder-volume[75710]: DEBUG cinder.volume.drivers.lvm [None req-18958d1c-13e3-49d3-b736-d970db00053e None None] Updating volume stats {{(pid=75710) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Jul 02 19:36:00 devstack cinder-volume[75710]: DEBUG oslo_concurrency.processutils [None req-18958d1c-13e3-49d3-b736-d970db00053e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75710) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:36:00 devstack sudo[78584]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jul 02 19:36:00 devstack sudo[78584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:36:01 devstack sudo[78584]: pam_unix(sudo:session): session closed for user root
Jul 02 19:36:01 devstack cinder-volume[75710]: DEBUG oslo_concurrency.processutils [None req-18958d1c-13e3-49d3-b736-d970db00053e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.788s {{(pid=75710) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:36:01 devstack cinder-volume[75710]: DEBUG oslo_concurrency.processutils [None req-18958d1c-13e3-49d3-b736-d970db00053e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75710) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:36:01 devstack sudo[78605]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 02 19:36:01 devstack sudo[78605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:36:02 devstack sudo[78605]: pam_unix(sudo:session): session closed for user root
Jul 02 19:36:02 devstack cinder-volume[75710]: DEBUG oslo_concurrency.processutils [None req-18958d1c-13e3-49d3-b736-d970db00053e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.783s {{(pid=75710) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:36:02 devstack cinder-volume[75710]: DEBUG oslo_concurrency.processutils [None req-18958d1c-13e3-49d3-b736-d970db00053e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75710) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:36:02 devstack sudo[78609]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 02 19:36:02 devstack sudo[78609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:36:03 devstack sudo[78609]: pam_unix(sudo:session): session closed for user root
Jul 02 19:36:03 devstack cinder-volume[75710]: DEBUG oslo_concurrency.processutils [None req-18958d1c-13e3-49d3-b736-d970db00053e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.817s {{(pid=75710) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:36:03 devstack cinder-volume[75710]: DEBUG oslo_concurrency.processutils [None req-18958d1c-13e3-49d3-b736-d970db00053e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75710) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:36:03 devstack sudo[78612]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 02 19:36:03 devstack sudo[78612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:36:03 devstack sudo[78612]: pam_unix(sudo:session): session closed for user root
Jul 02 19:36:03 devstack cinder-volume[75710]: DEBUG oslo_concurrency.processutils [None req-18958d1c-13e3-49d3-b736-d970db00053e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.709s {{(pid=75710) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:36:03 devstack cinder-volume[75710]: DEBUG cinder.manager [None req-18958d1c-13e3-49d3-b736-d970db00053e None None] Notifying Schedulers of capabilities ... {{(pid=75710) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 19:36:03 devstack cinder-volume[75710]: DEBUG oslo_service.periodic_task [None req-18958d1c-13e3-49d3-b736-d970db00053e None None] Running periodic task VolumeManager._thread_info {{(pid=75710) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 02 19:36:03 devstack cinder-volume[75710]: DEBUG cinder.volume.manager [None req-18958d1c-13e3-49d3-b736-d970db00053e None None] thread count: 6 {{(pid=75710) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 02 19:36:03 devstack cinder-volume[75710]: DEBUG cinder.volume.manager [None req-18958d1c-13e3-49d3-b736-d970db00053e None None] thread info: [<_MainThread(MainThread, started 135931135373440)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 135931023591808)>, <Thread(Thread-3 (stat_writer), started daemon 135931023463872)>, <Thread(Rabbit-heartbeat, started daemon 135931022955584)>, <Thread(Thread-5 (_runner), started daemon 135931023107136)>, <Thread(Thread-7 (_runner), started daemon 135931023174912)>] {{(pid=75710) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 02 19:37:00 devstack cinder-volume[75710]: DEBUG oslo_service.periodic_task [None req-18958d1c-13e3-49d3-b736-d970db00053e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75710) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 02 19:37:00 devstack cinder-volume[75710]: DEBUG cinder.volume.drivers.lvm [None req-18958d1c-13e3-49d3-b736-d970db00053e None None] Updating volume stats {{(pid=75710) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Jul 02 19:37:00 devstack cinder-volume[75710]: DEBUG oslo_concurrency.processutils [None req-18958d1c-13e3-49d3-b736-d970db00053e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75710) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:37:00 devstack sudo[81777]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jul 02 19:37:00 devstack sudo[81777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:37:01 devstack sudo[81777]: pam_unix(sudo:session): session closed for user root
Jul 02 19:37:01 devstack cinder-volume[75710]: DEBUG oslo_concurrency.processutils [None req-18958d1c-13e3-49d3-b736-d970db00053e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.769s {{(pid=75710) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:37:01 devstack cinder-volume[75710]: DEBUG oslo_concurrency.processutils [None req-18958d1c-13e3-49d3-b736-d970db00053e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75710) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:37:01 devstack sudo[81780]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 02 19:37:01 devstack sudo[81780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:37:02 devstack sudo[81780]: pam_unix(sudo:session): session closed for user root
Jul 02 19:37:02 devstack cinder-volume[75710]: DEBUG oslo_concurrency.processutils [None req-18958d1c-13e3-49d3-b736-d970db00053e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.781s {{(pid=75710) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:37:02 devstack cinder-volume[75710]: DEBUG oslo_concurrency.processutils [None req-18958d1c-13e3-49d3-b736-d970db00053e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75710) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:37:02 devstack sudo[81783]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 02 19:37:02 devstack sudo[81783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:37:03 devstack sudo[81783]: pam_unix(sudo:session): session closed for user root
Jul 02 19:37:03 devstack cinder-volume[75710]: DEBUG oslo_concurrency.processutils [None req-18958d1c-13e3-49d3-b736-d970db00053e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.801s {{(pid=75710) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:37:03 devstack cinder-volume[75710]: DEBUG oslo_concurrency.processutils [None req-18958d1c-13e3-49d3-b736-d970db00053e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75710) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:37:03 devstack sudo[81789]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 02 19:37:03 devstack sudo[81789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:37:03 devstack sudo[81789]: pam_unix(sudo:session): session closed for user root
Jul 02 19:37:03 devstack cinder-volume[75710]: DEBUG oslo_concurrency.processutils [None req-18958d1c-13e3-49d3-b736-d970db00053e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.679s {{(pid=75710) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:37:03 devstack cinder-volume[75710]: DEBUG cinder.manager [None req-18958d1c-13e3-49d3-b736-d970db00053e None None] Notifying Schedulers of capabilities ... {{(pid=75710) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 19:37:03 devstack cinder-volume[75710]: DEBUG oslo_service.periodic_task [None req-18958d1c-13e3-49d3-b736-d970db00053e None None] Running periodic task VolumeManager._thread_info {{(pid=75710) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 02 19:37:03 devstack cinder-volume[75710]: DEBUG cinder.volume.manager [None req-18958d1c-13e3-49d3-b736-d970db00053e None None] thread count: 6 {{(pid=75710) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 02 19:37:03 devstack cinder-volume[75710]: DEBUG cinder.volume.manager [None req-18958d1c-13e3-49d3-b736-d970db00053e None None] thread info: [<_MainThread(MainThread, started 135931135373440)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 135931023591808)>, <Thread(Thread-3 (stat_writer), started daemon 135931023463872)>, <Thread(Rabbit-heartbeat, started daemon 135931022955584)>, <Thread(Thread-5 (_runner), started daemon 135931023107136)>, <Thread(Thread-7 (_runner), started daemon 135931023174912)>] {{(pid=75710) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 02 19:37:08 devstack cinder-volume[75710]: DEBUG dbcounter [-] [75710] Writing DB stats cinder:SELECT=1 {{(pid=75710) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 02 19:37:08 devstack cinder-volume[75710]: DEBUG dbcounter [-] [75710] Writing DB stats cinder:UPDATE=1 {{(pid=75710) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 02 19:38:00 devstack cinder-volume[75710]: DEBUG oslo_service.periodic_task [None req-18958d1c-13e3-49d3-b736-d970db00053e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75710) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 02 19:38:00 devstack cinder-volume[75710]: DEBUG cinder.volume.drivers.lvm [None req-18958d1c-13e3-49d3-b736-d970db00053e None None] Updating volume stats {{(pid=75710) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Jul 02 19:38:00 devstack cinder-volume[75710]: DEBUG oslo_concurrency.processutils [None req-18958d1c-13e3-49d3-b736-d970db00053e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75710) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:38:00 devstack sudo[83423]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jul 02 19:38:00 devstack sudo[83423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:38:01 devstack sudo[83423]: pam_unix(sudo:session): session closed for user root
Jul 02 19:38:01 devstack cinder-volume[75710]: DEBUG oslo_concurrency.processutils [None req-18958d1c-13e3-49d3-b736-d970db00053e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.728s {{(pid=75710) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:38:01 devstack cinder-volume[75710]: DEBUG oslo_concurrency.processutils [None req-18958d1c-13e3-49d3-b736-d970db00053e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75710) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:38:01 devstack sudo[83437]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 02 19:38:01 devstack sudo[83437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:38:02 devstack sudo[83437]: pam_unix(sudo:session): session closed for user root
Jul 02 19:38:02 devstack cinder-volume[75710]: DEBUG oslo_concurrency.processutils [None req-18958d1c-13e3-49d3-b736-d970db00053e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.893s {{(pid=75710) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:38:02 devstack cinder-volume[75710]: DEBUG oslo_concurrency.processutils [None req-18958d1c-13e3-49d3-b736-d970db00053e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75710) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:38:02 devstack sudo[83466]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 02 19:38:02 devstack sudo[83466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:38:03 devstack sudo[83466]: pam_unix(sudo:session): session closed for user root
Jul 02 19:38:03 devstack cinder-volume[75710]: DEBUG oslo_concurrency.processutils [None req-18958d1c-13e3-49d3-b736-d970db00053e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.875s {{(pid=75710) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:38:03 devstack cinder-volume[75710]: DEBUG oslo_concurrency.processutils [None req-18958d1c-13e3-49d3-b736-d970db00053e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75710) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:38:03 devstack sudo[83495]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 02 19:38:03 devstack sudo[83495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:38:04 devstack sudo[83495]: pam_unix(sudo:session): session closed for user root
Jul 02 19:38:04 devstack cinder-volume[75710]: DEBUG oslo_concurrency.processutils [None req-18958d1c-13e3-49d3-b736-d970db00053e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.884s {{(pid=75710) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:38:04 devstack cinder-volume[75710]: DEBUG cinder.manager [None req-18958d1c-13e3-49d3-b736-d970db00053e None None] Notifying Schedulers of capabilities ... {{(pid=75710) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 19:38:04 devstack cinder-volume[75710]: DEBUG oslo_service.periodic_task [None req-18958d1c-13e3-49d3-b736-d970db00053e None None] Running periodic task VolumeManager._thread_info {{(pid=75710) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 02 19:38:04 devstack cinder-volume[75710]: DEBUG cinder.volume.manager [None req-18958d1c-13e3-49d3-b736-d970db00053e None None] thread count: 6 {{(pid=75710) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 02 19:38:04 devstack cinder-volume[75710]: DEBUG cinder.volume.manager [None req-18958d1c-13e3-49d3-b736-d970db00053e None None] thread info: [<_MainThread(MainThread, started 135931135373440)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 135931023591808)>, <Thread(Thread-3 (stat_writer), started daemon 135931023463872)>, <Thread(Rabbit-heartbeat, started daemon 135931022955584)>, <Thread(Thread-5 (_runner), started daemon 135931023107136)>, <Thread(Thread-7 (_runner), started daemon 135931023174912)>] {{(pid=75710) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 02 19:39:00 devstack cinder-volume[75710]: DEBUG oslo_service.periodic_task [None req-18958d1c-13e3-49d3-b736-d970db00053e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75710) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 02 19:39:00 devstack cinder-volume[75710]: DEBUG cinder.volume.drivers.lvm [None req-18958d1c-13e3-49d3-b736-d970db00053e None None] Updating volume stats {{(pid=75710) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Jul 02 19:39:00 devstack cinder-volume[75710]: DEBUG oslo_concurrency.processutils [None req-18958d1c-13e3-49d3-b736-d970db00053e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75710) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:39:00 devstack sudo[84684]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jul 02 19:39:00 devstack sudo[84684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:39:01 devstack sudo[84684]: pam_unix(sudo:session): session closed for user root
Jul 02 19:39:01 devstack cinder-volume[75710]: DEBUG oslo_concurrency.processutils [None req-18958d1c-13e3-49d3-b736-d970db00053e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.736s {{(pid=75710) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:39:01 devstack cinder-volume[75710]: DEBUG oslo_concurrency.processutils [None req-18958d1c-13e3-49d3-b736-d970db00053e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75710) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:39:01 devstack sudo[84688]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 02 19:39:01 devstack sudo[84688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:39:02 devstack sudo[84688]: pam_unix(sudo:session): session closed for user root
Jul 02 19:39:02 devstack cinder-volume[75710]: DEBUG oslo_concurrency.processutils [None req-18958d1c-13e3-49d3-b736-d970db00053e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.722s {{(pid=75710) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:39:02 devstack cinder-volume[75710]: DEBUG oslo_concurrency.processutils [None req-18958d1c-13e3-49d3-b736-d970db00053e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75710) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:39:02 devstack sudo[84702]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 02 19:39:02 devstack sudo[84702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:39:03 devstack sudo[84702]: pam_unix(sudo:session): session closed for user root
Jul 02 19:39:03 devstack cinder-volume[75710]: DEBUG oslo_concurrency.processutils [None req-18958d1c-13e3-49d3-b736-d970db00053e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.764s {{(pid=75710) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:39:03 devstack cinder-volume[75710]: DEBUG oslo_concurrency.processutils [None req-18958d1c-13e3-49d3-b736-d970db00053e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75710) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:39:03 devstack sudo[84729]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 02 19:39:03 devstack sudo[84729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:39:03 devstack sudo[84729]: pam_unix(sudo:session): session closed for user root
Jul 02 19:39:03 devstack cinder-volume[75710]: DEBUG oslo_concurrency.processutils [None req-18958d1c-13e3-49d3-b736-d970db00053e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.785s {{(pid=75710) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:39:03 devstack cinder-volume[75710]: DEBUG cinder.manager [None req-18958d1c-13e3-49d3-b736-d970db00053e None None] Notifying Schedulers of capabilities ... {{(pid=75710) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 19:39:03 devstack cinder-volume[75710]: DEBUG oslo_service.periodic_task [None req-18958d1c-13e3-49d3-b736-d970db00053e None None] Running periodic task VolumeManager._thread_info {{(pid=75710) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 02 19:39:03 devstack cinder-volume[75710]: DEBUG cinder.volume.manager [None req-18958d1c-13e3-49d3-b736-d970db00053e None None] thread count: 6 {{(pid=75710) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 02 19:39:03 devstack cinder-volume[75710]: DEBUG cinder.volume.manager [None req-18958d1c-13e3-49d3-b736-d970db00053e None None] thread info: [<_MainThread(MainThread, started 135931135373440)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 135931023591808)>, <Thread(Thread-3 (stat_writer), started daemon 135931023463872)>, <Thread(Rabbit-heartbeat, started daemon 135931022955584)>, <Thread(Thread-5 (_runner), started daemon 135931023107136)>, <Thread(Thread-7 (_runner), started daemon 135931023174912)>] {{(pid=75710) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 02 19:39:08 devstack cinder-volume[75710]: DEBUG dbcounter [-] [75710] Writing DB stats cinder:SELECT=1 {{(pid=75710) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 02 19:39:08 devstack cinder-volume[75710]: DEBUG dbcounter [-] [75710] Writing DB stats cinder:UPDATE=1 {{(pid=75710) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 02 19:39:55 devstack cinder-volume[75556]: INFO oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] Caught SIGTERM, stopping children
Jul 02 19:39:55 devstack cinder-volume[75556]: DEBUG oslo_concurrency.lockutils [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] Acquiring lock "singleton_lock" {{(pid=75556) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jul 02 19:39:55 devstack cinder-volume[75556]: DEBUG oslo_concurrency.lockutils [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] Acquired lock "singleton_lock" {{(pid=75556) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jul 02 19:39:55 devstack cinder-volume[75556]: DEBUG oslo_concurrency.lockutils [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] Releasing lock "singleton_lock" {{(pid=75556) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jul 02 19:39:55 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] Stop services. {{(pid=75556) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Jul 02 19:39:55 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] Killing children. {{(pid=75556) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Jul 02 19:39:55 devstack cinder-volume[75556]: INFO oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] Waiting on 1 children to exit
Jul 02 19:40:00 devstack cinder-volume[75710]: DEBUG oslo_concurrency.lockutils [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] Acquiring lock "singleton_lock" {{(pid=75710) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jul 02 19:40:00 devstack cinder-volume[75710]: DEBUG oslo_concurrency.lockutils [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] Acquired lock "singleton_lock" {{(pid=75710) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jul 02 19:40:00 devstack cinder-volume[75710]: DEBUG oslo_concurrency.lockutils [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] Releasing lock "singleton_lock" {{(pid=75710) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jul 02 19:40:00 devstack cinder-volume[75710]: WARNING amqp [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Jul 02 19:40:00 devstack cinder-volume[75710]: WARNING amqp [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Jul 02 19:40:00 devstack cinder-volume[75556]: INFO oslo_service.backend._eventlet.service [None req-d5e6e649-7f35-480b-ac7b-af7cb28d7a58 None None] Child 75710 exited with status 0
Jul 02 19:40:01 devstack cinder-volume[85814]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Jul 02 19:40:01 devstack cinder-volume[85814]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Jul 02 19:40:01 devstack cinder-volume[85814]: we strongly recommend against using it for new projects.
Jul 02 19:40:01 devstack cinder-volume[85814]: If you are already using Eventlet, we recommend migrating to a different
Jul 02 19:40:01 devstack cinder-volume[85814]: framework.  For more detail see
Jul 02 19:40:01 devstack cinder-volume[85814]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Jul 02 19:40:01 devstack cinder-volume[85814]:   import eventlet  # noqa
Jul 02 19:40:03 devstack cinder-volume[85814]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=85814) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jul 02 19:40:03 devstack cinder-volume[85814]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=85814) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jul 02 19:40:03 devstack cinder-volume[85814]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=85814) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jul 02 19:40:04 devstack cinder-volume[85814]: INFO dbcounter [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] Registered counter for database cinder
Jul 02 19:40:04 devstack cinder-volume[85814]: DEBUG oslo_db.sqlalchemy.engines [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85814) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 02 19:40:04 devstack cinder-volume[85814]: DEBUG dbcounter [-] [85814] Writer thread running {{(pid=85814) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Jul 02 19:40:04 devstack cinder-volume[85814]: INFO cinder.rpc [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Jul 02 19:40:04 devstack cinder-volume[85814]: INFO cinder.rpc [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Jul 02 19:40:04 devstack cinder-volume[85814]: DEBUG oslo_db.sqlalchemy.engines [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85814) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 02 19:40:04 devstack cinder-volume[85814]: INFO cinder.volume.manager [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] Determined volume DB was empty at startup.
Jul 02 19:40:04 devstack cinder-volume[85814]: DEBUG cinder.volume.manager [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=85814) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Jul 02 19:40:04 devstack cinder-volume[85814]: INFO cinder.volume.manager [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] Service not found for updating active_backend_id, assuming default for driver init.
Jul 02 19:40:04 devstack cinder-volume[85814]: WARNING stevedore.named [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jul 02 19:40:04 devstack cinder-volume[85814]: WARNING castellan.key_manager [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jul 02 19:40:04 devstack cinder-volume[85814]: WARNING cinder.keymgr.conf_key_mgr [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jul 02 19:40:04 devstack cinder-volume[85814]: INFO cinder.volume.manager [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] Image-volume cache disabled for host devstack@QuobyteHD.
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_db.sqlalchemy.engines [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85814) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 02 19:40:05 devstack cinder-volume[85814]: INFO oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] Starting 1 workers
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] Started child 86028 {{(pid=85814) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] Full set of CONF: {{(pid=85814) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] ******************************************************************************** {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] Configuration options gathered from: {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] ================================================================================ {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] allow_availability_zone_fallback = False {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] allow_compression_on_image_upload = False {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] allowed_direct_url_schemes     = [] {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] api_rate_limit                 = True {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] auth_strategy                  = keystone {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] backend_availability_zone      = None {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] backend_host                   = None {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] backend_name                   = None {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] backend_stats_polling_interval = 60 {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] backup_api_class               = cinder.backup.api.API {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:05 devstack cinder-volume[86028]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] backup_name_template           = backup-%s {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] backup_use_same_host           = False {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] backup_use_temp_snapshot       = False {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] chap_password                  = **** {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] chap_username                  =  {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] cinder_internal_tenant_project_id = 00fb7bd2636f4f118a3c900d218fbad9 {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] cinder_internal_tenant_user_id = 262938f490114b7f8275a8a6f8a8d644 {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] cluster                        = None {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] compression_format             = gzip {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] compute_api_class              = cinder.compute.nova.API {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] config_dir                     = [] {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] config_source                  = [] {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] control_exchange               = openstack {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] debug                          = True {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] default_availability_zone      = None {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] default_group_type             = None {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] default_volume_type            = QuobyteHD {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] disk_geometry                  = None {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] driver_client_cert             = None {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] driver_client_cert_key         = None {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] driver_data_namespace          = None {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] driver_ssl_cert_path           = None {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] driver_ssl_cert_verify         = False {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] driver_use_ssl                 = False {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] enable_new_services            = True {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] enable_unsupported_driver      = False {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] enabled_backends               = ['QuobyteHD'] {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] enforce_multipath_for_image_xfer = False {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] filter_function                = None {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] glance_api_insecure            = False {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] glance_api_servers             = ['http://192.168.122.181/image'] {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] glance_api_ssl_compression     = False {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] glance_ca_certificates_file    = None {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] glance_catalog_info            = image:glance:publicURL {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] glance_certfile                = None {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] glance_keyfile                 = None {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] glance_num_retries             = 3 {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] glance_request_timeout         = None {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] goodness_function              = None {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] graceful_shutdown_timeout      = 5 {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] group_api_class                = cinder.group.api.API {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] host                           = devstack {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] image_compress_on_upload       = True {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] image_conversion_address_space_limit = 1 {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] image_conversion_cpu_limit     = 60 {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] image_conversion_disable       = False {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] image_upload_use_cinder_backend = False {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] image_upload_use_internal_tenant = False {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] image_volume_cache_enabled     = False {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] image_volume_cache_max_count   = 0 {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] image_volume_cache_max_size_gb = 0 {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] init_host_max_objects_retrieval = 0 {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] instance_format                = [instance: %(uuid)s]  {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] iscsi_target_flags             =  {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] iscsi_write_cache              = on {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] iser_helper                    = tgtadm {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] iser_ip_address                = 192.168.122.181 {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] iser_port                      = 3260 {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] log_color                      = False {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] log_config_append              = None {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] log_dir                        = None {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] log_file                       = None {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] log_options                    = True {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] log_rotate_interval            = 1 {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] log_rotate_interval_type       = days {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] log_rotation_type              = none {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] max_age                        = 0 {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] max_logfile_count              = 30 {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] max_logfile_size_mb            = 200 {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] max_over_subscription_ratio    = 20.0 {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] message_reap_interval          = 86400 {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] message_ttl                    = 2592000 {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] migration_create_volume_timeout_secs = 300 {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] monkey_patch                   = False {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] monkey_patch_modules           = [] {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] my_ip                          = 192.168.122.181 {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] no_snapshot_gb_quota           = False {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] num_iser_scan_tries            = 3 {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] num_shell_tries                = 3 {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] num_volume_device_scan_tries   = 3 {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] nvmeof_conn_info_version       = 1 {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] nvmet_ns_id                    = 10 {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] nvmet_port_id                  = 1 {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] osapi_max_limit                = 1000 {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] osapi_volume_ext_list          = [] {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] osapi_volume_listen_port       = 8776 {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] osapi_volume_use_ssl           = False {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] osapi_volume_workers           = None {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] per_volume_size_limit          = -1 {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] periodic_fuzzy_delay           = 60 {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] periodic_interval              = 60 {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] public_endpoint                = None {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] publish_errors                 = False {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] quota_backup_gigabytes         = 1000 {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] quota_backups                  = 10 {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] quota_gigabytes                = 1000 {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] quota_groups                   = 10 {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] quota_snapshots                = 10 {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] quota_volumes                  = 10 {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] rate_limit_burst               = 0 {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] rate_limit_except_level        = CRITICAL {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] rate_limit_interval            = 0 {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] reinit_driver_count            = 3 {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] replication_device             = **** {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] report_discard_supported       = False {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] report_interval                = 120 {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] reservation_clean_interval     = 86400 {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] reservation_expire             = 86400 {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] reserved_image_namespaces      = [] {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] reserved_percentage            = 0 {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] rpc_response_timeout           = 120 {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] run_external_periodic_tasks    = True {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] scst_target_driver             = iscsi {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] scst_target_iqn_name           = None {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] service_down_time              = 720 {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] shell_completion               = None {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] snapshot_name_template         = snapshot-%s {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] split_loggers                  = False {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] state_path                     = /opt/stack/data/cinder {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] storage_availability_zone      = nova {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] storage_protocol               = iSCSI {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] syslog_log_facility            = LOG_USER {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] target_helper                  = lioadm {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] target_ip_address              = 192.168.122.181 {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] target_port                    = 3260 {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] target_protocol                = iscsi {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] target_secondary_ip_addresses  = [] {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] trace_flags                    = None {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] transport_url                  = **** {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] until_refresh                  = 0 {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] use_chap_auth                  = False {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] use_default_quota_class        = True {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] use_journal                    = False {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] use_json                       = False {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] use_multipath_for_image_xfer   = False {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] use_stderr                     = False {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] use_syslog                     = False {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] verify_glance_signatures       = enabled {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] volume_api_class               = cinder.volume.api.API {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] volume_backend_name            = None {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] volume_clear                   = zero {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] volume_clear_ionice            = None {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] volume_clear_size              = 0 {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] volume_copy_bps_limit          = 0 {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] volume_dd_blocksize            = 1M {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] volume_name_template           = volume-%s {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] volume_service_inithost_offload = False {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] volume_usage_audit_period      = month {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] zoning_mode                    = None {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] oslo_concurrency.disable_process_locking = False {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-39069ee1-f078-4554-a313-c45837fd47e4 None None] Starting volume driver QuobyteDriver (1.1.14)
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-39069ee1-f078-4554-a313-c45837fd47e4 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86028) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] keystone_authtoken.auth_section = None {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] keystone_authtoken.auth_type   = password {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] keystone_authtoken.auth_version = None {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] keystone_authtoken.cache       = None {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] keystone_authtoken.certfile    = None {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] keystone_authtoken.delay_auth_decision = False {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] keystone_authtoken.http_connect_timeout = None {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] keystone_authtoken.include_service_catalog = True {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] keystone_authtoken.insecure    = False {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] keystone_authtoken.interface   = public {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] keystone_authtoken.keyfile     = None {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] keystone_authtoken.memcache_password =  {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] keystone_authtoken.memcache_username =  {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] keystone_authtoken.region_name = None {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] keystone_authtoken.service_token_roles_required = True {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] keystone_authtoken.service_type = None {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] keystone_authtoken.token_cache_time = 300 {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.181/identity {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] cache.backend                  = dogpile.cache.null {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] cache.backend_argument         = **** {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] cache.backend_expiration_time  = None {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] cache.config_prefix            = cache.oslo {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] cache.debug_cache_backend      = False {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] cache.enable_retry_client      = False {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] cache.enable_socket_keepalive  = False {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] cache.enabled                  = False {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] cache.expiration_time          = 600 {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] cache.hashclient_retry_attempts = 2 {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] cache.memcache_dead_retry      = 300 {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] cache.memcache_pool_maxsize    = 10 {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] cache.memcache_sasl_enabled    = False {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] cache.password                 = **** {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] cache.proxies                  = [] {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] cache.redis_db                 = 0 {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] cache.redis_sentinel_service_name = mymaster {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] cache.redis_server             = localhost:6379 {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] cache.retry_attempts           = 2 {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] cache.retry_delay              = 0.0 {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] cache.socket_keepalive_count   = 1 {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] cache.socket_keepalive_idle    = 1 {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] cache.socket_keepalive_interval = 1 {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] cache.socket_timeout           = 1.0 {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] cache.tls_allowed_ciphers      = None {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] cache.tls_cafile               = None {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] cache.tls_certfile             = None {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] cache.tls_enabled              = False {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] cache.tls_keyfile              = None {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] cache.username                 = None {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] coordination.backend_url       = **** {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] database.asyncio_connection    = **** {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] database.asyncio_slave_connection = **** {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] database.backend               = sqlalchemy {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] database.connection            = **** {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] database.connection_debug      = 0 {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] database.connection_parameters =  {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] database.connection_recycle_time = 3600 {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] database.connection_trace      = False {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] database.db_inc_retry_interval = True {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] database.db_max_retries        = 20 {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] database.db_max_retry_interval = 10 {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] database.db_retry_interval     = 1 {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] database.max_overflow          = 50 {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] database.max_pool_size         = 5 {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] database.max_retries           = 10 {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] database.mysql_wsrep_sync_wait = None {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] database.pool_timeout          = None {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] database.retry_interval        = 10 {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] database.slave_connection      = **** {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] database.sqlite_synchronous    = True {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] database.synchronous_reader    = True {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] database.use_db_reconnect      = False {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] profiler.connection_string     = messaging:// {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] profiler.enabled               = False {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] profiler.es_doc_type           = notification {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] profiler.es_scroll_size        = 10000 {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] profiler.es_scroll_time        = 2m {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] profiler.filter_error_trace    = False {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] profiler.hmac_keys             = **** {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] profiler.sentinel_service_name = mymaster {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] profiler.socket_timeout        = 0.1 {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] profiler.trace_requests        = False {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] profiler.trace_sqlalchemy      = False {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] profiler_jaeger.process_tags   = {} {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] profiler_jaeger.service_name_prefix = None {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] profiler_otlp.service_name_prefix = None {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] oslo_policy.enforce_new_defaults = False {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] oslo_policy.enforce_scope      = False {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] oslo_policy.policy_default_rule = default {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] oslo_policy.policy_file        = policy.yaml {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] privsep_osbrick.group          = None {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] privsep_osbrick.helper_command = None {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] privsep_osbrick.user           = None {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] cinder_sys_admin.group         = None {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] cinder_sys_admin.helper_command = None {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] cinder_sys_admin.user          = None {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] service_user.auth_section      = None {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] service_user.auth_type         = password {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] service_user.cafile            = None {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] service_user.certfile          = None {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] service_user.collect_timing    = False {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] service_user.insecure          = False {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] service_user.keyfile           = None {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] service_user.send_service_user_token = True {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] service_user.split_loggers     = False {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] service_user.timeout           = None {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] glance.auth_section            = None {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] glance.auth_type               = password {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] glance.certfile                = None {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] glance.collect_timing          = False {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] glance.insecure                = False {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] glance.keyfile                 = None {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] glance.region_name             = None {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] glance.split_loggers           = False {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] glance.timeout                 = None {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] backend_defaults.backend_availability_zone = None {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] backend_defaults.chap_password = **** {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] backend_defaults.chap_username =  {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] backend_defaults.disk_geometry = None {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] backend_defaults.driver_client_cert = None {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] backend_defaults.driver_client_cert_key = None {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] backend_defaults.driver_data_namespace = None {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] backend_defaults.driver_use_ssl = False {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] backend_defaults.enable_unsupported_driver = False {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] backend_defaults.extra_capabilities = {} {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] backend_defaults.filter_function = None {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] backend_defaults.goodness_function = None {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] backend_defaults.iscsi_target_flags =  {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] backend_defaults.iscsi_write_cache = on {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] backend_defaults.iser_helper   = tgtadm {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] backend_defaults.iser_ip_address = 192.168.122.181 {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] backend_defaults.iser_port     = 3260 {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] backend_defaults.nas_host      =  {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] backend_defaults.nas_login     = admin {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] backend_defaults.nas_mount_options = None {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] backend_defaults.nas_password  = **** {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] backend_defaults.nas_private_key =  {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] backend_defaults.nas_share_path =  {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] backend_defaults.nas_ssh_port  = 22 {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] backend_defaults.num_shell_tries = 3 {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] backend_defaults.nvmet_port_id = 1 {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] backend_defaults.quobyte_client_cfg = None {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] backend_defaults.quobyte_volume_url = None {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] backend_defaults.replication_device = **** {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] backend_defaults.report_discard_supported = False {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] backend_defaults.reserved_percentage = 0 {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] backend_defaults.scst_target_driver = iscsi {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] backend_defaults.scst_target_iqn_name = None {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] backend_defaults.storage_protocol = iSCSI {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] backend_defaults.target_helper = tgtadm {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] backend_defaults.target_ip_address = 192.168.122.181 {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] backend_defaults.target_port   = 3260 {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] backend_defaults.target_protocol = iscsi {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] backend_defaults.trace_flags   = None {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] backend_defaults.unique_fqdn_network = True {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] backend_defaults.use_chap_auth = False {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] backend_defaults.volume_backend_name = None {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] backend_defaults.volume_clear  = zero {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] backend_defaults.volume_clear_ionice = None {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] backend_defaults.volume_clear_size = 0 {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] oslo_reports.file_event_handler = None {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] oslo_reports.log_dir           = None {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] QuobyteHD.backend_availability_zone = None {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] QuobyteHD.backend_host         = None {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] QuobyteHD.chap_password        = **** {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] QuobyteHD.chap_username        = None {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] QuobyteHD.chiscsi_conf         = None {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] QuobyteHD.disk_geometry        = None {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] QuobyteHD.driver_client_cert   = None {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] QuobyteHD.driver_client_cert_key = None {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] QuobyteHD.driver_data_namespace = None {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] QuobyteHD.driver_use_ssl       = None {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] QuobyteHD.extra_capabilities   = None {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] QuobyteHD.filter_function      = None {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] QuobyteHD.goodness_function    = None {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] QuobyteHD.iscsi_target_flags   = None {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] QuobyteHD.iscsi_write_cache    = None {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] QuobyteHD.iser_helper          = None {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] QuobyteHD.iser_ip_address      = None {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] QuobyteHD.iser_port            = None {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] QuobyteHD.iser_target_prefix   = None {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] QuobyteHD.nas_host             = None {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] QuobyteHD.nas_login            = None {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] QuobyteHD.nas_mount_options    = None {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] QuobyteHD.nas_password         = **** {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] QuobyteHD.nas_private_key      = None {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] QuobyteHD.nas_share_path       = None {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] QuobyteHD.nas_ssh_port         = None {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] QuobyteHD.num_shell_tries      = None {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] QuobyteHD.nvmet_ns_id          = None {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] QuobyteHD.nvmet_port_id        = None {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92 {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] QuobyteHD.replication_device   = **** {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] QuobyteHD.report_discard_supported = None {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] QuobyteHD.reserved_percentage  = None {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] QuobyteHD.scst_target_driver   = None {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] QuobyteHD.storage_protocol     = None {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] QuobyteHD.target_helper        = None {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] QuobyteHD.target_ip_address    = None {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] QuobyteHD.target_port          = None {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] QuobyteHD.target_prefix        = None {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] QuobyteHD.target_protocol      = None {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-39069ee1-f078-4554-a313-c45837fd47e4 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86028) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}}
Jul 02 19:40:05 devstack cinder-volume[86028]: WARNING cinder.volume.drivers.quobyte [None req-39069ee1-f078-4554-a313-c45837fd47e4 None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[86028]: WARNING cinder.volume.drivers.quobyte [None req-39069ee1-f078-4554-a313-c45837fd47e4 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] QuobyteHD.trace_flags          = None {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] QuobyteHD.unique_fqdn_network  = None {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] QuobyteHD.use_chap_auth        = None {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] QuobyteHD.volume_clear         = None {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] QuobyteHD.volume_clear_ionice  = None {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-39069ee1-f078-4554-a313-c45837fd47e4 None None] Running cmd (subprocess): mount.quobyte {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] QuobyteHD.volume_clear_size    = None {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] QuobyteHD.volumes_dir          = None {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] oslo_messaging_rabbit.ssl      = False {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] oslo_messaging_notifications.driver = [] {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] oslo_messaging_notifications.retry = -1 {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] oslo_messaging_notifications.transport_url = **** {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] key_manager.fixed_key          = **** {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] barbican.barbican_api_version  = None {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] barbican.barbican_endpoint     = None {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] barbican.barbican_endpoint_type = public {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] barbican.barbican_region_name  = None {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] barbican.cafile                = None {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] barbican.certfile              = None {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] barbican.collect_timing        = False {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] barbican.insecure              = False {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] barbican.keyfile               = None {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] barbican.number_of_retries     = 60 {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] barbican.retry_delay           = 1 {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] barbican.send_service_user_token = False {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] barbican.split_loggers         = False {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] barbican.timeout               = None {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] barbican.verify_ssl            = True {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] barbican.verify_ssl_path       = None {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] barbican_service_user.auth_section = None {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] barbican_service_user.auth_type = None {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] barbican_service_user.cafile   = None {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] barbican_service_user.certfile = None {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] barbican_service_user.collect_timing = False {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] barbican_service_user.insecure = False {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] barbican_service_user.keyfile  = None {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] barbican_service_user.split_loggers = False {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] barbican_service_user.timeout  = None {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] vault.approle_role_id          = **** {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] vault.approle_secret_id        = **** {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] vault.kv_mountpoint            = secret {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] vault.kv_path                  = None {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] vault.kv_version               = 2 {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] vault.namespace                = None {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] vault.root_token_id            = **** {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] vault.ssl_ca_crt_file          = None {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] vault.timeout                  = 60.0 {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] vault.use_ssl                  = False {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:05 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] ******************************************************************************** {{(pid=85814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}}
Jul 02 19:40:05 devstack quobyte-client[86033]: Reading configuration file: /etc/quobyte/client.cfg
Jul 02 19:40:05 devstack quobyte-client[86033]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Jul 02 19:40:05 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-39069ee1-f078-4554-a313-c45837fd47e4 None None] CMD "mount.quobyte" returned: 1 in 0.072s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:40:05 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-39069ee1-f078-4554-a313-c45837fd47e4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:40:05 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-39069ee1-f078-4554-a313-c45837fd47e4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:40:05 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-39069ee1-f078-4554-a313-c45837fd47e4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 19:40:05 devstack cinder-volume[86028]: INFO cinder.volume.drivers.quobyte [None req-39069ee1-f078-4554-a313-c45837fd47e4 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92 ...
Jul 02 19:40:05 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-39069ee1-f078-4554-a313-c45837fd47e4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e -c /etc/quobyte/client-cinder.cfg {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:40:05 devstack sudo[86034]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e -c /etc/quobyte/client-cinder.cfg
Jul 02 19:40:05 devstack sudo[86034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:40:06 devstack sudo[86034]: pam_unix(sudo:session): session closed for user root
Jul 02 19:40:06 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-39069ee1-f078-4554-a313-c45837fd47e4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.823s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:40:06 devstack cinder-volume[86028]: INFO cinder.volume.drivers.quobyte [None req-39069ee1-f078-4554-a313-c45837fd47e4 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92 succeeded
Jul 02 19:40:06 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-39069ee1-f078-4554-a313-c45837fd47e4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 19:40:06 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-39069ee1-f078-4554-a313-c45837fd47e4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.837s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:40:06 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-39069ee1-f078-4554-a313-c45837fd47e4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:40:06 devstack sudo[86103]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e
Jul 02 19:40:06 devstack sudo[86103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:40:06 devstack sudo[86103]: pam_unix(sudo:session): session closed for user root
Jul 02 19:40:06 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-39069ee1-f078-4554-a313-c45837fd47e4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e" returned: 0 in 0.672s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:40:06 devstack cinder-volume[86028]: INFO cinder.volume.driver [None req-39069ee1-f078-4554-a313-c45837fd47e4 None None] Driver hasn't implemented _init_vendor_properties()
Jul 02 19:40:06 devstack cinder-volume[86028]: DEBUG cinder.volume.driver [None req-39069ee1-f078-4554-a313-c45837fd47e4 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6712112426758, 'free_capacity_gb': 1775.6712112426758, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86028) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Jul 02 19:40:06 devstack cinder-volume[86028]: DEBUG oslo_db.sqlalchemy.engines [None req-39069ee1-f078-4554-a313-c45837fd47e4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86028) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 02 19:40:07 devstack cinder-volume[86028]: DEBUG dbcounter [-] [86028] Writer thread running {{(pid=86028) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Jul 02 19:40:07 devstack cinder-volume[86028]: DEBUG cinder.db.api [None req-39069ee1-f078-4554-a313-c45837fd47e4 None None] Building query based on filter {{(pid=86028) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}}
Jul 02 19:40:07 devstack cinder-volume[86028]: DEBUG cinder.image.image_utils [None req-39069ee1-f078-4554-a313-c45837fd47e4 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86028) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}}
Jul 02 19:40:07 devstack cinder-volume[86028]: INFO cinder.keymgr.migration [None req-471336da-6531-42f9-8498-ce6847b14b51 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Jul 02 19:40:07 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-39069ee1-f078-4554-a313-c45837fd47e4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:40:07 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-39069ee1-f078-4554-a313-c45837fd47e4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:40:07 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-39069ee1-f078-4554-a313-c45837fd47e4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 19:40:07 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-39069ee1-f078-4554-a313-c45837fd47e4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 19:40:07 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-39069ee1-f078-4554-a313-c45837fd47e4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:40:07 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-39069ee1-f078-4554-a313-c45837fd47e4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:40:07 devstack sudo[86106]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e
Jul 02 19:40:07 devstack sudo[86106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:40:07 devstack sudo[86106]: pam_unix(sudo:session): session closed for user root
Jul 02 19:40:07 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-39069ee1-f078-4554-a313-c45837fd47e4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e" returned: 0 in 0.637s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:40:07 devstack cinder-volume[86028]: DEBUG cinder.manager [None req-39069ee1-f078-4554-a313-c45837fd47e4 None None] Notifying Schedulers of capabilities ... {{(pid=86028) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 19:40:07 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-39069ee1-f078-4554-a313-c45837fd47e4 None None] Driver initialization completed successfully.
Jul 02 19:40:07 devstack cinder-volume[86028]: INFO cinder.manager [None req-39069ee1-f078-4554-a313-c45837fd47e4 None None] Initiating service 3 cleanup
Jul 02 19:40:07 devstack cinder-volume[86028]: INFO cinder.manager [None req-39069ee1-f078-4554-a313-c45837fd47e4 None None] Service 3 cleanup completed.
Jul 02 19:40:07 devstack cinder-volume[86028]: DEBUG cinder.service [None req-39069ee1-f078-4554-a313-c45837fd47e4 None None] Creating RPC server for service cinder-volume {{(pid=86028) start /opt/stack/cinder/cinder/service.py:231}}
Jul 02 19:40:07 devstack cinder-volume[86028]: DEBUG cinder.service [None req-39069ee1-f078-4554-a313-c45837fd47e4 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86028) start /opt/stack/cinder/cinder/service.py:237}}
Jul 02 19:40:07 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-39069ee1-f078-4554-a313-c45837fd47e4 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14)
Jul 02 19:40:07 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-39069ee1-f078-4554-a313-c45837fd47e4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:40:07 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-39069ee1-f078-4554-a313-c45837fd47e4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:40:07 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-39069ee1-f078-4554-a313-c45837fd47e4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 19:40:07 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-39069ee1-f078-4554-a313-c45837fd47e4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 19:40:07 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-39069ee1-f078-4554-a313-c45837fd47e4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:40:07 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-39069ee1-f078-4554-a313-c45837fd47e4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:40:07 devstack sudo[86113]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e
Jul 02 19:40:07 devstack sudo[86113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:40:08 devstack sudo[86113]: pam_unix(sudo:session): session closed for user root
Jul 02 19:40:08 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-39069ee1-f078-4554-a313-c45837fd47e4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e" returned: 0 in 0.707s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:40:08 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-39069ee1-f078-4554-a313-c45837fd47e4 None None] Driver post RPC initialization completed successfully.
Jul 02 19:40:13 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-bd635d90-6251-4adc-8db1-5e681576ff5e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:40:13 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-bd635d90-6251-4adc-8db1-5e681576ff5e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:40:13 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-bd635d90-6251-4adc-8db1-5e681576ff5e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 19:40:13 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-bd635d90-6251-4adc-8db1-5e681576ff5e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 19:40:13 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-bd635d90-6251-4adc-8db1-5e681576ff5e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:40:13 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-bd635d90-6251-4adc-8db1-5e681576ff5e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:40:13 devstack sudo[86227]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e
Jul 02 19:40:13 devstack sudo[86227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:40:14 devstack sudo[86227]: pam_unix(sudo:session): session closed for user root
Jul 02 19:40:14 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-bd635d90-6251-4adc-8db1-5e681576ff5e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e" returned: 0 in 0.874s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:40:14 devstack cinder-volume[86028]: DEBUG cinder.manager [None req-bd635d90-6251-4adc-8db1-5e681576ff5e None None] Notifying Schedulers of capabilities ... {{(pid=86028) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 19:40:15 devstack cinder-volume[85814]: DEBUG dbcounter [-] [85814] Writing DB stats cinder:SELECT=6,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=85814) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 02 19:40:16 devstack cinder-volume[85814]: INFO oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] Caught SIGTERM, stopping children
Jul 02 19:40:16 devstack cinder-volume[85814]: DEBUG oslo_concurrency.lockutils [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] Acquiring lock "singleton_lock" {{(pid=85814) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jul 02 19:40:16 devstack cinder-volume[85814]: DEBUG oslo_concurrency.lockutils [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] Acquired lock "singleton_lock" {{(pid=85814) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jul 02 19:40:16 devstack cinder-volume[85814]: DEBUG oslo_concurrency.lockutils [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] Releasing lock "singleton_lock" {{(pid=85814) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jul 02 19:40:16 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] Stop services. {{(pid=85814) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Jul 02 19:40:16 devstack cinder-volume[85814]: DEBUG oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] Killing children. {{(pid=85814) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Jul 02 19:40:16 devstack cinder-volume[85814]: INFO oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] Waiting on 1 children to exit
Jul 02 19:40:17 devstack cinder-volume[86028]: DEBUG dbcounter [-] [86028] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=86028) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 02 19:40:18 devstack cinder-volume[86028]: DEBUG dbcounter [-] [86028] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=86028) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 02 19:40:21 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] Acquiring lock "singleton_lock" {{(pid=86028) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jul 02 19:40:21 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] Acquired lock "singleton_lock" {{(pid=86028) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jul 02 19:40:21 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] Releasing lock "singleton_lock" {{(pid=86028) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jul 02 19:40:21 devstack cinder-volume[86028]: WARNING amqp [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Jul 02 19:40:21 devstack cinder-volume[86028]: WARNING amqp [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Jul 02 19:40:21 devstack cinder-volume[85814]: INFO oslo_service.backend._eventlet.service [None req-10bc8b4f-d3a4-448d-8325-2b7fdbadf189 None None] Child 86028 exited with status 0
Jul 02 19:40:21 devstack cinder-volume[86351]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Jul 02 19:40:21 devstack cinder-volume[86351]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Jul 02 19:40:21 devstack cinder-volume[86351]: we strongly recommend against using it for new projects.
Jul 02 19:40:21 devstack cinder-volume[86351]: If you are already using Eventlet, we recommend migrating to a different
Jul 02 19:40:21 devstack cinder-volume[86351]: framework.  For more detail see
Jul 02 19:40:21 devstack cinder-volume[86351]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Jul 02 19:40:21 devstack cinder-volume[86351]:   import eventlet  # noqa
Jul 02 19:40:24 devstack cinder-volume[86351]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86351) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jul 02 19:40:24 devstack cinder-volume[86351]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86351) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jul 02 19:40:24 devstack cinder-volume[86351]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86351) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jul 02 19:40:25 devstack cinder-volume[86351]: INFO dbcounter [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] Registered counter for database cinder
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_db.sqlalchemy.engines [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86351) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG dbcounter [-] [86351] Writer thread running {{(pid=86351) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Jul 02 19:40:25 devstack cinder-volume[86351]: INFO cinder.rpc [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Jul 02 19:40:25 devstack cinder-volume[86351]: INFO cinder.rpc [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_db.sqlalchemy.engines [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86351) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 02 19:40:25 devstack cinder-volume[86351]: INFO cinder.volume.manager [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] Determined volume DB was empty at startup.
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG cinder.volume.manager [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86351) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Jul 02 19:40:25 devstack cinder-volume[86351]: WARNING stevedore.named [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jul 02 19:40:25 devstack cinder-volume[86351]: WARNING castellan.key_manager [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jul 02 19:40:25 devstack cinder-volume[86351]: WARNING cinder.keymgr.conf_key_mgr [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jul 02 19:40:25 devstack cinder-volume[86351]: INFO cinder.volume.manager [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] Image-volume cache disabled for host devstack@QuobyteHD.
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_db.sqlalchemy.engines [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86351) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 02 19:40:25 devstack cinder-volume[86351]: INFO oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] Starting 1 workers
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] Started child 86639 {{(pid=86351) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] Full set of CONF: {{(pid=86351) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] ******************************************************************************** {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] Configuration options gathered from: {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] ================================================================================ {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] allow_availability_zone_fallback = False {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] allow_compression_on_image_upload = False {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] allowed_direct_url_schemes     = [] {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] api_rate_limit                 = True {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] auth_strategy                  = keystone {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] backend_availability_zone      = None {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:25 devstack cinder-volume[86639]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] backend_host                   = None {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] backend_name                   = None {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] backend_stats_polling_interval = 60 {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] backup_api_class               = cinder.backup.api.API {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] backup_name_template           = backup-%s {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] backup_use_same_host           = False {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] backup_use_temp_snapshot       = False {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] chap_password                  = **** {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] chap_username                  =  {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] cinder_internal_tenant_project_id = 00fb7bd2636f4f118a3c900d218fbad9 {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] cinder_internal_tenant_user_id = 262938f490114b7f8275a8a6f8a8d644 {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] cluster                        = None {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] compression_format             = gzip {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] compute_api_class              = cinder.compute.nova.API {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] config_dir                     = [] {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] config_source                  = [] {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] control_exchange               = openstack {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] debug                          = True {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] default_availability_zone      = None {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] default_group_type             = None {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] default_volume_type            = QuobyteHD {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] disk_geometry                  = None {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] driver_client_cert             = None {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] driver_client_cert_key         = None {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] driver_data_namespace          = None {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] driver_ssl_cert_path           = None {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] driver_ssl_cert_verify         = False {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] driver_use_ssl                 = False {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] enable_new_services            = True {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] enable_unsupported_driver      = False {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] enabled_backends               = ['QuobyteHD'] {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] enforce_multipath_for_image_xfer = False {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] filter_function                = None {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] glance_api_insecure            = False {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] glance_api_servers             = ['http://192.168.122.181/image'] {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] glance_api_ssl_compression     = False {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] glance_ca_certificates_file    = None {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] glance_catalog_info            = image:glance:publicURL {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] glance_certfile                = None {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] glance_keyfile                 = None {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] glance_num_retries             = 3 {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] glance_request_timeout         = None {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] goodness_function              = None {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] graceful_shutdown_timeout      = 5 {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] group_api_class                = cinder.group.api.API {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] host                           = devstack {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] image_compress_on_upload       = True {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] image_conversion_address_space_limit = 1 {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] image_conversion_cpu_limit     = 60 {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] image_conversion_disable       = False {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] image_upload_use_cinder_backend = False {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] image_upload_use_internal_tenant = False {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] image_volume_cache_enabled     = False {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] image_volume_cache_max_count   = 0 {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] image_volume_cache_max_size_gb = 0 {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] init_host_max_objects_retrieval = 0 {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] instance_format                = [instance: %(uuid)s]  {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] iscsi_target_flags             =  {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] iscsi_write_cache              = on {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] iser_helper                    = tgtadm {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] iser_ip_address                = 192.168.122.181 {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] iser_port                      = 3260 {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] log_color                      = False {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] log_config_append              = None {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] log_dir                        = None {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] log_file                       = None {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] log_options                    = True {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] log_rotate_interval            = 1 {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] log_rotate_interval_type       = days {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] log_rotation_type              = none {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] max_age                        = 0 {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] max_logfile_count              = 30 {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] max_logfile_size_mb            = 200 {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] max_over_subscription_ratio    = 20.0 {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] message_reap_interval          = 86400 {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] message_ttl                    = 2592000 {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] migration_create_volume_timeout_secs = 300 {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] monkey_patch                   = False {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] monkey_patch_modules           = [] {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] my_ip                          = 192.168.122.181 {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] no_snapshot_gb_quota           = False {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] num_iser_scan_tries            = 3 {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] num_shell_tries                = 3 {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] num_volume_device_scan_tries   = 3 {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] nvmeof_conn_info_version       = 1 {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] nvmet_ns_id                    = 10 {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] nvmet_port_id                  = 1 {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] osapi_max_limit                = 1000 {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] osapi_volume_ext_list          = [] {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] osapi_volume_listen_port       = 8776 {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] osapi_volume_use_ssl           = False {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] osapi_volume_workers           = None {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] per_volume_size_limit          = -1 {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] periodic_fuzzy_delay           = 60 {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] periodic_interval              = 60 {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] public_endpoint                = None {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] publish_errors                 = False {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] quota_backup_gigabytes         = 1000 {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] quota_backups                  = 10 {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] quota_gigabytes                = 1000 {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] quota_groups                   = 10 {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] quota_snapshots                = 10 {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] quota_volumes                  = 10 {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] rate_limit_burst               = 0 {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] rate_limit_except_level        = CRITICAL {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] rate_limit_interval            = 0 {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] reinit_driver_count            = 3 {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] replication_device             = **** {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] report_discard_supported       = False {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] report_interval                = 120 {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] reservation_clean_interval     = 86400 {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] reservation_expire             = 86400 {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] reserved_image_namespaces      = [] {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] reserved_percentage            = 0 {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] rpc_response_timeout           = 120 {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] run_external_periodic_tasks    = True {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] scst_target_driver             = iscsi {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] scst_target_iqn_name           = None {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] service_down_time              = 720 {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] shell_completion               = None {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] snapshot_name_template         = snapshot-%s {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] split_loggers                  = False {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] state_path                     = /opt/stack/data/cinder {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] storage_availability_zone      = nova {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] storage_protocol               = iSCSI {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] syslog_log_facility            = LOG_USER {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] target_helper                  = lioadm {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] target_ip_address              = 192.168.122.181 {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] target_port                    = 3260 {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] target_protocol                = iscsi {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] target_secondary_ip_addresses  = [] {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] trace_flags                    = None {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] transport_url                  = **** {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] until_refresh                  = 0 {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] use_chap_auth                  = False {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] use_default_quota_class        = True {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] use_journal                    = False {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:25 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-57726269-e89d-45e6-82b3-c072de8cc78a None None] Starting volume driver QuobyteDriver (1.1.14)
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] use_json                       = False {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:25 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-57726269-e89d-45e6-82b3-c072de8cc78a None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86639) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] use_multipath_for_image_xfer   = False {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] use_stderr                     = False {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] use_syslog                     = False {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] verify_glance_signatures       = enabled {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] volume_api_class               = cinder.volume.api.API {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] volume_backend_name            = None {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] volume_clear                   = zero {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] volume_clear_ionice            = None {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] volume_clear_size              = 0 {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] volume_copy_bps_limit          = 0 {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] volume_dd_blocksize            = 1M {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] volume_name_template           = volume-%s {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] volume_service_inithost_offload = False {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] volume_usage_audit_period      = month {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] zoning_mode                    = None {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] oslo_concurrency.disable_process_locking = False {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] keystone_authtoken.auth_section = None {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] keystone_authtoken.auth_type   = password {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] keystone_authtoken.auth_version = None {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] keystone_authtoken.cache       = None {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] keystone_authtoken.certfile    = None {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] keystone_authtoken.include_service_catalog = True {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] keystone_authtoken.insecure    = False {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] keystone_authtoken.interface   = public {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] keystone_authtoken.keyfile     = None {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] keystone_authtoken.memcache_password =  {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] keystone_authtoken.memcache_username =  {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] keystone_authtoken.region_name = None {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] keystone_authtoken.service_type = None {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.181/identity {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] cache.backend                  = dogpile.cache.null {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] cache.backend_argument         = **** {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] cache.backend_expiration_time  = None {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] cache.config_prefix            = cache.oslo {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] cache.debug_cache_backend      = False {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] cache.enable_retry_client      = False {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] cache.enable_socket_keepalive  = False {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] cache.enabled                  = False {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] cache.expiration_time          = 600 {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] cache.hashclient_retry_attempts = 2 {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] cache.memcache_dead_retry      = 300 {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] cache.memcache_pool_maxsize    = 10 {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] cache.memcache_sasl_enabled    = False {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] cache.password                 = **** {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] cache.proxies                  = [] {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] cache.redis_db                 = 0 {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] cache.redis_server             = localhost:6379 {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] cache.retry_attempts           = 2 {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] cache.retry_delay              = 0.0 {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] cache.socket_keepalive_count   = 1 {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] cache.socket_keepalive_idle    = 1 {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] cache.socket_keepalive_interval = 1 {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] cache.socket_timeout           = 1.0 {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] cache.tls_allowed_ciphers      = None {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] cache.tls_cafile               = None {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] cache.tls_certfile             = None {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] cache.tls_enabled              = False {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] cache.tls_keyfile              = None {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] cache.username                 = None {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] coordination.backend_url       = **** {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] database.asyncio_connection    = **** {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] database.asyncio_slave_connection = **** {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] database.backend               = sqlalchemy {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] database.connection            = **** {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] database.connection_debug      = 0 {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] database.connection_parameters =  {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] database.connection_recycle_time = 3600 {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] database.connection_trace      = False {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] database.db_inc_retry_interval = True {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] database.db_max_retries        = 20 {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] database.db_max_retry_interval = 10 {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] database.db_retry_interval     = 1 {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] database.max_overflow          = 50 {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] database.max_pool_size         = 5 {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] database.max_retries           = 10 {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] database.mysql_wsrep_sync_wait = None {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] database.pool_timeout          = None {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] database.retry_interval        = 10 {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] database.slave_connection      = **** {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] database.sqlite_synchronous    = True {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] database.synchronous_reader    = True {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] database.use_db_reconnect      = False {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] profiler.connection_string     = messaging:// {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] profiler.enabled               = False {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] profiler.es_doc_type           = notification {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] profiler.es_scroll_size        = 10000 {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] profiler.es_scroll_time        = 2m {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] profiler.filter_error_trace    = False {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] profiler.hmac_keys             = **** {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] profiler.sentinel_service_name = mymaster {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] profiler.socket_timeout        = 0.1 {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] profiler.trace_requests        = False {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] profiler.trace_sqlalchemy      = False {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] profiler_jaeger.process_tags   = {} {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] profiler_jaeger.service_name_prefix = None {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] profiler_otlp.service_name_prefix = None {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] oslo_policy.enforce_new_defaults = False {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] oslo_policy.enforce_scope      = False {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] oslo_policy.policy_default_rule = default {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] oslo_policy.policy_file        = policy.yaml {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] privsep_osbrick.group          = None {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:25 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] privsep_osbrick.helper_command = None {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] privsep_osbrick.user           = None {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] cinder_sys_admin.group         = None {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] cinder_sys_admin.helper_command = None {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] cinder_sys_admin.user          = None {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] service_user.auth_section      = None {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] service_user.auth_type         = password {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] service_user.cafile            = None {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] service_user.certfile          = None {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] service_user.collect_timing    = False {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] service_user.insecure          = False {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] service_user.keyfile           = None {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] service_user.send_service_user_token = True {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] service_user.split_loggers     = False {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] service_user.timeout           = None {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] glance.auth_section            = None {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] glance.auth_type               = password {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] glance.certfile                = None {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] glance.collect_timing          = False {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] glance.insecure                = False {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] glance.keyfile                 = None {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] glance.region_name             = None {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] glance.split_loggers           = False {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] glance.timeout                 = None {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] backend_defaults.backend_availability_zone = None {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] backend_defaults.chap_password = **** {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] backend_defaults.chap_username =  {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] backend_defaults.disk_geometry = None {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] backend_defaults.driver_client_cert = None {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] backend_defaults.driver_client_cert_key = None {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] backend_defaults.driver_data_namespace = None {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] backend_defaults.driver_use_ssl = False {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] backend_defaults.extra_capabilities = {} {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] backend_defaults.filter_function = None {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] backend_defaults.goodness_function = None {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] backend_defaults.iscsi_target_flags =  {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] backend_defaults.iscsi_write_cache = on {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] backend_defaults.iser_helper   = tgtadm {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] backend_defaults.iser_ip_address = 192.168.122.181 {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] backend_defaults.iser_port     = 3260 {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] backend_defaults.nas_host      =  {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] backend_defaults.nas_login     = admin {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] backend_defaults.nas_mount_options = None {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] backend_defaults.nas_password  = **** {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] backend_defaults.nas_private_key =  {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] backend_defaults.nas_share_path =  {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] backend_defaults.nas_ssh_port  = 22 {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] backend_defaults.num_shell_tries = 3 {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-57726269-e89d-45e6-82b3-c072de8cc78a None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86639) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}}
Jul 02 19:40:26 devstack cinder-volume[86639]: WARNING cinder.volume.drivers.quobyte [None req-57726269-e89d-45e6-82b3-c072de8cc78a None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86639]: WARNING cinder.volume.drivers.quobyte [None req-57726269-e89d-45e6-82b3-c072de8cc78a None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] backend_defaults.quobyte_volume_url = None {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] backend_defaults.replication_device = **** {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] backend_defaults.report_discard_supported = False {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] backend_defaults.reserved_percentage = 0 {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-57726269-e89d-45e6-82b3-c072de8cc78a None None] Running cmd (subprocess): mount.quobyte {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] backend_defaults.target_helper = tgtadm {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] backend_defaults.target_ip_address = 192.168.122.181 {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] backend_defaults.target_port   = 3260 {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] backend_defaults.target_protocol = iscsi {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] backend_defaults.trace_flags   = None {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] backend_defaults.unique_fqdn_network = True {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] backend_defaults.use_chap_auth = False {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] backend_defaults.volume_backend_name = None {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] backend_defaults.volume_clear  = zero {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] backend_defaults.volume_clear_ionice = None {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] backend_defaults.volume_clear_size = 0 {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] oslo_reports.file_event_handler = None {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] oslo_reports.log_dir           = None {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] QuobyteHD.backend_availability_zone = None {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] QuobyteHD.backend_host         = None {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] QuobyteHD.chap_password        = **** {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] QuobyteHD.chap_username        = None {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] QuobyteHD.chiscsi_conf         = None {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] QuobyteHD.disk_geometry        = None {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] QuobyteHD.driver_client_cert   = None {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] QuobyteHD.driver_data_namespace = None {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] QuobyteHD.driver_use_ssl       = None {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] QuobyteHD.extra_capabilities   = None {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] QuobyteHD.filter_function      = None {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] QuobyteHD.goodness_function    = None {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] QuobyteHD.iscsi_target_flags   = None {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] QuobyteHD.iscsi_write_cache    = None {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] QuobyteHD.iser_helper          = None {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] QuobyteHD.iser_ip_address      = None {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] QuobyteHD.iser_port            = None {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] QuobyteHD.iser_target_prefix   = None {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] QuobyteHD.nas_host             = None {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] QuobyteHD.nas_login            = None {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] QuobyteHD.nas_mount_options    = None {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] QuobyteHD.nas_password         = **** {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] QuobyteHD.nas_private_key      = None {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] QuobyteHD.nas_share_path       = None {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] QuobyteHD.nas_ssh_port         = None {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] QuobyteHD.num_shell_tries      = None {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] QuobyteHD.nvmet_ns_id          = None {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] QuobyteHD.nvmet_port_id        = None {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92 {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] QuobyteHD.replication_device   = **** {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] QuobyteHD.report_discard_supported = None {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] QuobyteHD.reserved_percentage  = None {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] QuobyteHD.scst_target_driver   = None {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] QuobyteHD.storage_protocol     = None {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack quobyte-client[86652]: Reading configuration file: /etc/quobyte/client.cfg
Jul 02 19:40:26 devstack quobyte-client[86652]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] QuobyteHD.target_helper        = None {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] QuobyteHD.target_ip_address    = None {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] QuobyteHD.target_port          = None {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] QuobyteHD.target_prefix        = None {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] QuobyteHD.target_protocol      = None {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-57726269-e89d-45e6-82b3-c072de8cc78a None None] CMD "mount.quobyte" returned: 1 in 0.069s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-57726269-e89d-45e6-82b3-c072de8cc78a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] QuobyteHD.trace_flags          = None {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-57726269-e89d-45e6-82b3-c072de8cc78a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] QuobyteHD.unique_fqdn_network  = None {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-57726269-e89d-45e6-82b3-c072de8cc78a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] QuobyteHD.use_chap_auth        = None {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] QuobyteHD.volume_clear         = None {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] QuobyteHD.volume_clear_ionice  = None {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] QuobyteHD.volume_clear_size    = None {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] QuobyteHD.volumes_dir          = None {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-57726269-e89d-45e6-82b3-c072de8cc78a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-57726269-e89d-45e6-82b3-c072de8cc78a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-57726269-e89d-45e6-82b3-c072de8cc78a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] oslo_messaging_rabbit.ssl      = False {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] oslo_messaging_notifications.driver = [] {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] oslo_messaging_notifications.retry = -1 {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] key_manager.fixed_key          = **** {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack sudo[86679]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] barbican.barbican_api_version  = None {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack sudo[86679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] barbican.barbican_endpoint     = None {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] barbican.barbican_endpoint_type = public {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] barbican.barbican_region_name  = None {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] barbican.cafile                = None {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] barbican.certfile              = None {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] barbican.collect_timing        = False {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] barbican.insecure              = False {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] barbican.keyfile               = None {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] barbican.number_of_retries     = 60 {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] barbican.retry_delay           = 1 {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] barbican.send_service_user_token = False {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] barbican.split_loggers         = False {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] barbican.timeout               = None {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] barbican.verify_ssl            = True {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] barbican.verify_ssl_path       = None {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] barbican_service_user.auth_section = None {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] barbican_service_user.auth_type = None {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] barbican_service_user.cafile   = None {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] barbican_service_user.certfile = None {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] barbican_service_user.collect_timing = False {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] barbican_service_user.insecure = False {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] barbican_service_user.keyfile  = None {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] barbican_service_user.split_loggers = False {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] barbican_service_user.timeout  = None {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] vault.approle_role_id          = **** {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] vault.approle_secret_id        = **** {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] vault.kv_mountpoint            = secret {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] vault.kv_path                  = None {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] vault.kv_version               = 2 {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] vault.namespace                = None {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] vault.root_token_id            = **** {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] vault.ssl_ca_crt_file          = None {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] vault.timeout                  = 60.0 {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] vault.use_ssl                  = False {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 19:40:26 devstack cinder-volume[86351]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9156d-43c8-48c8-8116-2ab23788adf8 None None] ******************************************************************************** {{(pid=86351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}}
Jul 02 19:40:26 devstack sudo[86679]: pam_unix(sudo:session): session closed for user root
Jul 02 19:40:26 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-57726269-e89d-45e6-82b3-c072de8cc78a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e" returned: 0 in 0.630s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:40:26 devstack cinder-volume[86639]: INFO cinder.volume.driver [None req-57726269-e89d-45e6-82b3-c072de8cc78a None None] Driver hasn't implemented _init_vendor_properties()
Jul 02 19:40:26 devstack cinder-volume[86639]: DEBUG cinder.volume.driver [None req-57726269-e89d-45e6-82b3-c072de8cc78a None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6319580078125, 'free_capacity_gb': 1775.6319580078125, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86639) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Jul 02 19:40:26 devstack cinder-volume[86639]: DEBUG oslo_db.sqlalchemy.engines [None req-57726269-e89d-45e6-82b3-c072de8cc78a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86639) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 02 19:40:26 devstack cinder-volume[86639]: DEBUG dbcounter [-] [86639] Writer thread running {{(pid=86639) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Jul 02 19:40:26 devstack cinder-volume[86639]: DEBUG cinder.db.api [None req-57726269-e89d-45e6-82b3-c072de8cc78a None None] Building query based on filter {{(pid=86639) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}}
Jul 02 19:40:26 devstack cinder-volume[86639]: DEBUG cinder.image.image_utils [None req-57726269-e89d-45e6-82b3-c072de8cc78a None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86639) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}}
Jul 02 19:40:26 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-57726269-e89d-45e6-82b3-c072de8cc78a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:40:26 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-57726269-e89d-45e6-82b3-c072de8cc78a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:40:26 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-57726269-e89d-45e6-82b3-c072de8cc78a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 19:40:26 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-57726269-e89d-45e6-82b3-c072de8cc78a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 19:40:26 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-57726269-e89d-45e6-82b3-c072de8cc78a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:40:26 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-57726269-e89d-45e6-82b3-c072de8cc78a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:40:26 devstack cinder-volume[86639]: INFO cinder.keymgr.migration [None req-4ac06af9-2793-423e-a34a-635479034308 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Jul 02 19:40:26 devstack sudo[86701]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e
Jul 02 19:40:26 devstack sudo[86701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:40:27 devstack sudo[86701]: pam_unix(sudo:session): session closed for user root
Jul 02 19:40:27 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-57726269-e89d-45e6-82b3-c072de8cc78a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e" returned: 0 in 0.635s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:40:27 devstack cinder-volume[86639]: DEBUG cinder.manager [None req-57726269-e89d-45e6-82b3-c072de8cc78a None None] Notifying Schedulers of capabilities ... {{(pid=86639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 19:40:27 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-57726269-e89d-45e6-82b3-c072de8cc78a None None] Driver initialization completed successfully.
Jul 02 19:40:27 devstack cinder-volume[86639]: INFO cinder.manager [None req-57726269-e89d-45e6-82b3-c072de8cc78a None None] Initiating service 3 cleanup
Jul 02 19:40:27 devstack cinder-volume[86639]: INFO cinder.manager [None req-57726269-e89d-45e6-82b3-c072de8cc78a None None] Service 3 cleanup completed.
Jul 02 19:40:27 devstack cinder-volume[86639]: DEBUG cinder.service [None req-57726269-e89d-45e6-82b3-c072de8cc78a None None] Creating RPC server for service cinder-volume {{(pid=86639) start /opt/stack/cinder/cinder/service.py:231}}
Jul 02 19:40:27 devstack cinder-volume[86639]: DEBUG cinder.service [None req-57726269-e89d-45e6-82b3-c072de8cc78a None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86639) start /opt/stack/cinder/cinder/service.py:237}}
Jul 02 19:40:27 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-57726269-e89d-45e6-82b3-c072de8cc78a None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14)
Jul 02 19:40:27 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-57726269-e89d-45e6-82b3-c072de8cc78a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:40:27 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-57726269-e89d-45e6-82b3-c072de8cc78a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:40:27 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-57726269-e89d-45e6-82b3-c072de8cc78a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 19:40:27 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-57726269-e89d-45e6-82b3-c072de8cc78a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 19:40:27 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-57726269-e89d-45e6-82b3-c072de8cc78a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:40:27 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-57726269-e89d-45e6-82b3-c072de8cc78a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:40:27 devstack sudo[86722]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e
Jul 02 19:40:27 devstack sudo[86722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:40:28 devstack sudo[86722]: pam_unix(sudo:session): session closed for user root
Jul 02 19:40:28 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-57726269-e89d-45e6-82b3-c072de8cc78a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e" returned: 0 in 0.727s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:40:28 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-57726269-e89d-45e6-82b3-c072de8cc78a None None] Driver post RPC initialization completed successfully.
Jul 02 19:40:35 devstack cinder-volume[86351]: DEBUG dbcounter [-] [86351] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86351) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 02 19:40:37 devstack cinder-volume[86639]: DEBUG dbcounter [-] [86639] Writing DB stats cinder:SELECT=2 {{(pid=86639) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 02 19:40:38 devstack cinder-volume[86639]: DEBUG dbcounter [-] [86639] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=86639) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 02 19:40:41 devstack cinder-volume[86639]: DEBUG oslo_service.periodic_task [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] Running periodic task VolumeManager._thread_info {{(pid=86639) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 02 19:40:41 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] thread count: 6 {{(pid=86639) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 02 19:40:41 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] thread info: [<_MainThread(MainThread, started 140525261275264)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 140525150678016)>, <Thread(Thread-3 (stat_writer), started daemon 140525150025920)>, <Thread(Rabbit-heartbeat, started daemon 140525150500864)>, <Thread(Thread-5 (_runner), started daemon 140525149847296)>, <Thread(Thread-7 (_runner), started daemon 140525149863424)>] {{(pid=86639) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 02 19:41:41 devstack cinder-volume[86639]: DEBUG oslo_service.periodic_task [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86639) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 02 19:41:41 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:41:41 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:41:41 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 19:41:41 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 19:41:41 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:41:41 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:41:41 devstack sudo[87153]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e
Jul 02 19:41:41 devstack sudo[87153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:41:42 devstack sudo[87153]: pam_unix(sudo:session): session closed for user root
Jul 02 19:41:42 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e" returned: 0 in 0.897s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:41:42 devstack cinder-volume[86639]: DEBUG cinder.manager [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] Notifying Schedulers of capabilities ... {{(pid=86639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 19:41:42 devstack cinder-volume[86639]: DEBUG oslo_service.periodic_task [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] Running periodic task VolumeManager._thread_info {{(pid=86639) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 02 19:41:42 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] thread count: 6 {{(pid=86639) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 02 19:41:42 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] thread info: [<_MainThread(MainThread, started 140525261275264)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 140525150678016)>, <Thread(Thread-3 (stat_writer), started daemon 140525150025920)>, <Thread(Rabbit-heartbeat, started daemon 140525150500864)>, <Thread(Thread-5 (_runner), started daemon 140525149847296)>, <Thread(Thread-7 (_runner), started daemon 140525149863424)>] {{(pid=86639) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 02 19:42:08 devstack cinder-volume[86639]: DEBUG cinder.volume.flows.manager.create_volume [None req-78d9f484-8a9c-4449-994a-15343698c83e tempest-DeleteServersTestJSON-1647155838 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 19:42:09 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-78d9f484-8a9c-4449-994a-15343698c83e tempest-DeleteServersTestJSON-1647155838 None] Flow 'volume_create_manager' (6c918107-6190-44d4-80c6-f787ae769409) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 19:42:09 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-78d9f484-8a9c-4449-994a-15343698c83e tempest-DeleteServersTestJSON-1647155838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d8eaec1-4cdd-43f1-8b39-c4bf19c76c0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:42:09 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-78d9f484-8a9c-4449-994a-15343698c83e tempest-DeleteServersTestJSON-1647155838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d8eaec1-4cdd-43f1-8b39-c4bf19c76c0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T17:42:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-303705606',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13ccba46-afa8-4270-88b0-a98c50c73928,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c26390e565941169fc2af21c935a5dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T17:42:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T17:42:09Z,use_quota=True,user_id='dfa57ef3d7bd42de9e49c498b472bf9b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:42:09 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-78d9f484-8a9c-4449-994a-15343698c83e tempest-DeleteServersTestJSON-1647155838 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2454a14-eb46-4e18-b9d4-a66137c1caeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:42:09 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-78d9f484-8a9c-4449-994a-15343698c83e tempest-DeleteServersTestJSON-1647155838 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2454a14-eb46-4e18-b9d4-a66137c1caeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:42:09 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-78d9f484-8a9c-4449-994a-15343698c83e tempest-DeleteServersTestJSON-1647155838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3b33e0e-5477-4807-80fb-ea9457b7fd14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:42:09 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-78d9f484-8a9c-4449-994a-15343698c83e tempest-DeleteServersTestJSON-1647155838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3b33e0e-5477-4807-80fb-ea9457b7fd14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '13ccba46-afa8-4270-88b0-a98c50c73928', 'volume_name': 'volume-13ccba46-afa8-4270-88b0-a98c50c73928', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:42:09 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-78d9f484-8a9c-4449-994a-15343698c83e tempest-DeleteServersTestJSON-1647155838 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c709e7f0-3429-463c-aa55-60ba8e9912c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:42:09 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-78d9f484-8a9c-4449-994a-15343698c83e tempest-DeleteServersTestJSON-1647155838 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c709e7f0-3429-463c-aa55-60ba8e9912c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:42:09 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-78d9f484-8a9c-4449-994a-15343698c83e tempest-DeleteServersTestJSON-1647155838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2738a23-33bb-4c02-adcc-9a8eb01e2cbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:42:09 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-78d9f484-8a9c-4449-994a-15343698c83e tempest-DeleteServersTestJSON-1647155838 None] Volume 13ccba46-afa8-4270-88b0-a98c50c73928: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-13ccba46-afa8-4270-88b0-a98c50c73928', 'volume_size': 1}
Jul 02 19:42:09 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-78d9f484-8a9c-4449-994a-15343698c83e tempest-DeleteServersTestJSON-1647155838 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:42:09 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-78d9f484-8a9c-4449-994a-15343698c83e tempest-DeleteServersTestJSON-1647155838 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:42:09 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-78d9f484-8a9c-4449-994a-15343698c83e tempest-DeleteServersTestJSON-1647155838 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce906cb830>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T17:42:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-303705606',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13ccba46-afa8-4270-88b0-a98c50c73928,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c26390e565941169fc2af21c935a5dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T17:42:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T17:42:09Z,use_quota=True,user_id='dfa57ef3d7bd42de9e49c498b472bf9b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)}" {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 19:42:09 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-78d9f484-8a9c-4449-994a-15343698c83e tempest-DeleteServersTestJSON-1647155838 None] Creating volume 13ccba46-afa8-4270-88b0-a98c50c73928 {{(pid=86639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 19:42:09 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-78d9f484-8a9c-4449-994a-15343698c83e tempest-DeleteServersTestJSON-1647155838 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:42:09 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-78d9f484-8a9c-4449-994a-15343698c83e tempest-DeleteServersTestJSON-1647155838 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:42:09 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-78d9f484-8a9c-4449-994a-15343698c83e tempest-DeleteServersTestJSON-1647155838 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 19:42:09 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-78d9f484-8a9c-4449-994a-15343698c83e tempest-DeleteServersTestJSON-1647155838 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 19:42:09 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-78d9f484-8a9c-4449-994a-15343698c83e tempest-DeleteServersTestJSON-1647155838 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:42:09 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-78d9f484-8a9c-4449-994a-15343698c83e tempest-DeleteServersTestJSON-1647155838 None] Selected osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92 as target Quobyte volume. {{(pid=86639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 19:42:09 devstack cinder-volume[86639]: INFO cinder.volume.drivers.remotefs [None req-78d9f484-8a9c-4449-994a-15343698c83e tempest-DeleteServersTestJSON-1647155838 None] casted to osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92
Jul 02 19:42:09 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-78d9f484-8a9c-4449-994a-15343698c83e tempest-DeleteServersTestJSON-1647155838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-13ccba46-afa8-4270-88b0-a98c50c73928 1073741824 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:42:09 devstack sudo[87420]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-13ccba46-afa8-4270-88b0-a98c50c73928 1073741824
Jul 02 19:42:09 devstack sudo[87420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:42:11 devstack sudo[87420]: pam_unix(sudo:session): session closed for user root
Jul 02 19:42:11 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-78d9f484-8a9c-4449-994a-15343698c83e tempest-DeleteServersTestJSON-1647155838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-13ccba46-afa8-4270-88b0-a98c50c73928 1073741824" returned: 0 in 1.762s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:42:11 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-78d9f484-8a9c-4449-994a-15343698c83e tempest-DeleteServersTestJSON-1647155838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-13ccba46-afa8-4270-88b0-a98c50c73928 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:42:11 devstack sudo[87742]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-13ccba46-afa8-4270-88b0-a98c50c73928
Jul 02 19:42:11 devstack sudo[87742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:42:13 devstack sudo[87742]: pam_unix(sudo:session): session closed for user root
Jul 02 19:42:13 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-78d9f484-8a9c-4449-994a-15343698c83e tempest-DeleteServersTestJSON-1647155838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-13ccba46-afa8-4270-88b0-a98c50c73928" returned: 0 in 2.158s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:42:13 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-78d9f484-8a9c-4449-994a-15343698c83e tempest-DeleteServersTestJSON-1647155838 None] <== create_volume: return (4027ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'} {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 19:42:13 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-78d9f484-8a9c-4449-994a-15343698c83e tempest-DeleteServersTestJSON-1647155838 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 4.029s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:42:13 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-78d9f484-8a9c-4449-994a-15343698c83e tempest-DeleteServersTestJSON-1647155838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2738a23-33bb-4c02-adcc-9a8eb01e2cbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-13ccba46-afa8-4270-88b0-a98c50c73928', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:42:13 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-78d9f484-8a9c-4449-994a-15343698c83e tempest-DeleteServersTestJSON-1647155838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44bc1735-44c7-46c2-a2f9-f8ac221c3c83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:42:13 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-78d9f484-8a9c-4449-994a-15343698c83e tempest-DeleteServersTestJSON-1647155838 None] Volume volume-13ccba46-afa8-4270-88b0-a98c50c73928 (13ccba46-afa8-4270-88b0-a98c50c73928): created successfully
Jul 02 19:42:13 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-78d9f484-8a9c-4449-994a-15343698c83e tempest-DeleteServersTestJSON-1647155838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44bc1735-44c7-46c2-a2f9-f8ac221c3c83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:42:13 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-78d9f484-8a9c-4449-994a-15343698c83e tempest-DeleteServersTestJSON-1647155838 None] Flow 'volume_create_manager' (6c918107-6190-44d4-80c6-f787ae769409) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 19:42:13 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-78d9f484-8a9c-4449-994a-15343698c83e tempest-DeleteServersTestJSON-1647155838 None] Created volume successfully.
Jul 02 19:42:23 devstack cinder-volume[86639]: DEBUG dbcounter [-] [86639] Writing DB stats cinder:SELECT=3,cinder:UPDATE=2,cinder:INSERT=1 {{(pid=86639) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 02 19:42:23 devstack cinder-volume[86639]: DEBUG dbcounter [-] [86639] Writing DB stats cinder:UPDATE=4,cinder:SELECT=1,cinder:DELETE=1 {{(pid=86639) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 02 19:42:24 devstack cinder-volume[86639]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3b3d915-18e7-4434-87ba-72565307fa49 tempest-VolumesAdminNegativeTest-155562282 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 19:42:24 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-f3b3d915-18e7-4434-87ba-72565307fa49 tempest-VolumesAdminNegativeTest-155562282 None] Flow 'volume_create_manager' (3aa9a1d9-3fc3-46ec-b7b4-50d4c7af9aff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 19:42:24 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-f3b3d915-18e7-4434-87ba-72565307fa49 tempest-VolumesAdminNegativeTest-155562282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (198a2f6f-a2fe-4bab-a136-efe09479bc86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:42:24 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-f3b3d915-18e7-4434-87ba-72565307fa49 tempest-VolumesAdminNegativeTest-155562282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (198a2f6f-a2fe-4bab-a136-efe09479bc86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T17:42:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-2081393534',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf7aa6ce-8e57-4623-be54-452144587639,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b659517363a84486b2dc9800c98fa488',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T17:42:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T17:42:24Z,use_quota=True,user_id='c2d8317eeadf4807b1b81eeb491f0519',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:42:24 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-f3b3d915-18e7-4434-87ba-72565307fa49 tempest-VolumesAdminNegativeTest-155562282 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f80ac2a7-d0a9-458f-aa81-cc88cfe32bcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:42:24 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-f3b3d915-18e7-4434-87ba-72565307fa49 tempest-VolumesAdminNegativeTest-155562282 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f80ac2a7-d0a9-458f-aa81-cc88cfe32bcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:42:24 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-f3b3d915-18e7-4434-87ba-72565307fa49 tempest-VolumesAdminNegativeTest-155562282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f2d41b3-2a93-4b9e-8c32-1258ebfd34f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:42:24 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-f3b3d915-18e7-4434-87ba-72565307fa49 tempest-VolumesAdminNegativeTest-155562282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f2d41b3-2a93-4b9e-8c32-1258ebfd34f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cf7aa6ce-8e57-4623-be54-452144587639', 'volume_name': 'volume-cf7aa6ce-8e57-4623-be54-452144587639', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:42:24 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-f3b3d915-18e7-4434-87ba-72565307fa49 tempest-VolumesAdminNegativeTest-155562282 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81d7d6a7-bea9-4141-bcc7-ef104778f362) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:42:24 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-f3b3d915-18e7-4434-87ba-72565307fa49 tempest-VolumesAdminNegativeTest-155562282 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81d7d6a7-bea9-4141-bcc7-ef104778f362) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:42:24 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-f3b3d915-18e7-4434-87ba-72565307fa49 tempest-VolumesAdminNegativeTest-155562282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca954094-2f86-44e4-8390-ccffa028e144) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:42:24 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-f3b3d915-18e7-4434-87ba-72565307fa49 tempest-VolumesAdminNegativeTest-155562282 None] Volume cf7aa6ce-8e57-4623-be54-452144587639: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cf7aa6ce-8e57-4623-be54-452144587639', 'volume_size': 1}
Jul 02 19:42:24 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-f3b3d915-18e7-4434-87ba-72565307fa49 tempest-VolumesAdminNegativeTest-155562282 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:42:24 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-f3b3d915-18e7-4434-87ba-72565307fa49 tempest-VolumesAdminNegativeTest-155562282 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:42:24 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-f3b3d915-18e7-4434-87ba-72565307fa49 tempest-VolumesAdminNegativeTest-155562282 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce906cb830>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T17:42:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-2081393534',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf7aa6ce-8e57-4623-be54-452144587639,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b659517363a84486b2dc9800c98fa488',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T17:42:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T17:42:24Z,use_quota=True,user_id='c2d8317eeadf4807b1b81eeb491f0519',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)}" {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 19:42:24 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-f3b3d915-18e7-4434-87ba-72565307fa49 tempest-VolumesAdminNegativeTest-155562282 None] Creating volume cf7aa6ce-8e57-4623-be54-452144587639 {{(pid=86639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 19:42:24 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-f3b3d915-18e7-4434-87ba-72565307fa49 tempest-VolumesAdminNegativeTest-155562282 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:42:24 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-f3b3d915-18e7-4434-87ba-72565307fa49 tempest-VolumesAdminNegativeTest-155562282 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:42:24 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-f3b3d915-18e7-4434-87ba-72565307fa49 tempest-VolumesAdminNegativeTest-155562282 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 19:42:24 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-f3b3d915-18e7-4434-87ba-72565307fa49 tempest-VolumesAdminNegativeTest-155562282 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 19:42:24 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-f3b3d915-18e7-4434-87ba-72565307fa49 tempest-VolumesAdminNegativeTest-155562282 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:42:24 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-f3b3d915-18e7-4434-87ba-72565307fa49 tempest-VolumesAdminNegativeTest-155562282 None] Selected osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92 as target Quobyte volume. {{(pid=86639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 19:42:24 devstack cinder-volume[86639]: INFO cinder.volume.drivers.remotefs [None req-f3b3d915-18e7-4434-87ba-72565307fa49 tempest-VolumesAdminNegativeTest-155562282 None] casted to osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92
Jul 02 19:42:24 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-f3b3d915-18e7-4434-87ba-72565307fa49 tempest-VolumesAdminNegativeTest-155562282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-cf7aa6ce-8e57-4623-be54-452144587639 1073741824 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:42:24 devstack sudo[87889]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-cf7aa6ce-8e57-4623-be54-452144587639 1073741824
Jul 02 19:42:24 devstack sudo[87889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:42:26 devstack cinder-volume[86639]: WARNING py.warnings [req-ba2d5635-4e66-44b2-837c-fbc8f6cf31f0 req-658d32de-9de9-40d8-8a73-d70fad337f31 tempest-DeleteServersTestJSON-1647155838 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes_1", "volume_attachment" and FROM element "volumes".  Apply join condition(s) between each element to resolve.
Jul 02 19:42:26 devstack cinder-volume[86639]:   .first()
Jul 02 19:42:26 devstack cinder-volume[86639]: 
Jul 02 19:42:26 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [req-ba2d5635-4e66-44b2-837c-fbc8f6cf31f0 req-658d32de-9de9-40d8-8a73-d70fad337f31 tempest-DeleteServersTestJSON-1647155838 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:42:26 devstack sudo[87889]: pam_unix(sudo:session): session closed for user root
Jul 02 19:42:26 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-f3b3d915-18e7-4434-87ba-72565307fa49 tempest-VolumesAdminNegativeTest-155562282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-cf7aa6ce-8e57-4623-be54-452144587639 1073741824" returned: 0 in 2.464s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:42:27 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-f3b3d915-18e7-4434-87ba-72565307fa49 tempest-VolumesAdminNegativeTest-155562282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-cf7aa6ce-8e57-4623-be54-452144587639 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:42:27 devstack sudo[87954]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-cf7aa6ce-8e57-4623-be54-452144587639
Jul 02 19:42:27 devstack sudo[87954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:42:29 devstack sudo[87954]: pam_unix(sudo:session): session closed for user root
Jul 02 19:42:29 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-f3b3d915-18e7-4434-87ba-72565307fa49 tempest-VolumesAdminNegativeTest-155562282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-cf7aa6ce-8e57-4623-be54-452144587639" returned: 0 in 2.201s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:42:29 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-f3b3d915-18e7-4434-87ba-72565307fa49 tempest-VolumesAdminNegativeTest-155562282 None] <== create_volume: return (4970ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'} {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 19:42:29 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-f3b3d915-18e7-4434-87ba-72565307fa49 tempest-VolumesAdminNegativeTest-155562282 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 4.981s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:42:29 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [req-ba2d5635-4e66-44b2-837c-fbc8f6cf31f0 req-658d32de-9de9-40d8-8a73-d70fad337f31 tempest-DeleteServersTestJSON-1647155838 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.976s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:42:29 devstack cinder-volume[86639]: INFO oslo.privsep.daemon [req-ba2d5635-4e66-44b2-837c-fbc8f6cf31f0 req-658d32de-9de9-40d8-8a73-d70fad337f31 tempest-DeleteServersTestJSON-1647155838 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpw39b7akh/privsep.sock']
Jul 02 19:42:29 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-f3b3d915-18e7-4434-87ba-72565307fa49 tempest-VolumesAdminNegativeTest-155562282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca954094-2f86-44e4-8390-ccffa028e144) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf7aa6ce-8e57-4623-be54-452144587639', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:42:29 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-f3b3d915-18e7-4434-87ba-72565307fa49 tempest-VolumesAdminNegativeTest-155562282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba83decb-8f45-4566-9b5c-88433143eb6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:42:29 devstack sudo[87979]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpw39b7akh/privsep.sock
Jul 02 19:42:29 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-f3b3d915-18e7-4434-87ba-72565307fa49 tempest-VolumesAdminNegativeTest-155562282 None] Volume volume-cf7aa6ce-8e57-4623-be54-452144587639 (cf7aa6ce-8e57-4623-be54-452144587639): created successfully
Jul 02 19:42:29 devstack sudo[87979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:42:29 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-f3b3d915-18e7-4434-87ba-72565307fa49 tempest-VolumesAdminNegativeTest-155562282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba83decb-8f45-4566-9b5c-88433143eb6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:42:29 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-f3b3d915-18e7-4434-87ba-72565307fa49 tempest-VolumesAdminNegativeTest-155562282 None] Flow 'volume_create_manager' (3aa9a1d9-3fc3-46ec-b7b4-50d4c7af9aff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 19:42:29 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-f3b3d915-18e7-4434-87ba-72565307fa49 tempest-VolumesAdminNegativeTest-155562282 None] Created volume successfully.
Jul 02 19:42:31 devstack cinder-volume[86639]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning:
Jul 02 19:42:31 devstack cinder-volume[86639]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Jul 02 19:42:31 devstack cinder-volume[86639]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
Jul 02 19:42:31 devstack cinder-volume[86639]: WARNING oslo.privsep.daemon [-] privsep log: 
Jul 02 19:42:31 devstack cinder-volume[86639]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
Jul 02 19:42:31 devstack cinder-volume[86639]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
Jul 02 19:42:31 devstack cinder-volume[86639]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Jul 02 19:42:31 devstack cinder-volume[86639]: WARNING oslo.privsep.daemon [-] privsep log: 
Jul 02 19:42:31 devstack cinder-volume[86639]: WARNING oslo.privsep.daemon [-] privsep log:   import eventlet.patcher
Jul 02 19:42:32 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-6fcfc3cd-bdf7-429d-b9c1-b160bad1ac74 tempest-VolumesAdminNegativeTest-155562282 None] Acquiring lock "cinder-cf7aa6ce-8e57-4623-be54-452144587639-delete_volume" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:42:32 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-6fcfc3cd-bdf7-429d-b9c1-b160bad1ac74 tempest-VolumesAdminNegativeTest-155562282 None] Lock "cinder-cf7aa6ce-8e57-4623-be54-452144587639-delete_volume" acquired by "delete_volume" :: waited 0.104s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:42:32 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-6fcfc3cd-bdf7-429d-b9c1-b160bad1ac74 tempest-VolumesAdminNegativeTest-155562282 None] Acquiring lock "cinder-quobyte-cf7aa6ce-8e57-4623-be54-452144587639" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:42:32 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-6fcfc3cd-bdf7-429d-b9c1-b160bad1ac74 tempest-VolumesAdminNegativeTest-155562282 None] Lock "cinder-quobyte-cf7aa6ce-8e57-4623-be54-452144587639" acquired by "delete_volume" :: waited 0.044s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:42:34 devstack cinder-volume[86639]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/importutils.py:77: EventletDeprecationWarning:
Jul 02 19:42:34 devstack cinder-volume[86639]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Jul 02 19:42:34 devstack cinder-volume[86639]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
Jul 02 19:42:34 devstack cinder-volume[86639]: WARNING oslo.privsep.daemon [-] privsep log: 
Jul 02 19:42:34 devstack cinder-volume[86639]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
Jul 02 19:42:34 devstack cinder-volume[86639]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
Jul 02 19:42:34 devstack cinder-volume[86639]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Jul 02 19:42:34 devstack cinder-volume[86639]: WARNING oslo.privsep.daemon [-] privsep log: 
Jul 02 19:42:34 devstack cinder-volume[86639]: WARNING oslo.privsep.daemon [-] privsep log:   __import__(import_str)
Jul 02 19:42:35 devstack cinder-volume[86639]: INFO oslo.privsep.daemon [req-ba2d5635-4e66-44b2-837c-fbc8f6cf31f0 req-658d32de-9de9-40d8-8a73-d70fad337f31 tempest-DeleteServersTestJSON-1647155838 None] Spawned new privsep daemon via rootwrap
Jul 02 19:42:35 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [req-ba2d5635-4e66-44b2-837c-fbc8f6cf31f0 req-658d32de-9de9-40d8-8a73-d70fad337f31 tempest-DeleteServersTestJSON-1647155838 None] Accepted privsep connection to /tmp/tmpw39b7akh/privsep.sock {{(pid=86639) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}}
Jul 02 19:42:35 devstack cinder-volume[86639]: INFO oslo.privsep.daemon [-] privsep daemon starting
Jul 02 19:42:35 devstack cinder-volume[86639]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Jul 02 19:42:35 devstack cinder-volume[86639]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Jul 02 19:42:35 devstack cinder-volume[86639]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 87992
Jul 02 19:42:35 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[9879736c-911c-4317-ac0f-42d51daae847]: (2,) {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 19:42:35 devstack cinder-volume[86639]: WARNING oslo_privsep.priv_context [None req-6fcfc3cd-bdf7-429d-b9c1-b160bad1ac74 tempest-VolumesAdminNegativeTest-155562282 None] privsep daemon already running
Jul 02 19:42:35 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[bea081eb-ca8d-4125-b4cb-af9946186c01]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 19:42:35 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [req-ba2d5635-4e66-44b2-837c-fbc8f6cf31f0 req-658d32de-9de9-40d8-8a73-d70fad337f31 tempest-DeleteServersTestJSON-1647155838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-13ccba46-afa8-4270-88b0-a98c50c73928 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:42:35 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0e3b3b8-df4d-47b8-8119-f3118e91ece3]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 19:42:35 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-6fcfc3cd-bdf7-429d-b9c1-b160bad1ac74 tempest-VolumesAdminNegativeTest-155562282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-cf7aa6ce-8e57-4623-be54-452144587639 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:42:36 devstack sudo[88057]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-13ccba46-afa8-4270-88b0-a98c50c73928
Jul 02 19:42:36 devstack sudo[88057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:42:36 devstack sudo[88058]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-cf7aa6ce-8e57-4623-be54-452144587639
Jul 02 19:42:36 devstack sudo[88058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:42:37 devstack sudo[88057]: pam_unix(sudo:session): session closed for user root
Jul 02 19:42:37 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [req-ba2d5635-4e66-44b2-837c-fbc8f6cf31f0 req-658d32de-9de9-40d8-8a73-d70fad337f31 tempest-DeleteServersTestJSON-1647155838 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-13ccba46-afa8-4270-88b0-a98c50c73928" returned: 0 in 1.803s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:42:37 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [req-ba2d5635-4e66-44b2-837c-fbc8f6cf31f0 req-658d32de-9de9-40d8-8a73-d70fad337f31 tempest-DeleteServersTestJSON-1647155838 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 8.325s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:42:37 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [req-ba2d5635-4e66-44b2-837c-fbc8f6cf31f0 req-658d32de-9de9-40d8-8a73-d70fad337f31 tempest-DeleteServersTestJSON-1647155838 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92', 'name': 'volume-13ccba46-afa8-4270-88b0-a98c50c73928', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '79765d43-89b7-40af-b228-84b91f4b317a', 'enforce_multipath': True} {{(pid=86639) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 02 19:42:37 devstack sudo[88058]: pam_unix(sudo:session): session closed for user root
Jul 02 19:42:37 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-6fcfc3cd-bdf7-429d-b9c1-b160bad1ac74 tempest-VolumesAdminNegativeTest-155562282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-cf7aa6ce-8e57-4623-be54-452144587639" returned: 0 in 1.946s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:42:37 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-6fcfc3cd-bdf7-429d-b9c1-b160bad1ac74 tempest-VolumesAdminNegativeTest-155562282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-cf7aa6ce-8e57-4623-be54-452144587639 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:42:37 devstack sudo[88074]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-cf7aa6ce-8e57-4623-be54-452144587639
Jul 02 19:42:37 devstack sudo[88074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:42:38 devstack cinder-volume[86639]: INFO cinder.volume.manager [req-ba2d5635-4e66-44b2-837c-fbc8f6cf31f0 req-658d32de-9de9-40d8-8a73-d70fad337f31 tempest-DeleteServersTestJSON-1647155838 None] attachment_update completed successfully.
Jul 02 19:42:39 devstack sudo[88074]: pam_unix(sudo:session): session closed for user root
Jul 02 19:42:39 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-6fcfc3cd-bdf7-429d-b9c1-b160bad1ac74 tempest-VolumesAdminNegativeTest-155562282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-cf7aa6ce-8e57-4623-be54-452144587639" returned: 0 in 1.132s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:42:39 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-6fcfc3cd-bdf7-429d-b9c1-b160bad1ac74 tempest-VolumesAdminNegativeTest-155562282 None] Lock "cinder-quobyte-cf7aa6ce-8e57-4623-be54-452144587639" released by "delete_volume" :: held 6.310s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:42:39 devstack cinder-volume[86639]: WARNING cinder.quota [None req-6fcfc3cd-bdf7-429d-b9c1-b160bad1ac74 tempest-VolumesAdminNegativeTest-155562282 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Jul 02 19:42:39 devstack cinder-volume[86639]: WARNING cinder.quota [None req-6fcfc3cd-bdf7-429d-b9c1-b160bad1ac74 tempest-VolumesAdminNegativeTest-155562282 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Jul 02 19:42:39 devstack cinder-volume[86639]: DEBUG cinder.quota [None req-6fcfc3cd-bdf7-429d-b9c1-b160bad1ac74 tempest-VolumesAdminNegativeTest-155562282 None] Created reservations ['d90ec1a6-100f-4ca0-8b9f-b2aa23a91df9', 'c63762a4-3af0-4367-87b6-8877f53a6579', '126fdb4e-5189-4fcf-be23-063017f3aa3f', '4179c445-6242-4dae-8c44-836e884db3dc'] {{(pid=86639) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 19:42:39 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-6fcfc3cd-bdf7-429d-b9c1-b160bad1ac74 tempest-VolumesAdminNegativeTest-155562282 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:42:39 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-6fcfc3cd-bdf7-429d-b9c1-b160bad1ac74 tempest-VolumesAdminNegativeTest-155562282 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:42:39 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-6fcfc3cd-bdf7-429d-b9c1-b160bad1ac74 tempest-VolumesAdminNegativeTest-155562282 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 19:42:39 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-6fcfc3cd-bdf7-429d-b9c1-b160bad1ac74 tempest-VolumesAdminNegativeTest-155562282 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 19:42:39 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-6fcfc3cd-bdf7-429d-b9c1-b160bad1ac74 tempest-VolumesAdminNegativeTest-155562282 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:42:39 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-6fcfc3cd-bdf7-429d-b9c1-b160bad1ac74 tempest-VolumesAdminNegativeTest-155562282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:42:39 devstack sudo[88302]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e
Jul 02 19:42:39 devstack sudo[88302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:42:40 devstack sudo[88302]: pam_unix(sudo:session): session closed for user root
Jul 02 19:42:40 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-6fcfc3cd-bdf7-429d-b9c1-b160bad1ac74 tempest-VolumesAdminNegativeTest-155562282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e" returned: 0 in 1.444s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:42:40 devstack cinder-volume[86639]: DEBUG cinder.manager [None req-6fcfc3cd-bdf7-429d-b9c1-b160bad1ac74 tempest-VolumesAdminNegativeTest-155562282 None] Notifying Schedulers of capabilities ... {{(pid=86639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 19:42:40 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-6fcfc3cd-bdf7-429d-b9c1-b160bad1ac74 tempest-VolumesAdminNegativeTest-155562282 None] Deleted volume successfully.
Jul 02 19:42:40 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-6fcfc3cd-bdf7-429d-b9c1-b160bad1ac74 tempest-VolumesAdminNegativeTest-155562282 None] Lock "cinder-cf7aa6ce-8e57-4623-be54-452144587639-delete_volume" released by "delete_volume" :: held 8.416s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:42:41 devstack cinder-volume[86639]: DEBUG oslo_service.periodic_task [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86639) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 02 19:42:41 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:42:41 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:42:41 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 19:42:41 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 19:42:41 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.045s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:42:41 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:42:41 devstack sudo[88472]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e
Jul 02 19:42:41 devstack sudo[88472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:42:42 devstack sudo[88472]: pam_unix(sudo:session): session closed for user root
Jul 02 19:42:42 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e" returned: 0 in 1.354s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:42:42 devstack cinder-volume[86639]: DEBUG cinder.manager [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] Notifying Schedulers of capabilities ... {{(pid=86639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 19:42:42 devstack cinder-volume[86639]: DEBUG oslo_service.periodic_task [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] Running periodic task VolumeManager._thread_info {{(pid=86639) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 02 19:42:42 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] thread count: 8 {{(pid=86639) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 02 19:42:42 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] thread info: [<_MainThread(MainThread, started 140525261275264)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 140525150678016)>, <Thread(Thread-3 (stat_writer), started daemon 140525150025920)>, <Thread(Rabbit-heartbeat, started daemon 140525150500864)>, <Thread(Thread-5 (_runner), started daemon 140525149847296)>, <Thread(Thread-7 (_runner), started daemon 140525149863424)>, <Thread(fd_logger, started daemon 140525146589376)>, <Thread(privsep_reader, started daemon 140525144562432)>] {{(pid=86639) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 02 19:42:45 devstack cinder-volume[86639]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ed10da7-136c-4aa7-8316-fee59b1e20b5 tempest-ServersNegativeTestJSON-484426248 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 19:42:45 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-1ed10da7-136c-4aa7-8316-fee59b1e20b5 tempest-ServersNegativeTestJSON-484426248 None] Flow 'volume_create_manager' (fc828a3d-9d2c-4f08-b04d-b1a3f7f51407) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 19:42:45 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-1ed10da7-136c-4aa7-8316-fee59b1e20b5 tempest-ServersNegativeTestJSON-484426248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b91b77a9-ac41-4afd-8d10-7d39c2318f7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:42:45 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-1ed10da7-136c-4aa7-8316-fee59b1e20b5 tempest-ServersNegativeTestJSON-484426248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b91b77a9-ac41-4afd-8d10-7d39c2318f7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T17:42:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-744979158',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5d0738e-fb51-4a48-a732-0b7a3bb97622,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2962938b7bd74b8795383b428b2da94b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T17:42:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T17:42:45Z,use_quota=True,user_id='b5b90170d4d241e48a6a3b2a12803ce7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:42:45 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-1ed10da7-136c-4aa7-8316-fee59b1e20b5 tempest-ServersNegativeTestJSON-484426248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bfe7988-2195-44ba-aebb-b0e362a6cdbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:42:45 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-1ed10da7-136c-4aa7-8316-fee59b1e20b5 tempest-ServersNegativeTestJSON-484426248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bfe7988-2195-44ba-aebb-b0e362a6cdbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:42:45 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-1ed10da7-136c-4aa7-8316-fee59b1e20b5 tempest-ServersNegativeTestJSON-484426248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb6e6164-def1-4428-9cf5-ea52b5318166) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:42:45 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-1ed10da7-136c-4aa7-8316-fee59b1e20b5 tempest-ServersNegativeTestJSON-484426248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb6e6164-def1-4428-9cf5-ea52b5318166) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f5d0738e-fb51-4a48-a732-0b7a3bb97622', 'volume_name': 'volume-f5d0738e-fb51-4a48-a732-0b7a3bb97622', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:42:45 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-1ed10da7-136c-4aa7-8316-fee59b1e20b5 tempest-ServersNegativeTestJSON-484426248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40dc21e8-136e-4e4b-89fc-0542f7ad1be8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:42:45 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-1ed10da7-136c-4aa7-8316-fee59b1e20b5 tempest-ServersNegativeTestJSON-484426248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40dc21e8-136e-4e4b-89fc-0542f7ad1be8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:42:45 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-1ed10da7-136c-4aa7-8316-fee59b1e20b5 tempest-ServersNegativeTestJSON-484426248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ff1b85b-e7c0-4c76-a640-e88e5d244747) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:42:45 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-1ed10da7-136c-4aa7-8316-fee59b1e20b5 tempest-ServersNegativeTestJSON-484426248 None] Volume f5d0738e-fb51-4a48-a732-0b7a3bb97622: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f5d0738e-fb51-4a48-a732-0b7a3bb97622', 'volume_size': 1}
Jul 02 19:42:45 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-1ed10da7-136c-4aa7-8316-fee59b1e20b5 tempest-ServersNegativeTestJSON-484426248 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:42:45 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-1ed10da7-136c-4aa7-8316-fee59b1e20b5 tempest-ServersNegativeTestJSON-484426248 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:42:45 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-1ed10da7-136c-4aa7-8316-fee59b1e20b5 tempest-ServersNegativeTestJSON-484426248 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce906cb830>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T17:42:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-744979158',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5d0738e-fb51-4a48-a732-0b7a3bb97622,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2962938b7bd74b8795383b428b2da94b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T17:42:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T17:42:45Z,use_quota=True,user_id='b5b90170d4d241e48a6a3b2a12803ce7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)}" {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 19:42:45 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-1ed10da7-136c-4aa7-8316-fee59b1e20b5 tempest-ServersNegativeTestJSON-484426248 None] Creating volume f5d0738e-fb51-4a48-a732-0b7a3bb97622 {{(pid=86639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 19:42:45 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-1ed10da7-136c-4aa7-8316-fee59b1e20b5 tempest-ServersNegativeTestJSON-484426248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:42:45 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-1ed10da7-136c-4aa7-8316-fee59b1e20b5 tempest-ServersNegativeTestJSON-484426248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:42:45 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-1ed10da7-136c-4aa7-8316-fee59b1e20b5 tempest-ServersNegativeTestJSON-484426248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 19:42:45 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-1ed10da7-136c-4aa7-8316-fee59b1e20b5 tempest-ServersNegativeTestJSON-484426248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 19:42:45 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-1ed10da7-136c-4aa7-8316-fee59b1e20b5 tempest-ServersNegativeTestJSON-484426248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:42:45 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-1ed10da7-136c-4aa7-8316-fee59b1e20b5 tempest-ServersNegativeTestJSON-484426248 None] Selected osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92 as target Quobyte volume. {{(pid=86639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 19:42:45 devstack cinder-volume[86639]: INFO cinder.volume.drivers.remotefs [None req-1ed10da7-136c-4aa7-8316-fee59b1e20b5 tempest-ServersNegativeTestJSON-484426248 None] casted to osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92
Jul 02 19:42:45 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-1ed10da7-136c-4aa7-8316-fee59b1e20b5 tempest-ServersNegativeTestJSON-484426248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-f5d0738e-fb51-4a48-a732-0b7a3bb97622 1073741824 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:42:45 devstack sudo[88574]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-f5d0738e-fb51-4a48-a732-0b7a3bb97622 1073741824
Jul 02 19:42:45 devstack sudo[88574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:42:47 devstack sudo[88574]: pam_unix(sudo:session): session closed for user root
Jul 02 19:42:47 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-1ed10da7-136c-4aa7-8316-fee59b1e20b5 tempest-ServersNegativeTestJSON-484426248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-f5d0738e-fb51-4a48-a732-0b7a3bb97622 1073741824" returned: 0 in 1.375s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:42:47 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-1ed10da7-136c-4aa7-8316-fee59b1e20b5 tempest-ServersNegativeTestJSON-484426248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-f5d0738e-fb51-4a48-a732-0b7a3bb97622 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:42:47 devstack sudo[88584]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-f5d0738e-fb51-4a48-a732-0b7a3bb97622
Jul 02 19:42:47 devstack sudo[88584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:42:48 devstack sudo[88584]: pam_unix(sudo:session): session closed for user root
Jul 02 19:42:48 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-1ed10da7-136c-4aa7-8316-fee59b1e20b5 tempest-ServersNegativeTestJSON-484426248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-f5d0738e-fb51-4a48-a732-0b7a3bb97622" returned: 0 in 0.939s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:42:48 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-1ed10da7-136c-4aa7-8316-fee59b1e20b5 tempest-ServersNegativeTestJSON-484426248 None] <== create_volume: return (2420ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'} {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 19:42:48 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-1ed10da7-136c-4aa7-8316-fee59b1e20b5 tempest-ServersNegativeTestJSON-484426248 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.425s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:42:48 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-1ed10da7-136c-4aa7-8316-fee59b1e20b5 tempest-ServersNegativeTestJSON-484426248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ff1b85b-e7c0-4c76-a640-e88e5d244747) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f5d0738e-fb51-4a48-a732-0b7a3bb97622', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:42:48 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-1ed10da7-136c-4aa7-8316-fee59b1e20b5 tempest-ServersNegativeTestJSON-484426248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e9d9976-eda3-4ee9-a887-e432140f2637) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:42:48 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-1ed10da7-136c-4aa7-8316-fee59b1e20b5 tempest-ServersNegativeTestJSON-484426248 None] Volume volume-f5d0738e-fb51-4a48-a732-0b7a3bb97622 (f5d0738e-fb51-4a48-a732-0b7a3bb97622): created successfully
Jul 02 19:42:48 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-1ed10da7-136c-4aa7-8316-fee59b1e20b5 tempest-ServersNegativeTestJSON-484426248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e9d9976-eda3-4ee9-a887-e432140f2637) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:42:48 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-1ed10da7-136c-4aa7-8316-fee59b1e20b5 tempest-ServersNegativeTestJSON-484426248 None] Flow 'volume_create_manager' (fc828a3d-9d2c-4f08-b04d-b1a3f7f51407) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 19:42:48 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-1ed10da7-136c-4aa7-8316-fee59b1e20b5 tempest-ServersNegativeTestJSON-484426248 None] Created volume successfully.
Jul 02 19:42:48 devstack cinder-volume[86639]: INFO cinder.volume.manager [req-b7996161-1461-4989-978e-1133f785621d req-bea9f7bd-ec21-48ae-b27f-63e8ead16503 tempest-DeleteServersTestJSON-1647155838 None] Terminate volume connection completed successfully.
Jul 02 19:42:48 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [req-b7996161-1461-4989-978e-1133f785621d req-bea9f7bd-ec21-48ae-b27f-63e8ead16503 tempest-DeleteServersTestJSON-1647155838 None] Deleting attachment 79765d43-89b7-40af-b228-84b91f4b317a. {{(pid=86639) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 02 19:42:54 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-e0a476ad-43fe-4586-8873-56b470420500 tempest-DeleteServersTestJSON-1647155838 None] Acquiring lock "cinder-13ccba46-afa8-4270-88b0-a98c50c73928-delete_volume" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:42:54 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-e0a476ad-43fe-4586-8873-56b470420500 tempest-DeleteServersTestJSON-1647155838 None] Lock "cinder-13ccba46-afa8-4270-88b0-a98c50c73928-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:42:54 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-e0a476ad-43fe-4586-8873-56b470420500 tempest-DeleteServersTestJSON-1647155838 None] Acquiring lock "cinder-quobyte-13ccba46-afa8-4270-88b0-a98c50c73928" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:42:54 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-e0a476ad-43fe-4586-8873-56b470420500 tempest-DeleteServersTestJSON-1647155838 None] Lock "cinder-quobyte-13ccba46-afa8-4270-88b0-a98c50c73928" acquired by "delete_volume" :: waited 0.032s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:42:54 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[3131b733-afe6-4ceb-8fff-570009477458]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 19:42:54 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-e0a476ad-43fe-4586-8873-56b470420500 tempest-DeleteServersTestJSON-1647155838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-13ccba46-afa8-4270-88b0-a98c50c73928 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:42:55 devstack sudo[88595]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-13ccba46-afa8-4270-88b0-a98c50c73928
Jul 02 19:42:55 devstack sudo[88595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:42:55 devstack sudo[88595]: pam_unix(sudo:session): session closed for user root
Jul 02 19:42:55 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-e0a476ad-43fe-4586-8873-56b470420500 tempest-DeleteServersTestJSON-1647155838 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-13ccba46-afa8-4270-88b0-a98c50c73928" returned: 0 in 1.099s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:42:55 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-e0a476ad-43fe-4586-8873-56b470420500 tempest-DeleteServersTestJSON-1647155838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-13ccba46-afa8-4270-88b0-a98c50c73928 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:42:55 devstack sudo[88602]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-13ccba46-afa8-4270-88b0-a98c50c73928
Jul 02 19:42:55 devstack sudo[88602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:42:56 devstack sudo[88602]: pam_unix(sudo:session): session closed for user root
Jul 02 19:42:56 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-e0a476ad-43fe-4586-8873-56b470420500 tempest-DeleteServersTestJSON-1647155838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-13ccba46-afa8-4270-88b0-a98c50c73928" returned: 0 in 1.001s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:42:56 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-e0a476ad-43fe-4586-8873-56b470420500 tempest-DeleteServersTestJSON-1647155838 None] Lock "cinder-quobyte-13ccba46-afa8-4270-88b0-a98c50c73928" released by "delete_volume" :: held 2.168s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:42:57 devstack cinder-volume[86639]: DEBUG cinder.quota [None req-e0a476ad-43fe-4586-8873-56b470420500 tempest-DeleteServersTestJSON-1647155838 None] Created reservations ['b231a474-4edc-4234-a72d-26b36487ecff', '3047385e-9f45-4e37-8e55-1e75b753c14e', 'bff6bfbe-ece6-40f6-8b53-c29a8b6631d5', 'ba449987-cc91-43d6-a32d-4e6d7ac3cc56'] {{(pid=86639) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 19:42:57 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-e0a476ad-43fe-4586-8873-56b470420500 tempest-DeleteServersTestJSON-1647155838 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:42:57 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-e0a476ad-43fe-4586-8873-56b470420500 tempest-DeleteServersTestJSON-1647155838 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:42:57 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-e0a476ad-43fe-4586-8873-56b470420500 tempest-DeleteServersTestJSON-1647155838 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 19:42:57 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-e0a476ad-43fe-4586-8873-56b470420500 tempest-DeleteServersTestJSON-1647155838 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 19:42:57 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-e0a476ad-43fe-4586-8873-56b470420500 tempest-DeleteServersTestJSON-1647155838 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:42:57 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-e0a476ad-43fe-4586-8873-56b470420500 tempest-DeleteServersTestJSON-1647155838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:42:57 devstack sudo[88606]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e
Jul 02 19:42:57 devstack sudo[88606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:42:57 devstack cinder-volume[86639]: DEBUG cinder.volume.flows.manager.create_volume [None req-0bf0c6d4-053e-4eed-bb36-7fd6973e31d8 tempest-ServersNegativeTestJSON-484426248 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 19:42:57 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-0bf0c6d4-053e-4eed-bb36-7fd6973e31d8 tempest-ServersNegativeTestJSON-484426248 None] Flow 'volume_create_manager' (c9ea21df-cc8f-483a-9a0d-541babdefc71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 19:42:57 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-0bf0c6d4-053e-4eed-bb36-7fd6973e31d8 tempest-ServersNegativeTestJSON-484426248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f744403-ae00-406b-a508-bb88c73b064e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:42:57 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-0bf0c6d4-053e-4eed-bb36-7fd6973e31d8 tempest-ServersNegativeTestJSON-484426248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f744403-ae00-406b-a508-bb88c73b064e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T17:42:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-2008446316',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48e157dd-e0b7-4b12-9ef2-e2fa726edb8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2962938b7bd74b8795383b428b2da94b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T17:42:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T17:42:57Z,use_quota=True,user_id='b5b90170d4d241e48a6a3b2a12803ce7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:42:57 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-0bf0c6d4-053e-4eed-bb36-7fd6973e31d8 tempest-ServersNegativeTestJSON-484426248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bde1b8e-4ed1-48bd-b62b-3950691c8e95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:42:57 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-0bf0c6d4-053e-4eed-bb36-7fd6973e31d8 tempest-ServersNegativeTestJSON-484426248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bde1b8e-4ed1-48bd-b62b-3950691c8e95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:42:57 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-0bf0c6d4-053e-4eed-bb36-7fd6973e31d8 tempest-ServersNegativeTestJSON-484426248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e074bd34-f503-40d4-bd8b-6e6532bd236d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:42:57 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-0bf0c6d4-053e-4eed-bb36-7fd6973e31d8 tempest-ServersNegativeTestJSON-484426248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e074bd34-f503-40d4-bd8b-6e6532bd236d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '48e157dd-e0b7-4b12-9ef2-e2fa726edb8b', 'volume_name': 'volume-48e157dd-e0b7-4b12-9ef2-e2fa726edb8b', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:42:57 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-0bf0c6d4-053e-4eed-bb36-7fd6973e31d8 tempest-ServersNegativeTestJSON-484426248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fa2f3f8-d90a-48fc-be82-e0ffedd04808) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:42:57 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-0bf0c6d4-053e-4eed-bb36-7fd6973e31d8 tempest-ServersNegativeTestJSON-484426248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fa2f3f8-d90a-48fc-be82-e0ffedd04808) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:42:57 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-0bf0c6d4-053e-4eed-bb36-7fd6973e31d8 tempest-ServersNegativeTestJSON-484426248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (943b6894-fedc-428f-8fc2-2e679ce5b10e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:42:57 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-0bf0c6d4-053e-4eed-bb36-7fd6973e31d8 tempest-ServersNegativeTestJSON-484426248 None] Volume 48e157dd-e0b7-4b12-9ef2-e2fa726edb8b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-48e157dd-e0b7-4b12-9ef2-e2fa726edb8b', 'volume_size': 1}
Jul 02 19:42:57 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-0bf0c6d4-053e-4eed-bb36-7fd6973e31d8 tempest-ServersNegativeTestJSON-484426248 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:42:57 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-0bf0c6d4-053e-4eed-bb36-7fd6973e31d8 tempest-ServersNegativeTestJSON-484426248 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:42:57 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-0bf0c6d4-053e-4eed-bb36-7fd6973e31d8 tempest-ServersNegativeTestJSON-484426248 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce906cb830>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T17:42:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-2008446316',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48e157dd-e0b7-4b12-9ef2-e2fa726edb8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2962938b7bd74b8795383b428b2da94b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T17:42:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T17:42:57Z,use_quota=True,user_id='b5b90170d4d241e48a6a3b2a12803ce7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)}" {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 19:42:57 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-0bf0c6d4-053e-4eed-bb36-7fd6973e31d8 tempest-ServersNegativeTestJSON-484426248 None] Creating volume 48e157dd-e0b7-4b12-9ef2-e2fa726edb8b {{(pid=86639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 19:42:57 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-0bf0c6d4-053e-4eed-bb36-7fd6973e31d8 tempest-ServersNegativeTestJSON-484426248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:42:57 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-0bf0c6d4-053e-4eed-bb36-7fd6973e31d8 tempest-ServersNegativeTestJSON-484426248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:42:57 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-0bf0c6d4-053e-4eed-bb36-7fd6973e31d8 tempest-ServersNegativeTestJSON-484426248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 19:42:57 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-0bf0c6d4-053e-4eed-bb36-7fd6973e31d8 tempest-ServersNegativeTestJSON-484426248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 19:42:57 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-0bf0c6d4-053e-4eed-bb36-7fd6973e31d8 tempest-ServersNegativeTestJSON-484426248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:42:57 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-0bf0c6d4-053e-4eed-bb36-7fd6973e31d8 tempest-ServersNegativeTestJSON-484426248 None] Selected osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92 as target Quobyte volume. {{(pid=86639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 19:42:57 devstack cinder-volume[86639]: INFO cinder.volume.drivers.remotefs [None req-0bf0c6d4-053e-4eed-bb36-7fd6973e31d8 tempest-ServersNegativeTestJSON-484426248 None] casted to osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92
Jul 02 19:42:57 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-0bf0c6d4-053e-4eed-bb36-7fd6973e31d8 tempest-ServersNegativeTestJSON-484426248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-48e157dd-e0b7-4b12-9ef2-e2fa726edb8b 1073741824 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:42:57 devstack sudo[88608]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-48e157dd-e0b7-4b12-9ef2-e2fa726edb8b 1073741824
Jul 02 19:42:57 devstack sudo[88608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:42:58 devstack sudo[88606]: pam_unix(sudo:session): session closed for user root
Jul 02 19:42:58 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-e0a476ad-43fe-4586-8873-56b470420500 tempest-DeleteServersTestJSON-1647155838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e" returned: 0 in 1.326s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:42:58 devstack cinder-volume[86639]: DEBUG cinder.manager [None req-e0a476ad-43fe-4586-8873-56b470420500 tempest-DeleteServersTestJSON-1647155838 None] Notifying Schedulers of capabilities ... {{(pid=86639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 19:42:58 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-e0a476ad-43fe-4586-8873-56b470420500 tempest-DeleteServersTestJSON-1647155838 None] Deleted volume successfully.
Jul 02 19:42:58 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-e0a476ad-43fe-4586-8873-56b470420500 tempest-DeleteServersTestJSON-1647155838 None] Lock "cinder-13ccba46-afa8-4270-88b0-a98c50c73928-delete_volume" released by "delete_volume" :: held 3.938s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:42:59 devstack cinder-volume[86639]: DEBUG cinder.volume.flows.manager.create_volume [None req-fbc62492-0611-4f79-bdbe-1d0f42938cdf tempest-TaggedAttachmentsTest-241125395 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 19:42:59 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-fbc62492-0611-4f79-bdbe-1d0f42938cdf tempest-TaggedAttachmentsTest-241125395 None] Flow 'volume_create_manager' (4d26106c-c45d-4888-a497-d3d51d102c8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 19:42:59 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-fbc62492-0611-4f79-bdbe-1d0f42938cdf tempest-TaggedAttachmentsTest-241125395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7277c329-2093-481a-bad1-9fa8168713a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:42:59 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-fbc62492-0611-4f79-bdbe-1d0f42938cdf tempest-TaggedAttachmentsTest-241125395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7277c329-2093-481a-bad1-9fa8168713a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T17:42:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1598147134',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5e3a764-cfac-4230-aa76-026ddf2e9a5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33c0a59f8cbc4ec89659cb9f0faea2de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T17:42:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T17:42:59Z,use_quota=True,user_id='e43f4a73a40f491c838eaa5d07f40b46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:42:59 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-fbc62492-0611-4f79-bdbe-1d0f42938cdf tempest-TaggedAttachmentsTest-241125395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da2f8aff-bd58-4d29-9661-b64e37e53227) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:42:59 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-fbc62492-0611-4f79-bdbe-1d0f42938cdf tempest-TaggedAttachmentsTest-241125395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da2f8aff-bd58-4d29-9661-b64e37e53227) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:42:59 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-fbc62492-0611-4f79-bdbe-1d0f42938cdf tempest-TaggedAttachmentsTest-241125395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fc447dd-a5f3-47a2-90ac-feee38926aed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:42:59 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-fbc62492-0611-4f79-bdbe-1d0f42938cdf tempest-TaggedAttachmentsTest-241125395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fc447dd-a5f3-47a2-90ac-feee38926aed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd5e3a764-cfac-4230-aa76-026ddf2e9a5f', 'volume_name': 'volume-d5e3a764-cfac-4230-aa76-026ddf2e9a5f', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:42:59 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-fbc62492-0611-4f79-bdbe-1d0f42938cdf tempest-TaggedAttachmentsTest-241125395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fdf21c0-a2d1-4fc2-a73b-9c467199537b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:42:59 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-fbc62492-0611-4f79-bdbe-1d0f42938cdf tempest-TaggedAttachmentsTest-241125395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fdf21c0-a2d1-4fc2-a73b-9c467199537b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:42:59 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-fbc62492-0611-4f79-bdbe-1d0f42938cdf tempest-TaggedAttachmentsTest-241125395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dab6ca03-86b0-40e1-82a1-aea8ac34861b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:42:59 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-fbc62492-0611-4f79-bdbe-1d0f42938cdf tempest-TaggedAttachmentsTest-241125395 None] Volume d5e3a764-cfac-4230-aa76-026ddf2e9a5f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d5e3a764-cfac-4230-aa76-026ddf2e9a5f', 'volume_size': 1}
Jul 02 19:42:59 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-fbc62492-0611-4f79-bdbe-1d0f42938cdf tempest-TaggedAttachmentsTest-241125395 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:42:59 devstack sudo[88608]: pam_unix(sudo:session): session closed for user root
Jul 02 19:42:59 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-0bf0c6d4-053e-4eed-bb36-7fd6973e31d8 tempest-ServersNegativeTestJSON-484426248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-48e157dd-e0b7-4b12-9ef2-e2fa726edb8b 1073741824" returned: 0 in 1.825s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:42:59 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-0bf0c6d4-053e-4eed-bb36-7fd6973e31d8 tempest-ServersNegativeTestJSON-484426248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-48e157dd-e0b7-4b12-9ef2-e2fa726edb8b {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:42:59 devstack sudo[88616]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-48e157dd-e0b7-4b12-9ef2-e2fa726edb8b
Jul 02 19:42:59 devstack sudo[88616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:43:00 devstack sudo[88616]: pam_unix(sudo:session): session closed for user root
Jul 02 19:43:00 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-0bf0c6d4-053e-4eed-bb36-7fd6973e31d8 tempest-ServersNegativeTestJSON-484426248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-48e157dd-e0b7-4b12-9ef2-e2fa726edb8b" returned: 0 in 0.984s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:43:00 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-0bf0c6d4-053e-4eed-bb36-7fd6973e31d8 tempest-ServersNegativeTestJSON-484426248 None] <== create_volume: return (2873ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'} {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 19:43:00 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-0bf0c6d4-053e-4eed-bb36-7fd6973e31d8 tempest-ServersNegativeTestJSON-484426248 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.878s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:43:00 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-fbc62492-0611-4f79-bdbe-1d0f42938cdf tempest-TaggedAttachmentsTest-241125395 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.347s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:43:00 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-fbc62492-0611-4f79-bdbe-1d0f42938cdf tempest-TaggedAttachmentsTest-241125395 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce906cb830>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T17:42:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1598147134',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5e3a764-cfac-4230-aa76-026ddf2e9a5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33c0a59f8cbc4ec89659cb9f0faea2de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T17:42:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T17:42:59Z,use_quota=True,user_id='e43f4a73a40f491c838eaa5d07f40b46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)}" {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 19:43:00 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-fbc62492-0611-4f79-bdbe-1d0f42938cdf tempest-TaggedAttachmentsTest-241125395 None] Creating volume d5e3a764-cfac-4230-aa76-026ddf2e9a5f {{(pid=86639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 19:43:00 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-fbc62492-0611-4f79-bdbe-1d0f42938cdf tempest-TaggedAttachmentsTest-241125395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:43:00 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-fbc62492-0611-4f79-bdbe-1d0f42938cdf tempest-TaggedAttachmentsTest-241125395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:43:00 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-fbc62492-0611-4f79-bdbe-1d0f42938cdf tempest-TaggedAttachmentsTest-241125395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 19:43:00 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-fbc62492-0611-4f79-bdbe-1d0f42938cdf tempest-TaggedAttachmentsTest-241125395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 19:43:00 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-fbc62492-0611-4f79-bdbe-1d0f42938cdf tempest-TaggedAttachmentsTest-241125395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:43:00 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-fbc62492-0611-4f79-bdbe-1d0f42938cdf tempest-TaggedAttachmentsTest-241125395 None] Selected osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92 as target Quobyte volume. {{(pid=86639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 19:43:00 devstack cinder-volume[86639]: INFO cinder.volume.drivers.remotefs [None req-fbc62492-0611-4f79-bdbe-1d0f42938cdf tempest-TaggedAttachmentsTest-241125395 None] casted to osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92
Jul 02 19:43:00 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-fbc62492-0611-4f79-bdbe-1d0f42938cdf tempest-TaggedAttachmentsTest-241125395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-d5e3a764-cfac-4230-aa76-026ddf2e9a5f 1073741824 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:43:00 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-0bf0c6d4-053e-4eed-bb36-7fd6973e31d8 tempest-ServersNegativeTestJSON-484426248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (943b6894-fedc-428f-8fc2-2e679ce5b10e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48e157dd-e0b7-4b12-9ef2-e2fa726edb8b', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:43:00 devstack sudo[88620]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-d5e3a764-cfac-4230-aa76-026ddf2e9a5f 1073741824
Jul 02 19:43:00 devstack sudo[88620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:43:00 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-0bf0c6d4-053e-4eed-bb36-7fd6973e31d8 tempest-ServersNegativeTestJSON-484426248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1159812f-5f00-401c-a877-11571d55ae43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:43:00 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-0bf0c6d4-053e-4eed-bb36-7fd6973e31d8 tempest-ServersNegativeTestJSON-484426248 None] Volume volume-48e157dd-e0b7-4b12-9ef2-e2fa726edb8b (48e157dd-e0b7-4b12-9ef2-e2fa726edb8b): created successfully
Jul 02 19:43:00 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-0bf0c6d4-053e-4eed-bb36-7fd6973e31d8 tempest-ServersNegativeTestJSON-484426248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1159812f-5f00-401c-a877-11571d55ae43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:43:00 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-0bf0c6d4-053e-4eed-bb36-7fd6973e31d8 tempest-ServersNegativeTestJSON-484426248 None] Flow 'volume_create_manager' (c9ea21df-cc8f-483a-9a0d-541babdefc71) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 19:43:00 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-0bf0c6d4-053e-4eed-bb36-7fd6973e31d8 tempest-ServersNegativeTestJSON-484426248 None] Created volume successfully.
Jul 02 19:43:01 devstack sudo[88620]: pam_unix(sudo:session): session closed for user root
Jul 02 19:43:01 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-fbc62492-0611-4f79-bdbe-1d0f42938cdf tempest-TaggedAttachmentsTest-241125395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-d5e3a764-cfac-4230-aa76-026ddf2e9a5f 1073741824" returned: 0 in 1.299s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:43:01 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-fbc62492-0611-4f79-bdbe-1d0f42938cdf tempest-TaggedAttachmentsTest-241125395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-d5e3a764-cfac-4230-aa76-026ddf2e9a5f {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:43:01 devstack sudo[88628]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-d5e3a764-cfac-4230-aa76-026ddf2e9a5f
Jul 02 19:43:01 devstack sudo[88628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:43:02 devstack sudo[88628]: pam_unix(sudo:session): session closed for user root
Jul 02 19:43:02 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-fbc62492-0611-4f79-bdbe-1d0f42938cdf tempest-TaggedAttachmentsTest-241125395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-d5e3a764-cfac-4230-aa76-026ddf2e9a5f" returned: 0 in 0.963s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:43:02 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-fbc62492-0611-4f79-bdbe-1d0f42938cdf tempest-TaggedAttachmentsTest-241125395 None] <== create_volume: return (2343ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'} {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 19:43:02 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-fbc62492-0611-4f79-bdbe-1d0f42938cdf tempest-TaggedAttachmentsTest-241125395 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.348s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:43:02 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-fbc62492-0611-4f79-bdbe-1d0f42938cdf tempest-TaggedAttachmentsTest-241125395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dab6ca03-86b0-40e1-82a1-aea8ac34861b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d5e3a764-cfac-4230-aa76-026ddf2e9a5f', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:43:02 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-fbc62492-0611-4f79-bdbe-1d0f42938cdf tempest-TaggedAttachmentsTest-241125395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d5ffe6a-f54c-4728-8674-cf8130afa222) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:43:03 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-fbc62492-0611-4f79-bdbe-1d0f42938cdf tempest-TaggedAttachmentsTest-241125395 None] Volume volume-d5e3a764-cfac-4230-aa76-026ddf2e9a5f (d5e3a764-cfac-4230-aa76-026ddf2e9a5f): created successfully
Jul 02 19:43:03 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-fbc62492-0611-4f79-bdbe-1d0f42938cdf tempest-TaggedAttachmentsTest-241125395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d5ffe6a-f54c-4728-8674-cf8130afa222) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:43:03 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-fbc62492-0611-4f79-bdbe-1d0f42938cdf tempest-TaggedAttachmentsTest-241125395 None] Flow 'volume_create_manager' (4d26106c-c45d-4888-a497-d3d51d102c8e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 19:43:03 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-fbc62492-0611-4f79-bdbe-1d0f42938cdf tempest-TaggedAttachmentsTest-241125395 None] Created volume successfully.
Jul 02 19:43:04 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-c6d56261-b6d0-40a4-8506-611655a69f47 tempest-ServersNegativeTestJSON-484426248 None] Acquiring lock "cinder-48e157dd-e0b7-4b12-9ef2-e2fa726edb8b-delete_volume" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:43:04 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-c6d56261-b6d0-40a4-8506-611655a69f47 tempest-ServersNegativeTestJSON-484426248 None] Lock "cinder-48e157dd-e0b7-4b12-9ef2-e2fa726edb8b-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:43:04 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-c6d56261-b6d0-40a4-8506-611655a69f47 tempest-ServersNegativeTestJSON-484426248 None] Acquiring lock "cinder-quobyte-48e157dd-e0b7-4b12-9ef2-e2fa726edb8b" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:43:04 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-c6d56261-b6d0-40a4-8506-611655a69f47 tempest-ServersNegativeTestJSON-484426248 None] Lock "cinder-quobyte-48e157dd-e0b7-4b12-9ef2-e2fa726edb8b" acquired by "delete_volume" :: waited 0.017s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:43:04 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[08550deb-803e-46bf-bc82-381abc4b38b2]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 19:43:04 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-c6d56261-b6d0-40a4-8506-611655a69f47 tempest-ServersNegativeTestJSON-484426248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-48e157dd-e0b7-4b12-9ef2-e2fa726edb8b {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:43:04 devstack sudo[88633]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-48e157dd-e0b7-4b12-9ef2-e2fa726edb8b
Jul 02 19:43:04 devstack sudo[88633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:43:05 devstack sudo[88633]: pam_unix(sudo:session): session closed for user root
Jul 02 19:43:05 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-c6d56261-b6d0-40a4-8506-611655a69f47 tempest-ServersNegativeTestJSON-484426248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-48e157dd-e0b7-4b12-9ef2-e2fa726edb8b" returned: 0 in 1.140s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:43:05 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-c6d56261-b6d0-40a4-8506-611655a69f47 tempest-ServersNegativeTestJSON-484426248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-48e157dd-e0b7-4b12-9ef2-e2fa726edb8b {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:43:05 devstack sudo[88639]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-48e157dd-e0b7-4b12-9ef2-e2fa726edb8b
Jul 02 19:43:05 devstack sudo[88639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:43:06 devstack sudo[88639]: pam_unix(sudo:session): session closed for user root
Jul 02 19:43:06 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-c6d56261-b6d0-40a4-8506-611655a69f47 tempest-ServersNegativeTestJSON-484426248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-48e157dd-e0b7-4b12-9ef2-e2fa726edb8b" returned: 0 in 1.106s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:43:06 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-c6d56261-b6d0-40a4-8506-611655a69f47 tempest-ServersNegativeTestJSON-484426248 None] Lock "cinder-quobyte-48e157dd-e0b7-4b12-9ef2-e2fa726edb8b" released by "delete_volume" :: held 2.328s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:43:07 devstack cinder-volume[86639]: DEBUG cinder.quota [None req-c6d56261-b6d0-40a4-8506-611655a69f47 tempest-ServersNegativeTestJSON-484426248 None] Created reservations ['1fb5817e-3234-459d-81b2-450b6358b5fc', 'e7c98729-cee9-48ad-967e-accbe5de90fd', 'bdf48f50-6e50-4877-bf4a-9a67bedd25e3', '9e842d9b-511f-4267-a04b-c8daa48b4b7c'] {{(pid=86639) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 19:43:07 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-c6d56261-b6d0-40a4-8506-611655a69f47 tempest-ServersNegativeTestJSON-484426248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:43:07 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-c6d56261-b6d0-40a4-8506-611655a69f47 tempest-ServersNegativeTestJSON-484426248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:43:07 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-c6d56261-b6d0-40a4-8506-611655a69f47 tempest-ServersNegativeTestJSON-484426248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 19:43:07 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-c6d56261-b6d0-40a4-8506-611655a69f47 tempest-ServersNegativeTestJSON-484426248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 19:43:07 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-c6d56261-b6d0-40a4-8506-611655a69f47 tempest-ServersNegativeTestJSON-484426248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:43:07 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-c6d56261-b6d0-40a4-8506-611655a69f47 tempest-ServersNegativeTestJSON-484426248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:43:07 devstack sudo[88643]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e
Jul 02 19:43:07 devstack sudo[88643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:43:08 devstack sudo[88643]: pam_unix(sudo:session): session closed for user root
Jul 02 19:43:08 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-2b680f14-549a-4dc4-a8d3-1cea99da9910 tempest-ServersNegativeTestJSON-484426248 None] Acquiring lock "cinder-f5d0738e-fb51-4a48-a732-0b7a3bb97622-delete_volume" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:43:08 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-c6d56261-b6d0-40a4-8506-611655a69f47 tempest-ServersNegativeTestJSON-484426248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e" returned: 0 in 0.989s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:43:08 devstack cinder-volume[86639]: DEBUG cinder.manager [None req-c6d56261-b6d0-40a4-8506-611655a69f47 tempest-ServersNegativeTestJSON-484426248 None] Notifying Schedulers of capabilities ... {{(pid=86639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 19:43:08 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-c6d56261-b6d0-40a4-8506-611655a69f47 tempest-ServersNegativeTestJSON-484426248 None] Deleted volume successfully.
Jul 02 19:43:08 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-2b680f14-549a-4dc4-a8d3-1cea99da9910 tempest-ServersNegativeTestJSON-484426248 None] Lock "cinder-f5d0738e-fb51-4a48-a732-0b7a3bb97622-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:43:08 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-c6d56261-b6d0-40a4-8506-611655a69f47 tempest-ServersNegativeTestJSON-484426248 None] Lock "cinder-48e157dd-e0b7-4b12-9ef2-e2fa726edb8b-delete_volume" released by "delete_volume" :: held 3.685s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:43:08 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-2b680f14-549a-4dc4-a8d3-1cea99da9910 tempest-ServersNegativeTestJSON-484426248 None] Acquiring lock "cinder-quobyte-f5d0738e-fb51-4a48-a732-0b7a3bb97622" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:43:08 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-2b680f14-549a-4dc4-a8d3-1cea99da9910 tempest-ServersNegativeTestJSON-484426248 None] Lock "cinder-quobyte-f5d0738e-fb51-4a48-a732-0b7a3bb97622" acquired by "delete_volume" :: waited 0.022s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:43:08 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[890ba348-1cf9-4a59-a6d9-9055ed9286f3]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 19:43:08 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-2b680f14-549a-4dc4-a8d3-1cea99da9910 tempest-ServersNegativeTestJSON-484426248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-f5d0738e-fb51-4a48-a732-0b7a3bb97622 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:43:08 devstack sudo[88646]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-f5d0738e-fb51-4a48-a732-0b7a3bb97622
Jul 02 19:43:08 devstack sudo[88646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:43:09 devstack sudo[88646]: pam_unix(sudo:session): session closed for user root
Jul 02 19:43:09 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-2b680f14-549a-4dc4-a8d3-1cea99da9910 tempest-ServersNegativeTestJSON-484426248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-f5d0738e-fb51-4a48-a732-0b7a3bb97622" returned: 0 in 1.185s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:43:09 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-2b680f14-549a-4dc4-a8d3-1cea99da9910 tempest-ServersNegativeTestJSON-484426248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-f5d0738e-fb51-4a48-a732-0b7a3bb97622 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:43:09 devstack sudo[88652]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-f5d0738e-fb51-4a48-a732-0b7a3bb97622
Jul 02 19:43:09 devstack sudo[88652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:43:10 devstack sudo[88652]: pam_unix(sudo:session): session closed for user root
Jul 02 19:43:10 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-2b680f14-549a-4dc4-a8d3-1cea99da9910 tempest-ServersNegativeTestJSON-484426248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-f5d0738e-fb51-4a48-a732-0b7a3bb97622" returned: 0 in 1.209s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:43:10 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-2b680f14-549a-4dc4-a8d3-1cea99da9910 tempest-ServersNegativeTestJSON-484426248 None] Lock "cinder-quobyte-f5d0738e-fb51-4a48-a732-0b7a3bb97622" released by "delete_volume" :: held 2.461s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:43:10 devstack cinder-volume[86639]: DEBUG cinder.quota [None req-2b680f14-549a-4dc4-a8d3-1cea99da9910 tempest-ServersNegativeTestJSON-484426248 None] Created reservations ['35de76e5-cca3-4b78-8401-f0ab7666b4bf', '0cfba55b-7fb7-470b-a174-f054b34ffb6b', '6a487af2-c415-4932-9700-1e48742c8f96', '963e6b00-52b7-4223-8d48-d079a133411f'] {{(pid=86639) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 19:43:10 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-2b680f14-549a-4dc4-a8d3-1cea99da9910 tempest-ServersNegativeTestJSON-484426248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:43:10 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-2b680f14-549a-4dc4-a8d3-1cea99da9910 tempest-ServersNegativeTestJSON-484426248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:43:10 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-2b680f14-549a-4dc4-a8d3-1cea99da9910 tempest-ServersNegativeTestJSON-484426248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 19:43:10 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-2b680f14-549a-4dc4-a8d3-1cea99da9910 tempest-ServersNegativeTestJSON-484426248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 19:43:10 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-2b680f14-549a-4dc4-a8d3-1cea99da9910 tempest-ServersNegativeTestJSON-484426248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:43:10 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-2b680f14-549a-4dc4-a8d3-1cea99da9910 tempest-ServersNegativeTestJSON-484426248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:43:11 devstack sudo[88659]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e
Jul 02 19:43:11 devstack sudo[88659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:43:12 devstack sudo[88659]: pam_unix(sudo:session): session closed for user root
Jul 02 19:43:12 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-2b680f14-549a-4dc4-a8d3-1cea99da9910 tempest-ServersNegativeTestJSON-484426248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e" returned: 0 in 1.122s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:43:12 devstack cinder-volume[86639]: DEBUG cinder.manager [None req-2b680f14-549a-4dc4-a8d3-1cea99da9910 tempest-ServersNegativeTestJSON-484426248 None] Notifying Schedulers of capabilities ... {{(pid=86639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 19:43:12 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-2b680f14-549a-4dc4-a8d3-1cea99da9910 tempest-ServersNegativeTestJSON-484426248 None] Deleted volume successfully.
Jul 02 19:43:12 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-2b680f14-549a-4dc4-a8d3-1cea99da9910 tempest-ServersNegativeTestJSON-484426248 None] Lock "cinder-f5d0738e-fb51-4a48-a732-0b7a3bb97622-delete_volume" released by "delete_volume" :: held 3.938s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:43:20 devstack cinder-volume[86639]: DEBUG dbcounter [-] [86639] Writing DB stats cinder:SELECT=35,cinder:UPDATE=47,cinder:INSERT=10,cinder:DELETE=2 {{(pid=86639) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 02 19:43:22 devstack cinder-volume[86639]: DEBUG dbcounter [-] [86639] Writing DB stats cinder:UPDATE=45,cinder:SELECT=35,cinder:INSERT=10,cinder:DELETE=6 {{(pid=86639) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 02 19:43:41 devstack cinder-volume[86639]: DEBUG oslo_service.periodic_task [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86639) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 02 19:43:41 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:43:41 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:43:41 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 19:43:41 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 19:43:41 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:43:41 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:43:41 devstack sudo[88866]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e
Jul 02 19:43:41 devstack sudo[88866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:43:42 devstack sudo[88866]: pam_unix(sudo:session): session closed for user root
Jul 02 19:43:42 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e" returned: 0 in 0.999s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:43:42 devstack cinder-volume[86639]: DEBUG cinder.manager [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] Notifying Schedulers of capabilities ... {{(pid=86639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 19:43:42 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-e61fa775-7304-4671-a188-1c91a7ed97d8 tempest-GroupSnapshotsTest-1838694738 None] Group tempest-GroupSnapshotsTest-Group-1606027930: creating
Jul 02 19:43:42 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-e61fa775-7304-4671-a188-1c91a7ed97d8 tempest-GroupSnapshotsTest-1838694738 None] Group tempest-GroupSnapshotsTest-Group-1606027930: created successfully
Jul 02 19:43:42 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-e61fa775-7304-4671-a188-1c91a7ed97d8 tempest-GroupSnapshotsTest-1838694738 None] Create group completed successfully.
Jul 02 19:43:45 devstack cinder-volume[86639]: DEBUG cinder.volume.flows.manager.create_volume [None req-84809b01-ea19-4992-b494-845486809bc4 tempest-GroupSnapshotsTest-1838694738 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 19:43:45 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-84809b01-ea19-4992-b494-845486809bc4 tempest-GroupSnapshotsTest-1838694738 None] Flow 'volume_create_manager' (1015afa6-f69b-4a72-85c4-dcba85877a8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 19:43:45 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-84809b01-ea19-4992-b494-845486809bc4 tempest-GroupSnapshotsTest-1838694738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b58f6bdd-9d62-4586-9feb-68a9326695f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:43:45 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-84809b01-ea19-4992-b494-845486809bc4 tempest-GroupSnapshotsTest-1838694738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b58f6bdd-9d62-4586-9feb-68a9326695f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T17:43:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-600419258',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=15c619e7-f87b-45b4-8405-b6e3ea7e2f5d,host='devstack@QuobyteHD#QuobyteHD',id=23b3d0ce-23d9-45b6-a6f8-074ae81802a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccce40c931504b29be89afa73433e0c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T17:43:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T17:43:45Z,use_quota=True,user_id='cd296cf1e98f4d7da1f681631ac1253d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8a62b6f-0306-4c29-95aa-264bc1f5034b),volume_type_id=b8a62b6f-0306-4c29-95aa-264bc1f5034b)' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:43:45 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-84809b01-ea19-4992-b494-845486809bc4 tempest-GroupSnapshotsTest-1838694738 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86055f9b-5c3c-4df7-88e6-eb152ce1b219) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:43:45 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-84809b01-ea19-4992-b494-845486809bc4 tempest-GroupSnapshotsTest-1838694738 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86055f9b-5c3c-4df7-88e6-eb152ce1b219) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:43:45 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-84809b01-ea19-4992-b494-845486809bc4 tempest-GroupSnapshotsTest-1838694738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f647dfa0-03ca-4d61-b146-9e5c77eedf5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:43:45 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-84809b01-ea19-4992-b494-845486809bc4 tempest-GroupSnapshotsTest-1838694738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f647dfa0-03ca-4d61-b146-9e5c77eedf5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '23b3d0ce-23d9-45b6-a6f8-074ae81802a0', 'volume_name': 'volume-23b3d0ce-23d9-45b6-a6f8-074ae81802a0', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:43:45 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-84809b01-ea19-4992-b494-845486809bc4 tempest-GroupSnapshotsTest-1838694738 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c59ba2f0-2976-48a7-90c5-6cb4c29072e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:43:45 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-84809b01-ea19-4992-b494-845486809bc4 tempest-GroupSnapshotsTest-1838694738 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c59ba2f0-2976-48a7-90c5-6cb4c29072e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:43:45 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-84809b01-ea19-4992-b494-845486809bc4 tempest-GroupSnapshotsTest-1838694738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db4d490f-2aa6-4638-96bf-1bb5b0f34ec5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:43:45 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-84809b01-ea19-4992-b494-845486809bc4 tempest-GroupSnapshotsTest-1838694738 None] Volume 23b3d0ce-23d9-45b6-a6f8-074ae81802a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-23b3d0ce-23d9-45b6-a6f8-074ae81802a0', 'volume_size': 1}
Jul 02 19:43:45 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-84809b01-ea19-4992-b494-845486809bc4 tempest-GroupSnapshotsTest-1838694738 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:43:45 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-84809b01-ea19-4992-b494-845486809bc4 tempest-GroupSnapshotsTest-1838694738 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:43:45 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-84809b01-ea19-4992-b494-845486809bc4 tempest-GroupSnapshotsTest-1838694738 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce906cb830>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=15c619e7-f87b-45b4-8405-b6e3ea7e2f5d,created_at=2026-07-02T17:43:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-600419258',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=15c619e7-f87b-45b4-8405-b6e3ea7e2f5d,host='devstack@QuobyteHD#QuobyteHD',id=23b3d0ce-23d9-45b6-a6f8-074ae81802a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccce40c931504b29be89afa73433e0c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T17:43:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T17:43:45Z,use_quota=True,user_id='cd296cf1e98f4d7da1f681631ac1253d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8a62b6f-0306-4c29-95aa-264bc1f5034b),volume_type_id=b8a62b6f-0306-4c29-95aa-264bc1f5034b)}" {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 19:43:45 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-84809b01-ea19-4992-b494-845486809bc4 tempest-GroupSnapshotsTest-1838694738 None] Creating volume 23b3d0ce-23d9-45b6-a6f8-074ae81802a0 {{(pid=86639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 19:43:45 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-84809b01-ea19-4992-b494-845486809bc4 tempest-GroupSnapshotsTest-1838694738 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:43:45 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-84809b01-ea19-4992-b494-845486809bc4 tempest-GroupSnapshotsTest-1838694738 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:43:45 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-84809b01-ea19-4992-b494-845486809bc4 tempest-GroupSnapshotsTest-1838694738 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 19:43:45 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-84809b01-ea19-4992-b494-845486809bc4 tempest-GroupSnapshotsTest-1838694738 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 19:43:45 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-84809b01-ea19-4992-b494-845486809bc4 tempest-GroupSnapshotsTest-1838694738 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:43:45 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-84809b01-ea19-4992-b494-845486809bc4 tempest-GroupSnapshotsTest-1838694738 None] Selected osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92 as target Quobyte volume. {{(pid=86639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 19:43:45 devstack cinder-volume[86639]: INFO cinder.volume.drivers.remotefs [None req-84809b01-ea19-4992-b494-845486809bc4 tempest-GroupSnapshotsTest-1838694738 None] casted to osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92
Jul 02 19:43:45 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-84809b01-ea19-4992-b494-845486809bc4 tempest-GroupSnapshotsTest-1838694738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-23b3d0ce-23d9-45b6-a6f8-074ae81802a0 1073741824 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:43:45 devstack sudo[88886]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-23b3d0ce-23d9-45b6-a6f8-074ae81802a0 1073741824
Jul 02 19:43:45 devstack sudo[88886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:43:46 devstack sudo[88886]: pam_unix(sudo:session): session closed for user root
Jul 02 19:43:46 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-84809b01-ea19-4992-b494-845486809bc4 tempest-GroupSnapshotsTest-1838694738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-23b3d0ce-23d9-45b6-a6f8-074ae81802a0 1073741824" returned: 0 in 1.402s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:43:46 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-84809b01-ea19-4992-b494-845486809bc4 tempest-GroupSnapshotsTest-1838694738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-23b3d0ce-23d9-45b6-a6f8-074ae81802a0 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:43:46 devstack sudo[88892]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-23b3d0ce-23d9-45b6-a6f8-074ae81802a0
Jul 02 19:43:46 devstack sudo[88892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:43:47 devstack sudo[88892]: pam_unix(sudo:session): session closed for user root
Jul 02 19:43:47 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-84809b01-ea19-4992-b494-845486809bc4 tempest-GroupSnapshotsTest-1838694738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-23b3d0ce-23d9-45b6-a6f8-074ae81802a0" returned: 0 in 1.161s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:43:47 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-84809b01-ea19-4992-b494-845486809bc4 tempest-GroupSnapshotsTest-1838694738 None] <== create_volume: return (2645ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'} {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 19:43:47 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-84809b01-ea19-4992-b494-845486809bc4 tempest-GroupSnapshotsTest-1838694738 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.650s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:43:47 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-84809b01-ea19-4992-b494-845486809bc4 tempest-GroupSnapshotsTest-1838694738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db4d490f-2aa6-4638-96bf-1bb5b0f34ec5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23b3d0ce-23d9-45b6-a6f8-074ae81802a0', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:43:47 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-84809b01-ea19-4992-b494-845486809bc4 tempest-GroupSnapshotsTest-1838694738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5654aa37-e5be-432d-80a5-591cb923db5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:43:47 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-84809b01-ea19-4992-b494-845486809bc4 tempest-GroupSnapshotsTest-1838694738 None] Volume volume-23b3d0ce-23d9-45b6-a6f8-074ae81802a0 (23b3d0ce-23d9-45b6-a6f8-074ae81802a0): created successfully
Jul 02 19:43:47 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-84809b01-ea19-4992-b494-845486809bc4 tempest-GroupSnapshotsTest-1838694738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5654aa37-e5be-432d-80a5-591cb923db5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:43:47 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-84809b01-ea19-4992-b494-845486809bc4 tempest-GroupSnapshotsTest-1838694738 None] Flow 'volume_create_manager' (1015afa6-f69b-4a72-85c4-dcba85877a8c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 19:43:47 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-84809b01-ea19-4992-b494-845486809bc4 tempest-GroupSnapshotsTest-1838694738 None] Created volume successfully.
Jul 02 19:43:49 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-49438f2d-f03f-4092-97a9-03fbdfe91a6b tempest-GroupSnapshotsTest-1838694738 None] GroupSnapshot 32b87c55-7f44-46e7-a5c3-1ffba4e1dacd: creating.
Jul 02 19:43:49 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-49438f2d-f03f-4092-97a9-03fbdfe91a6b tempest-GroupSnapshotsTest-1838694738 None] Group snapshot 32b87c55-7f44-46e7-a5c3-1ffba4e1dacd: creating. {{(pid=86639) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Jul 02 19:43:49 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-49438f2d-f03f-4092-97a9-03fbdfe91a6b tempest-GroupSnapshotsTest-1838694738 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:43:49 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-49438f2d-f03f-4092-97a9-03fbdfe91a6b tempest-GroupSnapshotsTest-1838694738 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:43:49 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-49438f2d-f03f-4092-97a9-03fbdfe91a6b tempest-GroupSnapshotsTest-1838694738 None] Creating offline snapshot f1741df1-3f31-4039-9176-36601c096ac2 of volume 23b3d0ce-23d9-45b6-a6f8-074ae81802a0 {{(pid=86639) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 02 19:43:49 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[66b98e12-54a6-4d30-8608-198b223f2e4d]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 19:43:49 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-49438f2d-f03f-4092-97a9-03fbdfe91a6b tempest-GroupSnapshotsTest-1838694738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-23b3d0ce-23d9-45b6-a6f8-074ae81802a0 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:43:49 devstack sudo[88909]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-23b3d0ce-23d9-45b6-a6f8-074ae81802a0
Jul 02 19:43:49 devstack sudo[88909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:43:50 devstack sudo[88909]: pam_unix(sudo:session): session closed for user root
Jul 02 19:43:50 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-49438f2d-f03f-4092-97a9-03fbdfe91a6b tempest-GroupSnapshotsTest-1838694738 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-23b3d0ce-23d9-45b6-a6f8-074ae81802a0" returned: 0 in 1.206s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:43:50 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-49438f2d-f03f-4092-97a9-03fbdfe91a6b tempest-GroupSnapshotsTest-1838694738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-23b3d0ce-23d9-45b6-a6f8-074ae81802a0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-23b3d0ce-23d9-45b6-a6f8-074ae81802a0.f1741df1-3f31-4039-9176-36601c096ac2 1G {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:43:51 devstack sudo[88915]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-23b3d0ce-23d9-45b6-a6f8-074ae81802a0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-23b3d0ce-23d9-45b6-a6f8-074ae81802a0.f1741df1-3f31-4039-9176-36601c096ac2 1G
Jul 02 19:43:51 devstack sudo[88915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:43:53 devstack sudo[88915]: pam_unix(sudo:session): session closed for user root
Jul 02 19:43:53 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-49438f2d-f03f-4092-97a9-03fbdfe91a6b tempest-GroupSnapshotsTest-1838694738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-23b3d0ce-23d9-45b6-a6f8-074ae81802a0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-23b3d0ce-23d9-45b6-a6f8-074ae81802a0.f1741df1-3f31-4039-9176-36601c096ac2 1G" returned: 0 in 2.511s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:43:53 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-49438f2d-f03f-4092-97a9-03fbdfe91a6b tempest-GroupSnapshotsTest-1838694738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-23b3d0ce-23d9-45b6-a6f8-074ae81802a0 -F qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-23b3d0ce-23d9-45b6-a6f8-074ae81802a0.f1741df1-3f31-4039-9176-36601c096ac2 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:43:53 devstack sudo[89020]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-23b3d0ce-23d9-45b6-a6f8-074ae81802a0 -F qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-23b3d0ce-23d9-45b6-a6f8-074ae81802a0.f1741df1-3f31-4039-9176-36601c096ac2
Jul 02 19:43:53 devstack sudo[89020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:43:54 devstack sudo[89020]: pam_unix(sudo:session): session closed for user root
Jul 02 19:43:54 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-49438f2d-f03f-4092-97a9-03fbdfe91a6b tempest-GroupSnapshotsTest-1838694738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-23b3d0ce-23d9-45b6-a6f8-074ae81802a0 -F qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-23b3d0ce-23d9-45b6-a6f8-074ae81802a0.f1741df1-3f31-4039-9176-36601c096ac2" returned: 0 in 1.208s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:43:54 devstack cinder-volume[86639]: WARNING cinder.volume.drivers.remotefs [None req-49438f2d-f03f-4092-97a9-03fbdfe91a6b tempest-GroupSnapshotsTest-1838694738 None] /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-23b3d0ce-23d9-45b6-a6f8-074ae81802a0.f1741df1-3f31-4039-9176-36601c096ac2 is being set with open permissions: ugo+rw: NotImplementedError
Jul 02 19:43:54 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-49438f2d-f03f-4092-97a9-03fbdfe91a6b tempest-GroupSnapshotsTest-1838694738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-23b3d0ce-23d9-45b6-a6f8-074ae81802a0.f1741df1-3f31-4039-9176-36601c096ac2 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:43:54 devstack sudo[89030]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-23b3d0ce-23d9-45b6-a6f8-074ae81802a0.f1741df1-3f31-4039-9176-36601c096ac2
Jul 02 19:43:54 devstack sudo[89030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:43:56 devstack sudo[89030]: pam_unix(sudo:session): session closed for user root
Jul 02 19:43:56 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-49438f2d-f03f-4092-97a9-03fbdfe91a6b tempest-GroupSnapshotsTest-1838694738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-23b3d0ce-23d9-45b6-a6f8-074ae81802a0.f1741df1-3f31-4039-9176-36601c096ac2" returned: 0 in 1.699s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:43:56 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-49438f2d-f03f-4092-97a9-03fbdfe91a6b tempest-GroupSnapshotsTest-1838694738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-23b3d0ce-23d9-45b6-a6f8-074ae81802a0.info {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:43:56 devstack sudo[89053]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-23b3d0ce-23d9-45b6-a6f8-074ae81802a0.info
Jul 02 19:43:56 devstack sudo[89053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:43:57 devstack sudo[89053]: pam_unix(sudo:session): session closed for user root
Jul 02 19:43:57 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-49438f2d-f03f-4092-97a9-03fbdfe91a6b tempest-GroupSnapshotsTest-1838694738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-23b3d0ce-23d9-45b6-a6f8-074ae81802a0.info" returned: 0 in 1.205s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:43:57 devstack cinder-volume[86639]: WARNING cinder.volume.drivers.remotefs [None req-49438f2d-f03f-4092-97a9-03fbdfe91a6b tempest-GroupSnapshotsTest-1838694738 None] /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-23b3d0ce-23d9-45b6-a6f8-074ae81802a0.info is being set with open permissions: ugo+rw: NotImplementedError
Jul 02 19:43:57 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-49438f2d-f03f-4092-97a9-03fbdfe91a6b tempest-GroupSnapshotsTest-1838694738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-23b3d0ce-23d9-45b6-a6f8-074ae81802a0.info {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:43:57 devstack sudo[89058]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-23b3d0ce-23d9-45b6-a6f8-074ae81802a0.info
Jul 02 19:43:57 devstack sudo[89058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:43:58 devstack sudo[89058]: pam_unix(sudo:session): session closed for user root
Jul 02 19:43:58 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-49438f2d-f03f-4092-97a9-03fbdfe91a6b tempest-GroupSnapshotsTest-1838694738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-23b3d0ce-23d9-45b6-a6f8-074ae81802a0.info" returned: 0 in 0.856s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:43:58 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-49438f2d-f03f-4092-97a9-03fbdfe91a6b tempest-GroupSnapshotsTest-1838694738 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 8.858s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:43:58 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-49438f2d-f03f-4092-97a9-03fbdfe91a6b tempest-GroupSnapshotsTest-1838694738 None] group_snapshot 32b87c55-7f44-46e7-a5c3-1ffba4e1dacd: created successfully
Jul 02 19:44:01 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-71324fd5-5d85-43df-915c-dca9d1ec7828 tempest-GroupSnapshotsTest-1838694738 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:44:01 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-71324fd5-5d85-43df-915c-dca9d1ec7828 tempest-GroupSnapshotsTest-1838694738 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:44:01 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-71324fd5-5d85-43df-915c-dca9d1ec7828 tempest-GroupSnapshotsTest-1838694738 None] Acquiring lock "cinder-quobyte-f1741df1-3f31-4039-9176-36601c096ac2-129dc2bf-569e-40d8-932f-a323dbb4117c" by "_create_volume_from_snapshot" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:44:01 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-71324fd5-5d85-43df-915c-dca9d1ec7828 tempest-GroupSnapshotsTest-1838694738 None] Lock "cinder-quobyte-f1741df1-3f31-4039-9176-36601c096ac2-129dc2bf-569e-40d8-932f-a323dbb4117c" acquired by "_create_volume_from_snapshot" :: waited 0.020s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:44:01 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-71324fd5-5d85-43df-915c-dca9d1ec7828 tempest-GroupSnapshotsTest-1838694738 None] Creating volume 129dc2bf-569e-40d8-932f-a323dbb4117c from snapshot f1741df1-3f31-4039-9176-36601c096ac2 {{(pid=86639) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jul 02 19:44:01 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-71324fd5-5d85-43df-915c-dca9d1ec7828 tempest-GroupSnapshotsTest-1838694738 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:44:01 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-71324fd5-5d85-43df-915c-dca9d1ec7828 tempest-GroupSnapshotsTest-1838694738 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:44:01 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-71324fd5-5d85-43df-915c-dca9d1ec7828 tempest-GroupSnapshotsTest-1838694738 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 19:44:01 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-71324fd5-5d85-43df-915c-dca9d1ec7828 tempest-GroupSnapshotsTest-1838694738 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 19:44:01 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-71324fd5-5d85-43df-915c-dca9d1ec7828 tempest-GroupSnapshotsTest-1838694738 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:44:01 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-71324fd5-5d85-43df-915c-dca9d1ec7828 tempest-GroupSnapshotsTest-1838694738 None] Selected osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92 as target Quobyte volume. {{(pid=86639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 19:44:01 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-71324fd5-5d85-43df-915c-dca9d1ec7828 tempest-GroupSnapshotsTest-1838694738 None] Acquiring lock "cinder-quobyte-129dc2bf-569e-40d8-932f-a323dbb4117c" by "_copy_volume_from_snapshot" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:44:01 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-71324fd5-5d85-43df-915c-dca9d1ec7828 tempest-GroupSnapshotsTest-1838694738 None] Lock "cinder-quobyte-129dc2bf-569e-40d8-932f-a323dbb4117c" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:44:01 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-71324fd5-5d85-43df-915c-dca9d1ec7828 tempest-GroupSnapshotsTest-1838694738 None] snapshot: f1741df1-3f31-4039-9176-36601c096ac2, volume: 129dc2bf-569e-40d8-932f-a323dbb4117c,  {{(pid=86639) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jul 02 19:44:01 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-71324fd5-5d85-43df-915c-dca9d1ec7828 tempest-GroupSnapshotsTest-1838694738 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:44:01 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-71324fd5-5d85-43df-915c-dca9d1ec7828 tempest-GroupSnapshotsTest-1838694738 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:44:01 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-71324fd5-5d85-43df-915c-dca9d1ec7828 tempest-GroupSnapshotsTest-1838694738 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 19:44:01 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-71324fd5-5d85-43df-915c-dca9d1ec7828 tempest-GroupSnapshotsTest-1838694738 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 19:44:01 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-71324fd5-5d85-43df-915c-dca9d1ec7828 tempest-GroupSnapshotsTest-1838694738 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:44:01 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f4061dc-861e-4f32-9e52-89062a38af0d]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 19:44:01 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-71324fd5-5d85-43df-915c-dca9d1ec7828 tempest-GroupSnapshotsTest-1838694738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-23b3d0ce-23d9-45b6-a6f8-074ae81802a0.f1741df1-3f31-4039-9176-36601c096ac2 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:44:01 devstack sudo[89064]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-23b3d0ce-23d9-45b6-a6f8-074ae81802a0.f1741df1-3f31-4039-9176-36601c096ac2
Jul 02 19:44:01 devstack sudo[89064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:44:02 devstack sudo[89064]: pam_unix(sudo:session): session closed for user root
Jul 02 19:44:02 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-71324fd5-5d85-43df-915c-dca9d1ec7828 tempest-GroupSnapshotsTest-1838694738 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-23b3d0ce-23d9-45b6-a6f8-074ae81802a0.f1741df1-3f31-4039-9176-36601c096ac2" returned: 0 in 1.131s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:44:02 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-71324fd5-5d85-43df-915c-dca9d1ec7828 tempest-GroupSnapshotsTest-1838694738 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-23b3d0ce-23d9-45b6-a6f8-074ae81802a0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86639) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 02 19:44:02 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-71324fd5-5d85-43df-915c-dca9d1ec7828 tempest-GroupSnapshotsTest-1838694738 None] will copy from snapshot at /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-23b3d0ce-23d9-45b6-a6f8-074ae81802a0 {{(pid=86639) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jul 02 19:44:02 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-71324fd5-5d85-43df-915c-dca9d1ec7828 tempest-GroupSnapshotsTest-1838694738 None] Creating direct copy from snapshot {{(pid=86639) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jul 02 19:44:02 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[54e952bb-0f29-4d20-aba5-a0f5cf1f8d30]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 19:44:02 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-71324fd5-5d85-43df-915c-dca9d1ec7828 tempest-GroupSnapshotsTest-1838694738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-23b3d0ce-23d9-45b6-a6f8-074ae81802a0 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:44:02 devstack sudo[89074]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-23b3d0ce-23d9-45b6-a6f8-074ae81802a0
Jul 02 19:44:02 devstack sudo[89074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:44:03 devstack sudo[89074]: pam_unix(sudo:session): session closed for user root
Jul 02 19:44:03 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-71324fd5-5d85-43df-915c-dca9d1ec7828 tempest-GroupSnapshotsTest-1838694738 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-23b3d0ce-23d9-45b6-a6f8-074ae81802a0" returned: 0 in 1.363s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:44:03 devstack cinder-volume[86639]: DEBUG cinder.utils [None req-71324fd5-5d85-43df-915c-dca9d1ec7828 tempest-GroupSnapshotsTest-1838694738 None] Path /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-129dc2bf-569e-40d8-932f-a323dbb4117c not found in is_blk_device check {{(pid=86639) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 02 19:44:03 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-71324fd5-5d85-43df-915c-dca9d1ec7828 tempest-GroupSnapshotsTest-1838694738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-23b3d0ce-23d9-45b6-a6f8-074ae81802a0 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-129dc2bf-569e-40d8-932f-a323dbb4117c {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:44:03 devstack sudo[89131]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-23b3d0ce-23d9-45b6-a6f8-074ae81802a0 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-129dc2bf-569e-40d8-932f-a323dbb4117c
Jul 02 19:44:03 devstack sudo[89131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:44:11 devstack cinder-volume[86639]: DEBUG dbcounter [-] [86639] Writing DB stats cinder:SELECT=14,cinder:UPDATE=7 {{(pid=86639) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 02 19:44:11 devstack cinder-volume[86639]: DEBUG dbcounter [-] [86639] Writing DB stats cinder:SELECT=10,cinder:UPDATE=5,cinder:INSERT=2,cinder:DELETE=1 {{(pid=86639) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 02 19:44:12 devstack sudo[89131]: pam_unix(sudo:session): session closed for user root
Jul 02 19:44:12 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-71324fd5-5d85-43df-915c-dca9d1ec7828 tempest-GroupSnapshotsTest-1838694738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-23b3d0ce-23d9-45b6-a6f8-074ae81802a0 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-129dc2bf-569e-40d8-932f-a323dbb4117c" returned: 0 in 8.659s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:44:12 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0e93521-5741-4b07-ad8a-6bc0065ffe5b]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 19:44:12 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-71324fd5-5d85-43df-915c-dca9d1ec7828 tempest-GroupSnapshotsTest-1838694738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-23b3d0ce-23d9-45b6-a6f8-074ae81802a0 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:44:12 devstack sudo[89205]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-23b3d0ce-23d9-45b6-a6f8-074ae81802a0
Jul 02 19:44:12 devstack sudo[89205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:44:13 devstack sudo[89205]: pam_unix(sudo:session): session closed for user root
Jul 02 19:44:13 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-71324fd5-5d85-43df-915c-dca9d1ec7828 tempest-GroupSnapshotsTest-1838694738 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-23b3d0ce-23d9-45b6-a6f8-074ae81802a0" returned: 0 in 1.483s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:44:13 devstack cinder-volume[86639]: DEBUG cinder.image.image_utils [None req-71324fd5-5d85-43df-915c-dca9d1ec7828 tempest-GroupSnapshotsTest-1838694738 None] Image conversion details: src /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-23b3d0ce-23d9-45b6-a6f8-074ae81802a0, size 1024.00 MB, duration 8.66 sec, destination /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-129dc2bf-569e-40d8-932f-a323dbb4117c {{(pid=86639) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 02 19:44:13 devstack cinder-volume[86639]: INFO cinder.image.image_utils [None req-71324fd5-5d85-43df-915c-dca9d1ec7828 tempest-GroupSnapshotsTest-1838694738 None] Converted 1024.00 MB image at 118.25 MB/s
Jul 02 19:44:13 devstack cinder-volume[86639]: WARNING cinder.volume.drivers.remotefs [None req-71324fd5-5d85-43df-915c-dca9d1ec7828 tempest-GroupSnapshotsTest-1838694738 None] /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-129dc2bf-569e-40d8-932f-a323dbb4117c is being set with open permissions: ugo+rw: NotImplementedError
Jul 02 19:44:13 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-71324fd5-5d85-43df-915c-dca9d1ec7828 tempest-GroupSnapshotsTest-1838694738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-129dc2bf-569e-40d8-932f-a323dbb4117c {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:44:14 devstack sudo[89214]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-129dc2bf-569e-40d8-932f-a323dbb4117c
Jul 02 19:44:14 devstack sudo[89214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:44:15 devstack sudo[89214]: pam_unix(sudo:session): session closed for user root
Jul 02 19:44:15 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-71324fd5-5d85-43df-915c-dca9d1ec7828 tempest-GroupSnapshotsTest-1838694738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-129dc2bf-569e-40d8-932f-a323dbb4117c" returned: 0 in 1.091s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:44:15 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-71324fd5-5d85-43df-915c-dca9d1ec7828 tempest-GroupSnapshotsTest-1838694738 None] Lock "cinder-quobyte-129dc2bf-569e-40d8-932f-a323dbb4117c" released by "_copy_volume_from_snapshot" :: held 13.924s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:44:15 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-71324fd5-5d85-43df-915c-dca9d1ec7828 tempest-GroupSnapshotsTest-1838694738 None] Lock "cinder-quobyte-f1741df1-3f31-4039-9176-36601c096ac2-129dc2bf-569e-40d8-932f-a323dbb4117c" released by "_create_volume_from_snapshot" :: held 13.972s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:44:15 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-71324fd5-5d85-43df-915c-dca9d1ec7828 tempest-GroupSnapshotsTest-1838694738 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 13.994s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:44:15 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-71324fd5-5d85-43df-915c-dca9d1ec7828 tempest-GroupSnapshotsTest-1838694738 None] Create group from source-snapshot-32b87c55-7f44-46e7-a5c3-1ffba4e1dacd completed successfully.
Jul 02 19:44:16 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-c08bbdca-ae38-4320-84f0-4718ce7c180b tempest-GroupSnapshotsTest-1838694738 None] Acquiring lock "cinder-quobyte-129dc2bf-569e-40d8-932f-a323dbb4117c" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:44:16 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-c08bbdca-ae38-4320-84f0-4718ce7c180b tempest-GroupSnapshotsTest-1838694738 None] Lock "cinder-quobyte-129dc2bf-569e-40d8-932f-a323dbb4117c" acquired by "delete_volume" :: waited 0.030s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:44:16 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ebaddd6-bdef-4868-9e84-d93c9c8d6a28]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 19:44:16 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-c08bbdca-ae38-4320-84f0-4718ce7c180b tempest-GroupSnapshotsTest-1838694738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-129dc2bf-569e-40d8-932f-a323dbb4117c {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:44:16 devstack sudo[89219]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-129dc2bf-569e-40d8-932f-a323dbb4117c
Jul 02 19:44:16 devstack sudo[89219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:44:17 devstack sudo[89219]: pam_unix(sudo:session): session closed for user root
Jul 02 19:44:17 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-c08bbdca-ae38-4320-84f0-4718ce7c180b tempest-GroupSnapshotsTest-1838694738 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-129dc2bf-569e-40d8-932f-a323dbb4117c" returned: 0 in 1.092s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:44:17 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-c08bbdca-ae38-4320-84f0-4718ce7c180b tempest-GroupSnapshotsTest-1838694738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-129dc2bf-569e-40d8-932f-a323dbb4117c {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:44:17 devstack sudo[89225]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-129dc2bf-569e-40d8-932f-a323dbb4117c
Jul 02 19:44:17 devstack sudo[89225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:44:18 devstack sudo[89225]: pam_unix(sudo:session): session closed for user root
Jul 02 19:44:18 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-c08bbdca-ae38-4320-84f0-4718ce7c180b tempest-GroupSnapshotsTest-1838694738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-129dc2bf-569e-40d8-932f-a323dbb4117c" returned: 0 in 0.944s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:44:18 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-c08bbdca-ae38-4320-84f0-4718ce7c180b tempest-GroupSnapshotsTest-1838694738 None] Lock "cinder-quobyte-129dc2bf-569e-40d8-932f-a323dbb4117c" released by "delete_volume" :: held 2.182s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:44:18 devstack cinder-volume[86639]: DEBUG cinder.quota [None req-c08bbdca-ae38-4320-84f0-4718ce7c180b tempest-GroupSnapshotsTest-1838694738 None] Created reservations ['74ac5956-d3d2-420a-80e7-2e1efa30809e'] {{(pid=86639) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 19:44:18 devstack cinder-volume[86639]: WARNING cinder.quota [None req-c08bbdca-ae38-4320-84f0-4718ce7c180b tempest-GroupSnapshotsTest-1838694738 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-668847859 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-668847859, it is now deprecated. Please use the default quota class for default quota.
Jul 02 19:44:18 devstack cinder-volume[86639]: WARNING cinder.quota [None req-c08bbdca-ae38-4320-84f0-4718ce7c180b tempest-GroupSnapshotsTest-1838694738 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-668847859 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-668847859, it is now deprecated. Please use the default quota class for default quota.
Jul 02 19:44:18 devstack cinder-volume[86639]: DEBUG cinder.quota [None req-c08bbdca-ae38-4320-84f0-4718ce7c180b tempest-GroupSnapshotsTest-1838694738 None] Created reservations ['987df7e7-6b78-4379-b35f-11e2da0d2a21', '3f082769-f60d-454c-8649-08bdfaa5f51b', '90a0228c-b211-493e-b394-1626f3896e56', 'd6ec78b1-dbe2-44cd-b1ee-669e98b6eaeb'] {{(pid=86639) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 19:44:18 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-c08bbdca-ae38-4320-84f0-4718ce7c180b tempest-GroupSnapshotsTest-1838694738 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:44:18 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-c08bbdca-ae38-4320-84f0-4718ce7c180b tempest-GroupSnapshotsTest-1838694738 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:44:18 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-c08bbdca-ae38-4320-84f0-4718ce7c180b tempest-GroupSnapshotsTest-1838694738 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 19:44:18 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-c08bbdca-ae38-4320-84f0-4718ce7c180b tempest-GroupSnapshotsTest-1838694738 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 19:44:18 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-c08bbdca-ae38-4320-84f0-4718ce7c180b tempest-GroupSnapshotsTest-1838694738 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:44:18 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-c08bbdca-ae38-4320-84f0-4718ce7c180b tempest-GroupSnapshotsTest-1838694738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:44:18 devstack sudo[89262]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e
Jul 02 19:44:18 devstack sudo[89262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:44:20 devstack sudo[89262]: pam_unix(sudo:session): session closed for user root
Jul 02 19:44:20 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-c08bbdca-ae38-4320-84f0-4718ce7c180b tempest-GroupSnapshotsTest-1838694738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e" returned: 0 in 1.109s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:44:20 devstack cinder-volume[86639]: DEBUG cinder.manager [None req-c08bbdca-ae38-4320-84f0-4718ce7c180b tempest-GroupSnapshotsTest-1838694738 None] Notifying Schedulers of capabilities ... {{(pid=86639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 19:44:20 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-c08bbdca-ae38-4320-84f0-4718ce7c180b tempest-GroupSnapshotsTest-1838694738 None] Delete group completed successfully.
Jul 02 19:44:20 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-ddbacba5-d707-42e0-9915-f8d2c2bbd6fa tempest-GroupSnapshotsTest-1838694738 None] group_snapshot 32b87c55-7f44-46e7-a5c3-1ffba4e1dacd: deleting
Jul 02 19:44:20 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-ddbacba5-d707-42e0-9915-f8d2c2bbd6fa tempest-GroupSnapshotsTest-1838694738 None] group_snapshot 32b87c55-7f44-46e7-a5c3-1ffba4e1dacd: deleting {{(pid=86639) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Jul 02 19:44:20 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-ddbacba5-d707-42e0-9915-f8d2c2bbd6fa tempest-GroupSnapshotsTest-1838694738 None] Acquiring lock "cinder-quobyte-23b3d0ce-23d9-45b6-a6f8-074ae81802a0" by "delete_snapshot" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:44:20 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-ddbacba5-d707-42e0-9915-f8d2c2bbd6fa tempest-GroupSnapshotsTest-1838694738 None] Lock "cinder-quobyte-23b3d0ce-23d9-45b6-a6f8-074ae81802a0" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:44:20 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-ddbacba5-d707-42e0-9915-f8d2c2bbd6fa tempest-GroupSnapshotsTest-1838694738 None] Acquiring lock "cinder-quobyte-f1741df1-3f31-4039-9176-36601c096ac2" by "_delete_snapshot" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:44:20 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-ddbacba5-d707-42e0-9915-f8d2c2bbd6fa tempest-GroupSnapshotsTest-1838694738 None] Lock "cinder-quobyte-f1741df1-3f31-4039-9176-36601c096ac2" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:44:20 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-ddbacba5-d707-42e0-9915-f8d2c2bbd6fa tempest-GroupSnapshotsTest-1838694738 None] Deleting offline snapshot f1741df1-3f31-4039-9176-36601c096ac2 of volume 23b3d0ce-23d9-45b6-a6f8-074ae81802a0 {{(pid=86639) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 02 19:44:20 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-ddbacba5-d707-42e0-9915-f8d2c2bbd6fa tempest-GroupSnapshotsTest-1838694738 None] snapshot_file for this snap is: volume-23b3d0ce-23d9-45b6-a6f8-074ae81802a0.f1741df1-3f31-4039-9176-36601c096ac2 {{(pid=86639) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 02 19:44:20 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[7055621d-31de-4bec-8a05-7f5c76f77951]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 19:44:20 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-ddbacba5-d707-42e0-9915-f8d2c2bbd6fa tempest-GroupSnapshotsTest-1838694738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-23b3d0ce-23d9-45b6-a6f8-074ae81802a0.f1741df1-3f31-4039-9176-36601c096ac2 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:44:20 devstack sudo[89280]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-23b3d0ce-23d9-45b6-a6f8-074ae81802a0.f1741df1-3f31-4039-9176-36601c096ac2
Jul 02 19:44:20 devstack sudo[89280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:44:21 devstack cinder-volume[86639]: DEBUG cinder.volume.flows.manager.create_volume [None req-040ce015-47d0-4eec-b32a-c50efad23356 tempest-ServerActionsTestOtherA-1484119296 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 19:44:21 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-040ce015-47d0-4eec-b32a-c50efad23356 tempest-ServerActionsTestOtherA-1484119296 None] Flow 'volume_create_manager' (7e9e5d0e-ac3f-4112-8284-41e79c82af9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 19:44:21 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-040ce015-47d0-4eec-b32a-c50efad23356 tempest-ServerActionsTestOtherA-1484119296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d67d033c-999a-4b05-af8e-a9d722dfe932) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:44:21 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-040ce015-47d0-4eec-b32a-c50efad23356 tempest-ServerActionsTestOtherA-1484119296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d67d033c-999a-4b05-af8e-a9d722dfe932) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T17:44:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1732918802',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76021e4b-1f91-419e-8f4e-07e754df6bf3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45bda7b272094b50848132c01f50594e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T17:44:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T17:44:21Z,use_quota=True,user_id='6f708f7675eb4c2e9e784fcd51397dd3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:44:21 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-040ce015-47d0-4eec-b32a-c50efad23356 tempest-ServerActionsTestOtherA-1484119296 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88d636c0-786b-4120-9041-38b7b7e5d242) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:44:21 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-040ce015-47d0-4eec-b32a-c50efad23356 tempest-ServerActionsTestOtherA-1484119296 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88d636c0-786b-4120-9041-38b7b7e5d242) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:44:21 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-040ce015-47d0-4eec-b32a-c50efad23356 tempest-ServerActionsTestOtherA-1484119296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d0be96b-14b6-4e11-b771-154dcb2547fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:44:21 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-040ce015-47d0-4eec-b32a-c50efad23356 tempest-ServerActionsTestOtherA-1484119296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d0be96b-14b6-4e11-b771-154dcb2547fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '76021e4b-1f91-419e-8f4e-07e754df6bf3', 'volume_name': 'volume-76021e4b-1f91-419e-8f4e-07e754df6bf3', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:44:21 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-040ce015-47d0-4eec-b32a-c50efad23356 tempest-ServerActionsTestOtherA-1484119296 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66fecb9b-9497-4907-9974-ea2a63ab0def) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:44:21 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-040ce015-47d0-4eec-b32a-c50efad23356 tempest-ServerActionsTestOtherA-1484119296 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66fecb9b-9497-4907-9974-ea2a63ab0def) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:44:21 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-040ce015-47d0-4eec-b32a-c50efad23356 tempest-ServerActionsTestOtherA-1484119296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd2eec92-bf4b-41d6-a8d5-350cd9456666) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:44:21 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-040ce015-47d0-4eec-b32a-c50efad23356 tempest-ServerActionsTestOtherA-1484119296 None] Volume 76021e4b-1f91-419e-8f4e-07e754df6bf3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-76021e4b-1f91-419e-8f4e-07e754df6bf3', 'volume_size': 1}
Jul 02 19:44:21 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-040ce015-47d0-4eec-b32a-c50efad23356 tempest-ServerActionsTestOtherA-1484119296 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:44:21 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-040ce015-47d0-4eec-b32a-c50efad23356 tempest-ServerActionsTestOtherA-1484119296 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:44:21 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-040ce015-47d0-4eec-b32a-c50efad23356 tempest-ServerActionsTestOtherA-1484119296 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce906cb830>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T17:44:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1732918802',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76021e4b-1f91-419e-8f4e-07e754df6bf3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45bda7b272094b50848132c01f50594e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T17:44:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T17:44:21Z,use_quota=True,user_id='6f708f7675eb4c2e9e784fcd51397dd3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)}" {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 19:44:21 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-040ce015-47d0-4eec-b32a-c50efad23356 tempest-ServerActionsTestOtherA-1484119296 None] Creating volume 76021e4b-1f91-419e-8f4e-07e754df6bf3 {{(pid=86639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 19:44:21 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-040ce015-47d0-4eec-b32a-c50efad23356 tempest-ServerActionsTestOtherA-1484119296 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:44:21 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-040ce015-47d0-4eec-b32a-c50efad23356 tempest-ServerActionsTestOtherA-1484119296 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:44:21 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-040ce015-47d0-4eec-b32a-c50efad23356 tempest-ServerActionsTestOtherA-1484119296 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 19:44:21 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-040ce015-47d0-4eec-b32a-c50efad23356 tempest-ServerActionsTestOtherA-1484119296 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 19:44:21 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-040ce015-47d0-4eec-b32a-c50efad23356 tempest-ServerActionsTestOtherA-1484119296 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:44:21 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-040ce015-47d0-4eec-b32a-c50efad23356 tempest-ServerActionsTestOtherA-1484119296 None] Selected osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92 as target Quobyte volume. {{(pid=86639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 19:44:21 devstack cinder-volume[86639]: INFO cinder.volume.drivers.remotefs [None req-040ce015-47d0-4eec-b32a-c50efad23356 tempest-ServerActionsTestOtherA-1484119296 None] casted to osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92
Jul 02 19:44:21 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-040ce015-47d0-4eec-b32a-c50efad23356 tempest-ServerActionsTestOtherA-1484119296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-76021e4b-1f91-419e-8f4e-07e754df6bf3 1073741824 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:44:21 devstack sudo[89337]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-76021e4b-1f91-419e-8f4e-07e754df6bf3 1073741824
Jul 02 19:44:21 devstack sudo[89337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:44:22 devstack sudo[89280]: pam_unix(sudo:session): session closed for user root
Jul 02 19:44:22 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-ddbacba5-d707-42e0-9915-f8d2c2bbd6fa tempest-GroupSnapshotsTest-1838694738 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-23b3d0ce-23d9-45b6-a6f8-074ae81802a0.f1741df1-3f31-4039-9176-36601c096ac2" returned: 0 in 2.115s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:44:22 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-ddbacba5-d707-42e0-9915-f8d2c2bbd6fa tempest-GroupSnapshotsTest-1838694738 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-23b3d0ce-23d9-45b6-a6f8-074ae81802a0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86639) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 02 19:44:22 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bb813a2-cb5e-4bf8-84af-c3afe0d8aabd]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 19:44:22 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-ddbacba5-d707-42e0-9915-f8d2c2bbd6fa tempest-GroupSnapshotsTest-1838694738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-23b3d0ce-23d9-45b6-a6f8-074ae81802a0 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:44:22 devstack sudo[89356]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-23b3d0ce-23d9-45b6-a6f8-074ae81802a0
Jul 02 19:44:22 devstack sudo[89356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:44:23 devstack sudo[89337]: pam_unix(sudo:session): session closed for user root
Jul 02 19:44:23 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-040ce015-47d0-4eec-b32a-c50efad23356 tempest-ServerActionsTestOtherA-1484119296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-76021e4b-1f91-419e-8f4e-07e754df6bf3 1073741824" returned: 0 in 1.385s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:44:23 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-040ce015-47d0-4eec-b32a-c50efad23356 tempest-ServerActionsTestOtherA-1484119296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-76021e4b-1f91-419e-8f4e-07e754df6bf3 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:44:23 devstack sudo[89361]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-76021e4b-1f91-419e-8f4e-07e754df6bf3
Jul 02 19:44:23 devstack sudo[89361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:44:23 devstack sudo[89356]: pam_unix(sudo:session): session closed for user root
Jul 02 19:44:23 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-ddbacba5-d707-42e0-9915-f8d2c2bbd6fa tempest-GroupSnapshotsTest-1838694738 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-23b3d0ce-23d9-45b6-a6f8-074ae81802a0" returned: 0 in 1.075s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:44:23 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-ddbacba5-d707-42e0-9915-f8d2c2bbd6fa tempest-GroupSnapshotsTest-1838694738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-23b3d0ce-23d9-45b6-a6f8-074ae81802a0.f1741df1-3f31-4039-9176-36601c096ac2 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:44:23 devstack sudo[89366]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-23b3d0ce-23d9-45b6-a6f8-074ae81802a0.f1741df1-3f31-4039-9176-36601c096ac2
Jul 02 19:44:23 devstack sudo[89366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:44:23 devstack sudo[89361]: pam_unix(sudo:session): session closed for user root
Jul 02 19:44:23 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-040ce015-47d0-4eec-b32a-c50efad23356 tempest-ServerActionsTestOtherA-1484119296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-76021e4b-1f91-419e-8f4e-07e754df6bf3" returned: 0 in 0.903s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:44:23 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-040ce015-47d0-4eec-b32a-c50efad23356 tempest-ServerActionsTestOtherA-1484119296 None] <== create_volume: return (2352ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'} {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 19:44:23 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-040ce015-47d0-4eec-b32a-c50efad23356 tempest-ServerActionsTestOtherA-1484119296 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.355s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:44:24 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-040ce015-47d0-4eec-b32a-c50efad23356 tempest-ServerActionsTestOtherA-1484119296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd2eec92-bf4b-41d6-a8d5-350cd9456666) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-76021e4b-1f91-419e-8f4e-07e754df6bf3', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:44:24 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-040ce015-47d0-4eec-b32a-c50efad23356 tempest-ServerActionsTestOtherA-1484119296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (989d8d8f-f1ba-4c1b-a176-10b432f58dc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:44:24 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-040ce015-47d0-4eec-b32a-c50efad23356 tempest-ServerActionsTestOtherA-1484119296 None] Volume volume-76021e4b-1f91-419e-8f4e-07e754df6bf3 (76021e4b-1f91-419e-8f4e-07e754df6bf3): created successfully
Jul 02 19:44:24 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-040ce015-47d0-4eec-b32a-c50efad23356 tempest-ServerActionsTestOtherA-1484119296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (989d8d8f-f1ba-4c1b-a176-10b432f58dc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:44:24 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-040ce015-47d0-4eec-b32a-c50efad23356 tempest-ServerActionsTestOtherA-1484119296 None] Flow 'volume_create_manager' (7e9e5d0e-ac3f-4112-8284-41e79c82af9e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 19:44:24 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-040ce015-47d0-4eec-b32a-c50efad23356 tempest-ServerActionsTestOtherA-1484119296 None] Created volume successfully.
Jul 02 19:44:24 devstack sudo[89366]: pam_unix(sudo:session): session closed for user root
Jul 02 19:44:24 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-ddbacba5-d707-42e0-9915-f8d2c2bbd6fa tempest-GroupSnapshotsTest-1838694738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-23b3d0ce-23d9-45b6-a6f8-074ae81802a0.f1741df1-3f31-4039-9176-36601c096ac2" returned: 0 in 1.018s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:44:24 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-ddbacba5-d707-42e0-9915-f8d2c2bbd6fa tempest-GroupSnapshotsTest-1838694738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-23b3d0ce-23d9-45b6-a6f8-074ae81802a0.f1741df1-3f31-4039-9176-36601c096ac2 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:44:24 devstack sudo[89379]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-23b3d0ce-23d9-45b6-a6f8-074ae81802a0.f1741df1-3f31-4039-9176-36601c096ac2
Jul 02 19:44:24 devstack sudo[89379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:44:25 devstack sudo[89379]: pam_unix(sudo:session): session closed for user root
Jul 02 19:44:25 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-ddbacba5-d707-42e0-9915-f8d2c2bbd6fa tempest-GroupSnapshotsTest-1838694738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-23b3d0ce-23d9-45b6-a6f8-074ae81802a0.f1741df1-3f31-4039-9176-36601c096ac2" returned: 0 in 0.745s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:44:25 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-ddbacba5-d707-42e0-9915-f8d2c2bbd6fa tempest-GroupSnapshotsTest-1838694738 None] Lock "cinder-quobyte-f1741df1-3f31-4039-9176-36601c096ac2" released by "_delete_snapshot" :: held 5.102s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:44:25 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-ddbacba5-d707-42e0-9915-f8d2c2bbd6fa tempest-GroupSnapshotsTest-1838694738 None] Lock "cinder-quobyte-23b3d0ce-23d9-45b6-a6f8-074ae81802a0" released by "delete_snapshot" :: held 5.146s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:44:25 devstack cinder-volume[86639]: WARNING cinder.quota [None req-ddbacba5-d707-42e0-9915-f8d2c2bbd6fa tempest-GroupSnapshotsTest-1838694738 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-668847859 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-668847859, it is now deprecated. Please use the default quota class for default quota.
Jul 02 19:44:25 devstack cinder-volume[86639]: DEBUG cinder.quota [None req-ddbacba5-d707-42e0-9915-f8d2c2bbd6fa tempest-GroupSnapshotsTest-1838694738 None] Created reservations ['fdf7142a-6bba-4798-b148-0ef3a957f4be', '3cb004f8-3a54-41c2-aa97-d6ccee11ca8b', 'a273081c-0652-470d-9131-fe7c0d27a7b8', '36f3f27a-9d92-42ee-9c7e-053d56c705a4'] {{(pid=86639) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 19:44:25 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-ddbacba5-d707-42e0-9915-f8d2c2bbd6fa tempest-GroupSnapshotsTest-1838694738 None] group_snapshot 32b87c55-7f44-46e7-a5c3-1ffba4e1dacd: deleted successfully
Jul 02 19:44:26 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-4a0d9120-b442-4447-a4de-bc3d8575eb44 tempest-GroupSnapshotsTest-1838694738 None] Acquiring lock "cinder-quobyte-23b3d0ce-23d9-45b6-a6f8-074ae81802a0" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:44:26 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-4a0d9120-b442-4447-a4de-bc3d8575eb44 tempest-GroupSnapshotsTest-1838694738 None] Lock "cinder-quobyte-23b3d0ce-23d9-45b6-a6f8-074ae81802a0" acquired by "delete_volume" :: waited 0.024s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:44:26 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[69590796-4715-4eac-bd45-5888475b3be9]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 19:44:26 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-4a0d9120-b442-4447-a4de-bc3d8575eb44 tempest-GroupSnapshotsTest-1838694738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-23b3d0ce-23d9-45b6-a6f8-074ae81802a0 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:44:26 devstack sudo[89387]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-23b3d0ce-23d9-45b6-a6f8-074ae81802a0
Jul 02 19:44:26 devstack sudo[89387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:44:27 devstack sudo[89387]: pam_unix(sudo:session): session closed for user root
Jul 02 19:44:27 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-4a0d9120-b442-4447-a4de-bc3d8575eb44 tempest-GroupSnapshotsTest-1838694738 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-23b3d0ce-23d9-45b6-a6f8-074ae81802a0" returned: 0 in 1.036s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:44:27 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-4a0d9120-b442-4447-a4de-bc3d8575eb44 tempest-GroupSnapshotsTest-1838694738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-23b3d0ce-23d9-45b6-a6f8-074ae81802a0 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:44:27 devstack sudo[89406]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-23b3d0ce-23d9-45b6-a6f8-074ae81802a0
Jul 02 19:44:27 devstack sudo[89406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:44:27 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [req-3101e12f-7563-48ec-b144-e246ac10ca63 req-fecbead3-1c5f-42f0-bd6e-836d12b00562 tempest-TaggedAttachmentsTest-241125395 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:44:27 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [req-3101e12f-7563-48ec-b144-e246ac10ca63 req-fecbead3-1c5f-42f0-bd6e-836d12b00562 tempest-TaggedAttachmentsTest-241125395 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:44:27 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1a1ad28-4756-4add-a360-50e3a944a750]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 19:44:27 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [req-3101e12f-7563-48ec-b144-e246ac10ca63 req-fecbead3-1c5f-42f0-bd6e-836d12b00562 tempest-TaggedAttachmentsTest-241125395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-d5e3a764-cfac-4230-aa76-026ddf2e9a5f {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:44:27 devstack sudo[89415]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-d5e3a764-cfac-4230-aa76-026ddf2e9a5f
Jul 02 19:44:27 devstack sudo[89415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:44:28 devstack sudo[89406]: pam_unix(sudo:session): session closed for user root
Jul 02 19:44:28 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-4a0d9120-b442-4447-a4de-bc3d8575eb44 tempest-GroupSnapshotsTest-1838694738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-23b3d0ce-23d9-45b6-a6f8-074ae81802a0" returned: 0 in 1.009s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:44:28 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-4a0d9120-b442-4447-a4de-bc3d8575eb44 tempest-GroupSnapshotsTest-1838694738 None] Lock "cinder-quobyte-23b3d0ce-23d9-45b6-a6f8-074ae81802a0" released by "delete_volume" :: held 2.164s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:44:28 devstack cinder-volume[86639]: DEBUG cinder.quota [None req-4a0d9120-b442-4447-a4de-bc3d8575eb44 tempest-GroupSnapshotsTest-1838694738 None] Created reservations ['cef26671-0283-4acf-92bb-99e847cb5bba'] {{(pid=86639) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 19:44:28 devstack cinder-volume[86639]: WARNING cinder.db.api [None req-4a0d9120-b442-4447-a4de-bc3d8575eb44 tempest-GroupSnapshotsTest-1838694738 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-668847859']
Jul 02 19:44:28 devstack cinder-volume[86639]: DEBUG cinder.quota [None req-4a0d9120-b442-4447-a4de-bc3d8575eb44 tempest-GroupSnapshotsTest-1838694738 None] Created reservations ['d0794b7f-cc4a-4a1f-a7af-26989846e1ec', 'ab8f053c-001c-4092-93d3-ae1730e48518', 'bb84ede5-3076-4956-bb14-b2bb116f1821', '08ed6dca-08b2-46f2-bd53-34aedc61f34b'] {{(pid=86639) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 19:44:28 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-4a0d9120-b442-4447-a4de-bc3d8575eb44 tempest-GroupSnapshotsTest-1838694738 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:44:28 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-4a0d9120-b442-4447-a4de-bc3d8575eb44 tempest-GroupSnapshotsTest-1838694738 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:44:28 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-4a0d9120-b442-4447-a4de-bc3d8575eb44 tempest-GroupSnapshotsTest-1838694738 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 19:44:28 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-4a0d9120-b442-4447-a4de-bc3d8575eb44 tempest-GroupSnapshotsTest-1838694738 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 19:44:28 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-4a0d9120-b442-4447-a4de-bc3d8575eb44 tempest-GroupSnapshotsTest-1838694738 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:44:28 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-4a0d9120-b442-4447-a4de-bc3d8575eb44 tempest-GroupSnapshotsTest-1838694738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:44:28 devstack sudo[89431]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e
Jul 02 19:44:28 devstack sudo[89431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:44:28 devstack sudo[89415]: pam_unix(sudo:session): session closed for user root
Jul 02 19:44:28 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [req-3101e12f-7563-48ec-b144-e246ac10ca63 req-fecbead3-1c5f-42f0-bd6e-836d12b00562 tempest-TaggedAttachmentsTest-241125395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-d5e3a764-cfac-4230-aa76-026ddf2e9a5f" returned: 0 in 1.158s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:44:28 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [req-3101e12f-7563-48ec-b144-e246ac10ca63 req-fecbead3-1c5f-42f0-bd6e-836d12b00562 tempest-TaggedAttachmentsTest-241125395 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.213s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:44:29 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [req-3101e12f-7563-48ec-b144-e246ac10ca63 req-fecbead3-1c5f-42f0-bd6e-836d12b00562 tempest-TaggedAttachmentsTest-241125395 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92', 'name': 'volume-d5e3a764-cfac-4230-aa76-026ddf2e9a5f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5c0943bf-0579-4f45-880c-508a9e41b25e', 'enforce_multipath': True} {{(pid=86639) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 02 19:44:29 devstack cinder-volume[86639]: INFO cinder.volume.manager [req-3101e12f-7563-48ec-b144-e246ac10ca63 req-fecbead3-1c5f-42f0-bd6e-836d12b00562 tempest-TaggedAttachmentsTest-241125395 None] attachment_update completed successfully.
Jul 02 19:44:29 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-7647c5bc-b85a-45e3-b0b9-7a249824612a tempest-GroupSnapshotsTest-1838694738 None] Group tempest-GroupSnapshotsTest-Group-99355389: creating
Jul 02 19:44:29 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-7647c5bc-b85a-45e3-b0b9-7a249824612a tempest-GroupSnapshotsTest-1838694738 None] Group tempest-GroupSnapshotsTest-Group-99355389: created successfully
Jul 02 19:44:30 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-7647c5bc-b85a-45e3-b0b9-7a249824612a tempest-GroupSnapshotsTest-1838694738 None] Create group completed successfully.
Jul 02 19:44:30 devstack sudo[89431]: pam_unix(sudo:session): session closed for user root
Jul 02 19:44:30 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-4a0d9120-b442-4447-a4de-bc3d8575eb44 tempest-GroupSnapshotsTest-1838694738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e" returned: 0 in 1.182s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:44:30 devstack cinder-volume[86639]: DEBUG cinder.manager [None req-4a0d9120-b442-4447-a4de-bc3d8575eb44 tempest-GroupSnapshotsTest-1838694738 None] Notifying Schedulers of capabilities ... {{(pid=86639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 19:44:30 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-4a0d9120-b442-4447-a4de-bc3d8575eb44 tempest-GroupSnapshotsTest-1838694738 None] Delete group completed successfully.
Jul 02 19:44:31 devstack cinder-volume[86639]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a390b4a-90ff-40cb-a77b-0fe1e66713e5 tempest-GroupSnapshotsTest-1838694738 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 19:44:32 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-5a390b4a-90ff-40cb-a77b-0fe1e66713e5 tempest-GroupSnapshotsTest-1838694738 None] Flow 'volume_create_manager' (a7ca33d8-cea7-437b-a6f8-1c9e46781612) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 19:44:32 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-5a390b4a-90ff-40cb-a77b-0fe1e66713e5 tempest-GroupSnapshotsTest-1838694738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4098a42a-16b0-4575-b882-e8bdcbc93f75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:44:32 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-5a390b4a-90ff-40cb-a77b-0fe1e66713e5 tempest-GroupSnapshotsTest-1838694738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4098a42a-16b0-4575-b882-e8bdcbc93f75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T17:44:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2011306073',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=999b969e-b5fb-47fd-96cc-75986549995f,host='devstack@QuobyteHD#QuobyteHD',id=3c6df81f-bbbd-477c-b51e-195a2f2d1e52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccce40c931504b29be89afa73433e0c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T17:44:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T17:44:32Z,use_quota=True,user_id='cd296cf1e98f4d7da1f681631ac1253d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2379b88-d0f8-4950-a40f-14d6b773f486),volume_type_id=c2379b88-d0f8-4950-a40f-14d6b773f486)' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:44:32 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-5a390b4a-90ff-40cb-a77b-0fe1e66713e5 tempest-GroupSnapshotsTest-1838694738 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb5487c2-73ff-4905-9761-0c1b2edd9272) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:44:32 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-5a390b4a-90ff-40cb-a77b-0fe1e66713e5 tempest-GroupSnapshotsTest-1838694738 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb5487c2-73ff-4905-9761-0c1b2edd9272) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:44:32 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-5a390b4a-90ff-40cb-a77b-0fe1e66713e5 tempest-GroupSnapshotsTest-1838694738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b73d3b17-77d9-4f22-89e1-a1abf1aca085) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:44:32 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-5a390b4a-90ff-40cb-a77b-0fe1e66713e5 tempest-GroupSnapshotsTest-1838694738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b73d3b17-77d9-4f22-89e1-a1abf1aca085) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3c6df81f-bbbd-477c-b51e-195a2f2d1e52', 'volume_name': 'volume-3c6df81f-bbbd-477c-b51e-195a2f2d1e52', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:44:32 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-5a390b4a-90ff-40cb-a77b-0fe1e66713e5 tempest-GroupSnapshotsTest-1838694738 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fea0289-ddc8-43d3-8f39-a2e577c0ad7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:44:32 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-5a390b4a-90ff-40cb-a77b-0fe1e66713e5 tempest-GroupSnapshotsTest-1838694738 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fea0289-ddc8-43d3-8f39-a2e577c0ad7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:44:32 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-5a390b4a-90ff-40cb-a77b-0fe1e66713e5 tempest-GroupSnapshotsTest-1838694738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4491b6f1-93da-4c9a-a550-d93d23e3cea8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:44:32 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-5a390b4a-90ff-40cb-a77b-0fe1e66713e5 tempest-GroupSnapshotsTest-1838694738 None] Volume 3c6df81f-bbbd-477c-b51e-195a2f2d1e52: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3c6df81f-bbbd-477c-b51e-195a2f2d1e52', 'volume_size': 1}
Jul 02 19:44:32 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-5a390b4a-90ff-40cb-a77b-0fe1e66713e5 tempest-GroupSnapshotsTest-1838694738 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:44:32 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-5a390b4a-90ff-40cb-a77b-0fe1e66713e5 tempest-GroupSnapshotsTest-1838694738 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:44:32 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-5a390b4a-90ff-40cb-a77b-0fe1e66713e5 tempest-GroupSnapshotsTest-1838694738 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce906cb830>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=999b969e-b5fb-47fd-96cc-75986549995f,created_at=2026-07-02T17:44:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2011306073',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=999b969e-b5fb-47fd-96cc-75986549995f,host='devstack@QuobyteHD#QuobyteHD',id=3c6df81f-bbbd-477c-b51e-195a2f2d1e52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccce40c931504b29be89afa73433e0c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T17:44:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T17:44:32Z,use_quota=True,user_id='cd296cf1e98f4d7da1f681631ac1253d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2379b88-d0f8-4950-a40f-14d6b773f486),volume_type_id=c2379b88-d0f8-4950-a40f-14d6b773f486)}" {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 19:44:32 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-5a390b4a-90ff-40cb-a77b-0fe1e66713e5 tempest-GroupSnapshotsTest-1838694738 None] Creating volume 3c6df81f-bbbd-477c-b51e-195a2f2d1e52 {{(pid=86639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 19:44:32 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-5a390b4a-90ff-40cb-a77b-0fe1e66713e5 tempest-GroupSnapshotsTest-1838694738 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:44:32 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-5a390b4a-90ff-40cb-a77b-0fe1e66713e5 tempest-GroupSnapshotsTest-1838694738 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:44:32 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-5a390b4a-90ff-40cb-a77b-0fe1e66713e5 tempest-GroupSnapshotsTest-1838694738 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 19:44:32 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-5a390b4a-90ff-40cb-a77b-0fe1e66713e5 tempest-GroupSnapshotsTest-1838694738 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 19:44:32 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-5a390b4a-90ff-40cb-a77b-0fe1e66713e5 tempest-GroupSnapshotsTest-1838694738 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:44:32 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-5a390b4a-90ff-40cb-a77b-0fe1e66713e5 tempest-GroupSnapshotsTest-1838694738 None] Selected osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92 as target Quobyte volume. {{(pid=86639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 19:44:32 devstack cinder-volume[86639]: INFO cinder.volume.drivers.remotefs [None req-5a390b4a-90ff-40cb-a77b-0fe1e66713e5 tempest-GroupSnapshotsTest-1838694738 None] casted to osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92
Jul 02 19:44:32 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-5a390b4a-90ff-40cb-a77b-0fe1e66713e5 tempest-GroupSnapshotsTest-1838694738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-3c6df81f-bbbd-477c-b51e-195a2f2d1e52 1073741824 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:44:32 devstack sudo[89824]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-3c6df81f-bbbd-477c-b51e-195a2f2d1e52 1073741824
Jul 02 19:44:32 devstack sudo[89824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:44:33 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-5a390b4a-90ff-40cb-a77b-0fe1e66713e5 tempest-GroupSnapshotsTest-1838694738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-3c6df81f-bbbd-477c-b51e-195a2f2d1e52 1073741824" returned: 0 in 1.607s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:44:33 devstack sudo[89824]: pam_unix(sudo:session): session closed for user root
Jul 02 19:44:33 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-5a390b4a-90ff-40cb-a77b-0fe1e66713e5 tempest-GroupSnapshotsTest-1838694738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-3c6df81f-bbbd-477c-b51e-195a2f2d1e52 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:44:33 devstack sudo[89856]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-3c6df81f-bbbd-477c-b51e-195a2f2d1e52
Jul 02 19:44:33 devstack sudo[89856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:44:34 devstack cinder-volume[86639]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f31bc6a-0dcc-43d4-a3b9-a93247bb56db tempest-AttachVolumeTestJSON-1400825288 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 19:44:34 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-0f31bc6a-0dcc-43d4-a3b9-a93247bb56db tempest-AttachVolumeTestJSON-1400825288 None] Flow 'volume_create_manager' (973dcadc-ec18-4d08-a797-fa836a4ae1a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 19:44:34 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-0f31bc6a-0dcc-43d4-a3b9-a93247bb56db tempest-AttachVolumeTestJSON-1400825288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd9e734c-f659-4e6b-9561-f6611a9271f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:44:34 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-0f31bc6a-0dcc-43d4-a3b9-a93247bb56db tempest-AttachVolumeTestJSON-1400825288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd9e734c-f659-4e6b-9561-f6611a9271f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T17:44:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-785758137',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1aa59cc9-9533-43b6-bf70-77d04e17a7ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f6a9a1c5d504a128308722e4f105bba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T17:44:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T17:44:34Z,use_quota=True,user_id='0bd5c732a9864ab3b47fb15ac6ec17ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:44:34 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-0f31bc6a-0dcc-43d4-a3b9-a93247bb56db tempest-AttachVolumeTestJSON-1400825288 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (841c6f33-7a3b-4a18-9ed3-89040a25c897) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:44:34 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-0f31bc6a-0dcc-43d4-a3b9-a93247bb56db tempest-AttachVolumeTestJSON-1400825288 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (841c6f33-7a3b-4a18-9ed3-89040a25c897) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:44:34 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-0f31bc6a-0dcc-43d4-a3b9-a93247bb56db tempest-AttachVolumeTestJSON-1400825288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0a8785c-5564-484c-b360-053f41626bee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:44:34 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-0f31bc6a-0dcc-43d4-a3b9-a93247bb56db tempest-AttachVolumeTestJSON-1400825288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0a8785c-5564-484c-b360-053f41626bee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1aa59cc9-9533-43b6-bf70-77d04e17a7ac', 'volume_name': 'volume-1aa59cc9-9533-43b6-bf70-77d04e17a7ac', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:44:34 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-0f31bc6a-0dcc-43d4-a3b9-a93247bb56db tempest-AttachVolumeTestJSON-1400825288 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0755b0ab-4ed4-4b9b-a1ed-42901eca4b79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:44:34 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-0f31bc6a-0dcc-43d4-a3b9-a93247bb56db tempest-AttachVolumeTestJSON-1400825288 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0755b0ab-4ed4-4b9b-a1ed-42901eca4b79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:44:34 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-0f31bc6a-0dcc-43d4-a3b9-a93247bb56db tempest-AttachVolumeTestJSON-1400825288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b218fba4-1cbd-42bd-a38a-deffe304650e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:44:34 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-0f31bc6a-0dcc-43d4-a3b9-a93247bb56db tempest-AttachVolumeTestJSON-1400825288 None] Volume 1aa59cc9-9533-43b6-bf70-77d04e17a7ac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1aa59cc9-9533-43b6-bf70-77d04e17a7ac', 'volume_size': 1}
Jul 02 19:44:34 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-0f31bc6a-0dcc-43d4-a3b9-a93247bb56db tempest-AttachVolumeTestJSON-1400825288 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:44:34 devstack sudo[89856]: pam_unix(sudo:session): session closed for user root
Jul 02 19:44:34 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-5a390b4a-90ff-40cb-a77b-0fe1e66713e5 tempest-GroupSnapshotsTest-1838694738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-3c6df81f-bbbd-477c-b51e-195a2f2d1e52" returned: 0 in 1.119s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:44:34 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-5a390b4a-90ff-40cb-a77b-0fe1e66713e5 tempest-GroupSnapshotsTest-1838694738 None] <== create_volume: return (2827ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'} {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 19:44:34 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-5a390b4a-90ff-40cb-a77b-0fe1e66713e5 tempest-GroupSnapshotsTest-1838694738 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.829s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:44:34 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-0f31bc6a-0dcc-43d4-a3b9-a93247bb56db tempest-AttachVolumeTestJSON-1400825288 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.509s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:44:34 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-0f31bc6a-0dcc-43d4-a3b9-a93247bb56db tempest-AttachVolumeTestJSON-1400825288 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce906cb830>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T17:44:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-785758137',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1aa59cc9-9533-43b6-bf70-77d04e17a7ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f6a9a1c5d504a128308722e4f105bba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T17:44:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T17:44:34Z,use_quota=True,user_id='0bd5c732a9864ab3b47fb15ac6ec17ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)}" {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 19:44:34 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-0f31bc6a-0dcc-43d4-a3b9-a93247bb56db tempest-AttachVolumeTestJSON-1400825288 None] Creating volume 1aa59cc9-9533-43b6-bf70-77d04e17a7ac {{(pid=86639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 19:44:34 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-0f31bc6a-0dcc-43d4-a3b9-a93247bb56db tempest-AttachVolumeTestJSON-1400825288 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:44:34 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-0f31bc6a-0dcc-43d4-a3b9-a93247bb56db tempest-AttachVolumeTestJSON-1400825288 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:44:34 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-0f31bc6a-0dcc-43d4-a3b9-a93247bb56db tempest-AttachVolumeTestJSON-1400825288 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 19:44:34 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-0f31bc6a-0dcc-43d4-a3b9-a93247bb56db tempest-AttachVolumeTestJSON-1400825288 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 19:44:34 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-0f31bc6a-0dcc-43d4-a3b9-a93247bb56db tempest-AttachVolumeTestJSON-1400825288 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:44:34 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-0f31bc6a-0dcc-43d4-a3b9-a93247bb56db tempest-AttachVolumeTestJSON-1400825288 None] Selected osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92 as target Quobyte volume. {{(pid=86639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 19:44:34 devstack cinder-volume[86639]: INFO cinder.volume.drivers.remotefs [None req-0f31bc6a-0dcc-43d4-a3b9-a93247bb56db tempest-AttachVolumeTestJSON-1400825288 None] casted to osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92
Jul 02 19:44:34 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-0f31bc6a-0dcc-43d4-a3b9-a93247bb56db tempest-AttachVolumeTestJSON-1400825288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-1aa59cc9-9533-43b6-bf70-77d04e17a7ac 1073741824 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:44:34 devstack sudo[89865]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-1aa59cc9-9533-43b6-bf70-77d04e17a7ac 1073741824
Jul 02 19:44:35 devstack sudo[89865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:44:35 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-5a390b4a-90ff-40cb-a77b-0fe1e66713e5 tempest-GroupSnapshotsTest-1838694738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4491b6f1-93da-4c9a-a550-d93d23e3cea8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c6df81f-bbbd-477c-b51e-195a2f2d1e52', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:44:35 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-5a390b4a-90ff-40cb-a77b-0fe1e66713e5 tempest-GroupSnapshotsTest-1838694738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ed448f1-9eff-49f2-8e95-51a61325e519) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:44:35 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-5a390b4a-90ff-40cb-a77b-0fe1e66713e5 tempest-GroupSnapshotsTest-1838694738 None] Volume volume-3c6df81f-bbbd-477c-b51e-195a2f2d1e52 (3c6df81f-bbbd-477c-b51e-195a2f2d1e52): created successfully
Jul 02 19:44:35 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-5a390b4a-90ff-40cb-a77b-0fe1e66713e5 tempest-GroupSnapshotsTest-1838694738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ed448f1-9eff-49f2-8e95-51a61325e519) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:44:35 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-5a390b4a-90ff-40cb-a77b-0fe1e66713e5 tempest-GroupSnapshotsTest-1838694738 None] Flow 'volume_create_manager' (a7ca33d8-cea7-437b-a6f8-1c9e46781612) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 19:44:35 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-5a390b4a-90ff-40cb-a77b-0fe1e66713e5 tempest-GroupSnapshotsTest-1838694738 None] Created volume successfully.
Jul 02 19:44:36 devstack sudo[89865]: pam_unix(sudo:session): session closed for user root
Jul 02 19:44:36 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-0f31bc6a-0dcc-43d4-a3b9-a93247bb56db tempest-AttachVolumeTestJSON-1400825288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-1aa59cc9-9533-43b6-bf70-77d04e17a7ac 1073741824" returned: 0 in 1.139s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:44:36 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-0f31bc6a-0dcc-43d4-a3b9-a93247bb56db tempest-AttachVolumeTestJSON-1400825288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-1aa59cc9-9533-43b6-bf70-77d04e17a7ac {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:44:36 devstack sudo[89872]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-1aa59cc9-9533-43b6-bf70-77d04e17a7ac
Jul 02 19:44:36 devstack sudo[89872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:44:36 devstack cinder-volume[86639]: INFO cinder.volume.manager [req-1766d6b6-6ee3-4429-b33c-a36c0ebc08d3 req-35ff034f-b68c-4434-995d-0ee2543bdaa2 tempest-TaggedAttachmentsTest-241125395 None] Terminate volume connection completed successfully.
Jul 02 19:44:36 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [req-1766d6b6-6ee3-4429-b33c-a36c0ebc08d3 req-35ff034f-b68c-4434-995d-0ee2543bdaa2 tempest-TaggedAttachmentsTest-241125395 None] Deleting attachment 5c0943bf-0579-4f45-880c-508a9e41b25e. {{(pid=86639) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 02 19:44:37 devstack cinder-volume[86639]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ddcf321-d82d-4b5f-99a8-a8cd1b0acd07 tempest-GroupSnapshotsTest-1838694738 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 19:44:37 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-3ddcf321-d82d-4b5f-99a8-a8cd1b0acd07 tempest-GroupSnapshotsTest-1838694738 None] Flow 'volume_create_manager' (29861974-f499-4d03-90ea-c33ee10277de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 19:44:37 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-3ddcf321-d82d-4b5f-99a8-a8cd1b0acd07 tempest-GroupSnapshotsTest-1838694738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (910f1630-1f85-4daf-867c-aea7a70c9153) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:44:37 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-3ddcf321-d82d-4b5f-99a8-a8cd1b0acd07 tempest-GroupSnapshotsTest-1838694738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (910f1630-1f85-4daf-867c-aea7a70c9153) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T17:44:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1423281357',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=999b969e-b5fb-47fd-96cc-75986549995f,host='devstack@QuobyteHD#QuobyteHD',id=8a515fcc-92ae-4757-8f52-edbde39fd487,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccce40c931504b29be89afa73433e0c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T17:44:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T17:44:37Z,use_quota=True,user_id='cd296cf1e98f4d7da1f681631ac1253d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2379b88-d0f8-4950-a40f-14d6b773f486),volume_type_id=c2379b88-d0f8-4950-a40f-14d6b773f486)' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:44:37 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-3ddcf321-d82d-4b5f-99a8-a8cd1b0acd07 tempest-GroupSnapshotsTest-1838694738 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (309ec527-7f62-4165-8fda-c6c025d9add6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:44:37 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-3ddcf321-d82d-4b5f-99a8-a8cd1b0acd07 tempest-GroupSnapshotsTest-1838694738 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (309ec527-7f62-4165-8fda-c6c025d9add6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:44:37 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-3ddcf321-d82d-4b5f-99a8-a8cd1b0acd07 tempest-GroupSnapshotsTest-1838694738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9aa58fc8-f307-4d7d-9fb4-a677484f3b4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:44:37 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-3ddcf321-d82d-4b5f-99a8-a8cd1b0acd07 tempest-GroupSnapshotsTest-1838694738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9aa58fc8-f307-4d7d-9fb4-a677484f3b4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a515fcc-92ae-4757-8f52-edbde39fd487', 'volume_name': 'volume-8a515fcc-92ae-4757-8f52-edbde39fd487', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:44:37 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-3ddcf321-d82d-4b5f-99a8-a8cd1b0acd07 tempest-GroupSnapshotsTest-1838694738 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9d06bc1-a923-412a-a6fc-756b0baf8fd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:44:37 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-3ddcf321-d82d-4b5f-99a8-a8cd1b0acd07 tempest-GroupSnapshotsTest-1838694738 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9d06bc1-a923-412a-a6fc-756b0baf8fd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:44:37 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-3ddcf321-d82d-4b5f-99a8-a8cd1b0acd07 tempest-GroupSnapshotsTest-1838694738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22ef997e-26c0-461a-af22-ff803b26e3d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:44:37 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-3ddcf321-d82d-4b5f-99a8-a8cd1b0acd07 tempest-GroupSnapshotsTest-1838694738 None] Volume 8a515fcc-92ae-4757-8f52-edbde39fd487: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a515fcc-92ae-4757-8f52-edbde39fd487', 'volume_size': 1}
Jul 02 19:44:37 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-3ddcf321-d82d-4b5f-99a8-a8cd1b0acd07 tempest-GroupSnapshotsTest-1838694738 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:44:37 devstack sudo[89872]: pam_unix(sudo:session): session closed for user root
Jul 02 19:44:37 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-0f31bc6a-0dcc-43d4-a3b9-a93247bb56db tempest-AttachVolumeTestJSON-1400825288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-1aa59cc9-9533-43b6-bf70-77d04e17a7ac" returned: 0 in 1.248s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:44:37 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-0f31bc6a-0dcc-43d4-a3b9-a93247bb56db tempest-AttachVolumeTestJSON-1400825288 None] <== create_volume: return (2441ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'} {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 19:44:37 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-0f31bc6a-0dcc-43d4-a3b9-a93247bb56db tempest-AttachVolumeTestJSON-1400825288 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.445s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:44:37 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-3ddcf321-d82d-4b5f-99a8-a8cd1b0acd07 tempest-GroupSnapshotsTest-1838694738 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.268s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:44:37 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-3ddcf321-d82d-4b5f-99a8-a8cd1b0acd07 tempest-GroupSnapshotsTest-1838694738 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce906cb830>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=999b969e-b5fb-47fd-96cc-75986549995f,created_at=2026-07-02T17:44:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1423281357',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=999b969e-b5fb-47fd-96cc-75986549995f,host='devstack@QuobyteHD#QuobyteHD',id=8a515fcc-92ae-4757-8f52-edbde39fd487,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccce40c931504b29be89afa73433e0c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T17:44:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T17:44:37Z,use_quota=True,user_id='cd296cf1e98f4d7da1f681631ac1253d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2379b88-d0f8-4950-a40f-14d6b773f486),volume_type_id=c2379b88-d0f8-4950-a40f-14d6b773f486)}" {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 19:44:37 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-3ddcf321-d82d-4b5f-99a8-a8cd1b0acd07 tempest-GroupSnapshotsTest-1838694738 None] Creating volume 8a515fcc-92ae-4757-8f52-edbde39fd487 {{(pid=86639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 19:44:37 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-3ddcf321-d82d-4b5f-99a8-a8cd1b0acd07 tempest-GroupSnapshotsTest-1838694738 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:44:37 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-3ddcf321-d82d-4b5f-99a8-a8cd1b0acd07 tempest-GroupSnapshotsTest-1838694738 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:44:37 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-3ddcf321-d82d-4b5f-99a8-a8cd1b0acd07 tempest-GroupSnapshotsTest-1838694738 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 19:44:37 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-3ddcf321-d82d-4b5f-99a8-a8cd1b0acd07 tempest-GroupSnapshotsTest-1838694738 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 19:44:37 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-3ddcf321-d82d-4b5f-99a8-a8cd1b0acd07 tempest-GroupSnapshotsTest-1838694738 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:44:37 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-3ddcf321-d82d-4b5f-99a8-a8cd1b0acd07 tempest-GroupSnapshotsTest-1838694738 None] Selected osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92 as target Quobyte volume. {{(pid=86639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 19:44:37 devstack cinder-volume[86639]: INFO cinder.volume.drivers.remotefs [None req-3ddcf321-d82d-4b5f-99a8-a8cd1b0acd07 tempest-GroupSnapshotsTest-1838694738 None] casted to osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92
Jul 02 19:44:37 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-3ddcf321-d82d-4b5f-99a8-a8cd1b0acd07 tempest-GroupSnapshotsTest-1838694738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8a515fcc-92ae-4757-8f52-edbde39fd487 1073741824 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:44:37 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-0f31bc6a-0dcc-43d4-a3b9-a93247bb56db tempest-AttachVolumeTestJSON-1400825288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b218fba4-1cbd-42bd-a38a-deffe304650e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1aa59cc9-9533-43b6-bf70-77d04e17a7ac', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:44:37 devstack sudo[89903]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8a515fcc-92ae-4757-8f52-edbde39fd487 1073741824
Jul 02 19:44:37 devstack sudo[89903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:44:37 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-0f31bc6a-0dcc-43d4-a3b9-a93247bb56db tempest-AttachVolumeTestJSON-1400825288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93c1c552-ff76-458b-81c0-1c2eb20bdcd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:44:37 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-0f31bc6a-0dcc-43d4-a3b9-a93247bb56db tempest-AttachVolumeTestJSON-1400825288 None] Volume volume-1aa59cc9-9533-43b6-bf70-77d04e17a7ac (1aa59cc9-9533-43b6-bf70-77d04e17a7ac): created successfully
Jul 02 19:44:37 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-0f31bc6a-0dcc-43d4-a3b9-a93247bb56db tempest-AttachVolumeTestJSON-1400825288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93c1c552-ff76-458b-81c0-1c2eb20bdcd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:44:37 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-0f31bc6a-0dcc-43d4-a3b9-a93247bb56db tempest-AttachVolumeTestJSON-1400825288 None] Flow 'volume_create_manager' (973dcadc-ec18-4d08-a797-fa836a4ae1a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 19:44:37 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-0f31bc6a-0dcc-43d4-a3b9-a93247bb56db tempest-AttachVolumeTestJSON-1400825288 None] Created volume successfully.
Jul 02 19:44:38 devstack sudo[89903]: pam_unix(sudo:session): session closed for user root
Jul 02 19:44:38 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-3ddcf321-d82d-4b5f-99a8-a8cd1b0acd07 tempest-GroupSnapshotsTest-1838694738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8a515fcc-92ae-4757-8f52-edbde39fd487 1073741824" returned: 0 in 1.379s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:44:38 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-3ddcf321-d82d-4b5f-99a8-a8cd1b0acd07 tempest-GroupSnapshotsTest-1838694738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8a515fcc-92ae-4757-8f52-edbde39fd487 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:44:38 devstack sudo[89917]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8a515fcc-92ae-4757-8f52-edbde39fd487
Jul 02 19:44:38 devstack sudo[89917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:44:39 devstack sudo[89917]: pam_unix(sudo:session): session closed for user root
Jul 02 19:44:39 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-3ddcf321-d82d-4b5f-99a8-a8cd1b0acd07 tempest-GroupSnapshotsTest-1838694738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8a515fcc-92ae-4757-8f52-edbde39fd487" returned: 0 in 1.004s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:44:39 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-3ddcf321-d82d-4b5f-99a8-a8cd1b0acd07 tempest-GroupSnapshotsTest-1838694738 None] <== create_volume: return (2438ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'} {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 19:44:39 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-3ddcf321-d82d-4b5f-99a8-a8cd1b0acd07 tempest-GroupSnapshotsTest-1838694738 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.440s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:44:39 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-3ddcf321-d82d-4b5f-99a8-a8cd1b0acd07 tempest-GroupSnapshotsTest-1838694738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22ef997e-26c0-461a-af22-ff803b26e3d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a515fcc-92ae-4757-8f52-edbde39fd487', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:44:39 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-3ddcf321-d82d-4b5f-99a8-a8cd1b0acd07 tempest-GroupSnapshotsTest-1838694738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41d1403d-8508-48e7-99ca-c53c52595f76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:44:39 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-3ddcf321-d82d-4b5f-99a8-a8cd1b0acd07 tempest-GroupSnapshotsTest-1838694738 None] Volume volume-8a515fcc-92ae-4757-8f52-edbde39fd487 (8a515fcc-92ae-4757-8f52-edbde39fd487): created successfully
Jul 02 19:44:39 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-3ddcf321-d82d-4b5f-99a8-a8cd1b0acd07 tempest-GroupSnapshotsTest-1838694738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41d1403d-8508-48e7-99ca-c53c52595f76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:44:39 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-3ddcf321-d82d-4b5f-99a8-a8cd1b0acd07 tempest-GroupSnapshotsTest-1838694738 None] Flow 'volume_create_manager' (29861974-f499-4d03-90ea-c33ee10277de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 19:44:39 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-3ddcf321-d82d-4b5f-99a8-a8cd1b0acd07 tempest-GroupSnapshotsTest-1838694738 None] Created volume successfully.
Jul 02 19:44:41 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-819d5495-821a-47d1-bf30-97cfebcfe169 tempest-GroupSnapshotsTest-1838694738 None] Update group completed successfully.
Jul 02 19:44:41 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [req-46c74065-45bf-40b5-bef5-9fbdcf25eb4e req-5031e209-29ea-42c0-ad3f-247d732622c9 tempest-AttachVolumeTestJSON-1400825288 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:44:41 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [req-46c74065-45bf-40b5-bef5-9fbdcf25eb4e req-5031e209-29ea-42c0-ad3f-247d732622c9 tempest-AttachVolumeTestJSON-1400825288 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:44:41 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[05df0907-8391-4ea2-bb1f-096230605f4b]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 19:44:41 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [req-46c74065-45bf-40b5-bef5-9fbdcf25eb4e req-5031e209-29ea-42c0-ad3f-247d732622c9 tempest-AttachVolumeTestJSON-1400825288 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-1aa59cc9-9533-43b6-bf70-77d04e17a7ac {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:44:41 devstack cinder-volume[86639]: DEBUG oslo_service.periodic_task [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86639) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 02 19:44:41 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:44:41 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:44:41 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 19:44:41 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 19:44:41 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:44:41 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:44:41 devstack sudo[89998]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e
Jul 02 19:44:41 devstack sudo[89998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:44:41 devstack sudo[89997]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-1aa59cc9-9533-43b6-bf70-77d04e17a7ac
Jul 02 19:44:41 devstack sudo[89997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:44:42 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-064eccf2-3d8e-4395-8005-cf71be61bb47 tempest-GroupSnapshotsTest-1838694738 None] Update group completed successfully.
Jul 02 19:44:42 devstack sudo[89998]: pam_unix(sudo:session): session closed for user root
Jul 02 19:44:42 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e" returned: 0 in 1.297s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:44:42 devstack cinder-volume[86639]: DEBUG cinder.manager [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] Notifying Schedulers of capabilities ... {{(pid=86639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 19:44:42 devstack cinder-volume[86639]: DEBUG oslo_service.periodic_task [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] Running periodic task VolumeManager._thread_info {{(pid=86639) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 02 19:44:42 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] thread count: 8 {{(pid=86639) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 02 19:44:42 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] thread info: [<_MainThread(MainThread, started 140525261275264)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 140525150678016)>, <Thread(Thread-3 (stat_writer), started daemon 140525150025920)>, <Thread(Rabbit-heartbeat, started daemon 140525150500864)>, <Thread(Thread-5 (_runner), started daemon 140525149847296)>, <Thread(Thread-7 (_runner), started daemon 140525149863424)>, <Thread(fd_logger, started daemon 140525146589376)>, <Thread(privsep_reader, started daemon 140525144562432)>] {{(pid=86639) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 02 19:44:42 devstack sudo[89997]: pam_unix(sudo:session): session closed for user root
Jul 02 19:44:42 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [req-46c74065-45bf-40b5-bef5-9fbdcf25eb4e req-5031e209-29ea-42c0-ad3f-247d732622c9 tempest-AttachVolumeTestJSON-1400825288 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-1aa59cc9-9533-43b6-bf70-77d04e17a7ac" returned: 0 in 1.488s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:44:42 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [req-46c74065-45bf-40b5-bef5-9fbdcf25eb4e req-5031e209-29ea-42c0-ad3f-247d732622c9 tempest-AttachVolumeTestJSON-1400825288 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.553s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:44:42 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [req-46c74065-45bf-40b5-bef5-9fbdcf25eb4e req-5031e209-29ea-42c0-ad3f-247d732622c9 tempest-AttachVolumeTestJSON-1400825288 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92', 'name': 'volume-1aa59cc9-9533-43b6-bf70-77d04e17a7ac', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4edb7a37-ad5a-4f7c-a925-56cb0bedb8db', 'enforce_multipath': True} {{(pid=86639) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 02 19:44:43 devstack cinder-volume[86639]: INFO cinder.volume.manager [req-46c74065-45bf-40b5-bef5-9fbdcf25eb4e req-5031e209-29ea-42c0-ad3f-247d732622c9 tempest-AttachVolumeTestJSON-1400825288 None] attachment_update completed successfully.
Jul 02 19:44:43 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-d9e373ae-df49-4b39-aa65-43938763e18c tempest-GroupSnapshotsTest-1838694738 None] Update group completed successfully.
Jul 02 19:44:45 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-dc8181cc-8304-4f0c-a98d-5e784e92d294 tempest-GroupSnapshotsTest-1838694738 None] Update group completed successfully.
Jul 02 19:44:47 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-59f17db3-3c8a-427e-92a5-9c366cbe9294 tempest-GroupSnapshotsTest-1838694738 None] GroupSnapshot 0dd2994c-7463-4352-addb-2e2e32b6e821: creating.
Jul 02 19:44:47 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-59f17db3-3c8a-427e-92a5-9c366cbe9294 tempest-GroupSnapshotsTest-1838694738 None] Group snapshot 0dd2994c-7463-4352-addb-2e2e32b6e821: creating. {{(pid=86639) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Jul 02 19:44:47 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-59f17db3-3c8a-427e-92a5-9c366cbe9294 tempest-GroupSnapshotsTest-1838694738 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:44:47 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-59f17db3-3c8a-427e-92a5-9c366cbe9294 tempest-GroupSnapshotsTest-1838694738 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:44:47 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-59f17db3-3c8a-427e-92a5-9c366cbe9294 tempest-GroupSnapshotsTest-1838694738 None] Creating offline snapshot 20f788dc-5f8d-48d4-9d44-43cc0e911008 of volume 3c6df81f-bbbd-477c-b51e-195a2f2d1e52 {{(pid=86639) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 02 19:44:47 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cbf460e-f6e1-45df-9171-ddc453d6f10a]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 19:44:47 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-59f17db3-3c8a-427e-92a5-9c366cbe9294 tempest-GroupSnapshotsTest-1838694738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-3c6df81f-bbbd-477c-b51e-195a2f2d1e52 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:44:47 devstack sudo[90397]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-3c6df81f-bbbd-477c-b51e-195a2f2d1e52
Jul 02 19:44:47 devstack sudo[90397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:44:49 devstack sudo[90397]: pam_unix(sudo:session): session closed for user root
Jul 02 19:44:49 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-59f17db3-3c8a-427e-92a5-9c366cbe9294 tempest-GroupSnapshotsTest-1838694738 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-3c6df81f-bbbd-477c-b51e-195a2f2d1e52" returned: 0 in 1.740s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:44:49 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-59f17db3-3c8a-427e-92a5-9c366cbe9294 tempest-GroupSnapshotsTest-1838694738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-3c6df81f-bbbd-477c-b51e-195a2f2d1e52,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-3c6df81f-bbbd-477c-b51e-195a2f2d1e52.20f788dc-5f8d-48d4-9d44-43cc0e911008 1G {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:44:49 devstack sudo[90412]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-3c6df81f-bbbd-477c-b51e-195a2f2d1e52,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-3c6df81f-bbbd-477c-b51e-195a2f2d1e52.20f788dc-5f8d-48d4-9d44-43cc0e911008 1G
Jul 02 19:44:49 devstack sudo[90412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:44:51 devstack sudo[90412]: pam_unix(sudo:session): session closed for user root
Jul 02 19:44:51 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-59f17db3-3c8a-427e-92a5-9c366cbe9294 tempest-GroupSnapshotsTest-1838694738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-3c6df81f-bbbd-477c-b51e-195a2f2d1e52,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-3c6df81f-bbbd-477c-b51e-195a2f2d1e52.20f788dc-5f8d-48d4-9d44-43cc0e911008 1G" returned: 0 in 2.484s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:44:51 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-59f17db3-3c8a-427e-92a5-9c366cbe9294 tempest-GroupSnapshotsTest-1838694738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3c6df81f-bbbd-477c-b51e-195a2f2d1e52 -F qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-3c6df81f-bbbd-477c-b51e-195a2f2d1e52.20f788dc-5f8d-48d4-9d44-43cc0e911008 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:44:51 devstack sudo[90498]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3c6df81f-bbbd-477c-b51e-195a2f2d1e52 -F qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-3c6df81f-bbbd-477c-b51e-195a2f2d1e52.20f788dc-5f8d-48d4-9d44-43cc0e911008
Jul 02 19:44:51 devstack sudo[90498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:44:53 devstack sudo[90498]: pam_unix(sudo:session): session closed for user root
Jul 02 19:44:53 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-59f17db3-3c8a-427e-92a5-9c366cbe9294 tempest-GroupSnapshotsTest-1838694738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3c6df81f-bbbd-477c-b51e-195a2f2d1e52 -F qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-3c6df81f-bbbd-477c-b51e-195a2f2d1e52.20f788dc-5f8d-48d4-9d44-43cc0e911008" returned: 0 in 1.500s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:44:53 devstack cinder-volume[86639]: WARNING cinder.volume.drivers.remotefs [None req-59f17db3-3c8a-427e-92a5-9c366cbe9294 tempest-GroupSnapshotsTest-1838694738 None] /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-3c6df81f-bbbd-477c-b51e-195a2f2d1e52.20f788dc-5f8d-48d4-9d44-43cc0e911008 is being set with open permissions: ugo+rw: NotImplementedError
Jul 02 19:44:53 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-59f17db3-3c8a-427e-92a5-9c366cbe9294 tempest-GroupSnapshotsTest-1838694738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-3c6df81f-bbbd-477c-b51e-195a2f2d1e52.20f788dc-5f8d-48d4-9d44-43cc0e911008 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:44:53 devstack sudo[90511]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-3c6df81f-bbbd-477c-b51e-195a2f2d1e52.20f788dc-5f8d-48d4-9d44-43cc0e911008
Jul 02 19:44:53 devstack sudo[90511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:44:54 devstack sudo[90511]: pam_unix(sudo:session): session closed for user root
Jul 02 19:44:54 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-59f17db3-3c8a-427e-92a5-9c366cbe9294 tempest-GroupSnapshotsTest-1838694738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-3c6df81f-bbbd-477c-b51e-195a2f2d1e52.20f788dc-5f8d-48d4-9d44-43cc0e911008" returned: 0 in 1.227s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:44:54 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-59f17db3-3c8a-427e-92a5-9c366cbe9294 tempest-GroupSnapshotsTest-1838694738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-3c6df81f-bbbd-477c-b51e-195a2f2d1e52.info {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:44:54 devstack sudo[90517]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-3c6df81f-bbbd-477c-b51e-195a2f2d1e52.info
Jul 02 19:44:54 devstack sudo[90517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:44:55 devstack sudo[90517]: pam_unix(sudo:session): session closed for user root
Jul 02 19:44:55 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-59f17db3-3c8a-427e-92a5-9c366cbe9294 tempest-GroupSnapshotsTest-1838694738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-3c6df81f-bbbd-477c-b51e-195a2f2d1e52.info" returned: 0 in 1.203s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:44:55 devstack cinder-volume[86639]: WARNING cinder.volume.drivers.remotefs [None req-59f17db3-3c8a-427e-92a5-9c366cbe9294 tempest-GroupSnapshotsTest-1838694738 None] /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-3c6df81f-bbbd-477c-b51e-195a2f2d1e52.info is being set with open permissions: ugo+rw: NotImplementedError
Jul 02 19:44:55 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-59f17db3-3c8a-427e-92a5-9c366cbe9294 tempest-GroupSnapshotsTest-1838694738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-3c6df81f-bbbd-477c-b51e-195a2f2d1e52.info {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:44:55 devstack sudo[90525]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-3c6df81f-bbbd-477c-b51e-195a2f2d1e52.info
Jul 02 19:44:55 devstack sudo[90525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:44:56 devstack sudo[90525]: pam_unix(sudo:session): session closed for user root
Jul 02 19:44:56 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-59f17db3-3c8a-427e-92a5-9c366cbe9294 tempest-GroupSnapshotsTest-1838694738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-3c6df81f-bbbd-477c-b51e-195a2f2d1e52.info" returned: 0 in 1.007s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:44:56 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-59f17db3-3c8a-427e-92a5-9c366cbe9294 tempest-GroupSnapshotsTest-1838694738 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 9.352s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:44:56 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-59f17db3-3c8a-427e-92a5-9c366cbe9294 tempest-GroupSnapshotsTest-1838694738 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:44:56 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-59f17db3-3c8a-427e-92a5-9c366cbe9294 tempest-GroupSnapshotsTest-1838694738 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:44:56 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-59f17db3-3c8a-427e-92a5-9c366cbe9294 tempest-GroupSnapshotsTest-1838694738 None] Creating offline snapshot 42a20365-99d5-4c2e-a52f-f1b55361416f of volume 8a515fcc-92ae-4757-8f52-edbde39fd487 {{(pid=86639) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 02 19:44:56 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[db5ff50e-5841-42f8-a699-35b85323cbc4]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 19:44:56 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-59f17db3-3c8a-427e-92a5-9c366cbe9294 tempest-GroupSnapshotsTest-1838694738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8a515fcc-92ae-4757-8f52-edbde39fd487 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:44:56 devstack sudo[90531]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8a515fcc-92ae-4757-8f52-edbde39fd487
Jul 02 19:44:56 devstack sudo[90531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:44:57 devstack sudo[90531]: pam_unix(sudo:session): session closed for user root
Jul 02 19:44:57 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-59f17db3-3c8a-427e-92a5-9c366cbe9294 tempest-GroupSnapshotsTest-1838694738 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8a515fcc-92ae-4757-8f52-edbde39fd487" returned: 0 in 1.069s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:44:57 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-59f17db3-3c8a-427e-92a5-9c366cbe9294 tempest-GroupSnapshotsTest-1838694738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8a515fcc-92ae-4757-8f52-edbde39fd487,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8a515fcc-92ae-4757-8f52-edbde39fd487.42a20365-99d5-4c2e-a52f-f1b55361416f 1G {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:44:57 devstack sudo[90557]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8a515fcc-92ae-4757-8f52-edbde39fd487,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8a515fcc-92ae-4757-8f52-edbde39fd487.42a20365-99d5-4c2e-a52f-f1b55361416f 1G
Jul 02 19:44:57 devstack sudo[90557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:44:58 devstack sudo[90557]: pam_unix(sudo:session): session closed for user root
Jul 02 19:44:58 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-59f17db3-3c8a-427e-92a5-9c366cbe9294 tempest-GroupSnapshotsTest-1838694738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8a515fcc-92ae-4757-8f52-edbde39fd487,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8a515fcc-92ae-4757-8f52-edbde39fd487.42a20365-99d5-4c2e-a52f-f1b55361416f 1G" returned: 0 in 1.221s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:44:58 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-59f17db3-3c8a-427e-92a5-9c366cbe9294 tempest-GroupSnapshotsTest-1838694738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8a515fcc-92ae-4757-8f52-edbde39fd487 -F qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8a515fcc-92ae-4757-8f52-edbde39fd487.42a20365-99d5-4c2e-a52f-f1b55361416f {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:44:58 devstack sudo[90568]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8a515fcc-92ae-4757-8f52-edbde39fd487 -F qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8a515fcc-92ae-4757-8f52-edbde39fd487.42a20365-99d5-4c2e-a52f-f1b55361416f
Jul 02 19:44:58 devstack sudo[90568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:44:59 devstack sudo[90568]: pam_unix(sudo:session): session closed for user root
Jul 02 19:44:59 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-59f17db3-3c8a-427e-92a5-9c366cbe9294 tempest-GroupSnapshotsTest-1838694738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8a515fcc-92ae-4757-8f52-edbde39fd487 -F qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8a515fcc-92ae-4757-8f52-edbde39fd487.42a20365-99d5-4c2e-a52f-f1b55361416f" returned: 0 in 0.977s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:44:59 devstack cinder-volume[86639]: WARNING cinder.volume.drivers.remotefs [None req-59f17db3-3c8a-427e-92a5-9c366cbe9294 tempest-GroupSnapshotsTest-1838694738 None] /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8a515fcc-92ae-4757-8f52-edbde39fd487.42a20365-99d5-4c2e-a52f-f1b55361416f is being set with open permissions: ugo+rw: NotImplementedError
Jul 02 19:44:59 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-59f17db3-3c8a-427e-92a5-9c366cbe9294 tempest-GroupSnapshotsTest-1838694738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8a515fcc-92ae-4757-8f52-edbde39fd487.42a20365-99d5-4c2e-a52f-f1b55361416f {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:44:59 devstack sudo[90665]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8a515fcc-92ae-4757-8f52-edbde39fd487.42a20365-99d5-4c2e-a52f-f1b55361416f
Jul 02 19:44:59 devstack sudo[90665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:45:00 devstack sudo[90665]: pam_unix(sudo:session): session closed for user root
Jul 02 19:45:00 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-59f17db3-3c8a-427e-92a5-9c366cbe9294 tempest-GroupSnapshotsTest-1838694738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8a515fcc-92ae-4757-8f52-edbde39fd487.42a20365-99d5-4c2e-a52f-f1b55361416f" returned: 0 in 0.981s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:45:00 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-59f17db3-3c8a-427e-92a5-9c366cbe9294 tempest-GroupSnapshotsTest-1838694738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8a515fcc-92ae-4757-8f52-edbde39fd487.info {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:45:00 devstack sudo[90668]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8a515fcc-92ae-4757-8f52-edbde39fd487.info
Jul 02 19:45:00 devstack sudo[90668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:45:01 devstack sudo[90668]: pam_unix(sudo:session): session closed for user root
Jul 02 19:45:01 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-59f17db3-3c8a-427e-92a5-9c366cbe9294 tempest-GroupSnapshotsTest-1838694738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8a515fcc-92ae-4757-8f52-edbde39fd487.info" returned: 0 in 0.869s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:45:01 devstack cinder-volume[86639]: WARNING cinder.volume.drivers.remotefs [None req-59f17db3-3c8a-427e-92a5-9c366cbe9294 tempest-GroupSnapshotsTest-1838694738 None] /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8a515fcc-92ae-4757-8f52-edbde39fd487.info is being set with open permissions: ugo+rw: NotImplementedError
Jul 02 19:45:01 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-59f17db3-3c8a-427e-92a5-9c366cbe9294 tempest-GroupSnapshotsTest-1838694738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8a515fcc-92ae-4757-8f52-edbde39fd487.info {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:45:01 devstack sudo[90681]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8a515fcc-92ae-4757-8f52-edbde39fd487.info
Jul 02 19:45:01 devstack sudo[90681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:45:02 devstack sudo[90681]: pam_unix(sudo:session): session closed for user root
Jul 02 19:45:02 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-59f17db3-3c8a-427e-92a5-9c366cbe9294 tempest-GroupSnapshotsTest-1838694738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8a515fcc-92ae-4757-8f52-edbde39fd487.info" returned: 0 in 1.120s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:45:03 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-59f17db3-3c8a-427e-92a5-9c366cbe9294 tempest-GroupSnapshotsTest-1838694738 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.454s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:45:03 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-e5e02765-e70c-416a-9ed9-ed753a6e7fa4 tempest-TaggedAttachmentsTest-241125395 None] Acquiring lock "cinder-d5e3a764-cfac-4230-aa76-026ddf2e9a5f-delete_volume" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:45:03 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-e5e02765-e70c-416a-9ed9-ed753a6e7fa4 tempest-TaggedAttachmentsTest-241125395 None] Lock "cinder-d5e3a764-cfac-4230-aa76-026ddf2e9a5f-delete_volume" acquired by "delete_volume" :: waited 0.092s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:45:03 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-e5e02765-e70c-416a-9ed9-ed753a6e7fa4 tempest-TaggedAttachmentsTest-241125395 None] Acquiring lock "cinder-quobyte-d5e3a764-cfac-4230-aa76-026ddf2e9a5f" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:45:03 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-e5e02765-e70c-416a-9ed9-ed753a6e7fa4 tempest-TaggedAttachmentsTest-241125395 None] Lock "cinder-quobyte-d5e3a764-cfac-4230-aa76-026ddf2e9a5f" acquired by "delete_volume" :: waited 0.033s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:45:03 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[3df40236-e602-4a74-b972-3b04d1689b09]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 19:45:03 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-e5e02765-e70c-416a-9ed9-ed753a6e7fa4 tempest-TaggedAttachmentsTest-241125395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-d5e3a764-cfac-4230-aa76-026ddf2e9a5f {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:45:03 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-59f17db3-3c8a-427e-92a5-9c366cbe9294 tempest-GroupSnapshotsTest-1838694738 None] group_snapshot 0dd2994c-7463-4352-addb-2e2e32b6e821: created successfully
Jul 02 19:45:03 devstack sudo[91044]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-d5e3a764-cfac-4230-aa76-026ddf2e9a5f
Jul 02 19:45:03 devstack sudo[91044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:45:04 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-510bd123-8f4a-4a8c-9965-f63103da5cbc tempest-GroupSnapshotsTest-1838694738 None] group_snapshot 0dd2994c-7463-4352-addb-2e2e32b6e821: deleting
Jul 02 19:45:04 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-510bd123-8f4a-4a8c-9965-f63103da5cbc tempest-GroupSnapshotsTest-1838694738 None] group_snapshot 0dd2994c-7463-4352-addb-2e2e32b6e821: deleting {{(pid=86639) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Jul 02 19:45:04 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-510bd123-8f4a-4a8c-9965-f63103da5cbc tempest-GroupSnapshotsTest-1838694738 None] Acquiring lock "cinder-quobyte-3c6df81f-bbbd-477c-b51e-195a2f2d1e52" by "delete_snapshot" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:45:04 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-510bd123-8f4a-4a8c-9965-f63103da5cbc tempest-GroupSnapshotsTest-1838694738 None] Lock "cinder-quobyte-3c6df81f-bbbd-477c-b51e-195a2f2d1e52" acquired by "delete_snapshot" :: waited 0.070s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:45:04 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-510bd123-8f4a-4a8c-9965-f63103da5cbc tempest-GroupSnapshotsTest-1838694738 None] Acquiring lock "cinder-quobyte-20f788dc-5f8d-48d4-9d44-43cc0e911008" by "_delete_snapshot" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:45:04 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-510bd123-8f4a-4a8c-9965-f63103da5cbc tempest-GroupSnapshotsTest-1838694738 None] Lock "cinder-quobyte-20f788dc-5f8d-48d4-9d44-43cc0e911008" acquired by "_delete_snapshot" :: waited 0.050s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:45:04 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-510bd123-8f4a-4a8c-9965-f63103da5cbc tempest-GroupSnapshotsTest-1838694738 None] Deleting offline snapshot 20f788dc-5f8d-48d4-9d44-43cc0e911008 of volume 3c6df81f-bbbd-477c-b51e-195a2f2d1e52 {{(pid=86639) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 02 19:45:04 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-510bd123-8f4a-4a8c-9965-f63103da5cbc tempest-GroupSnapshotsTest-1838694738 None] snapshot_file for this snap is: volume-3c6df81f-bbbd-477c-b51e-195a2f2d1e52.20f788dc-5f8d-48d4-9d44-43cc0e911008 {{(pid=86639) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 02 19:45:04 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[f31ed031-70bd-4a5f-9ada-61af9cac8602]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 19:45:04 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-510bd123-8f4a-4a8c-9965-f63103da5cbc tempest-GroupSnapshotsTest-1838694738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-3c6df81f-bbbd-477c-b51e-195a2f2d1e52.20f788dc-5f8d-48d4-9d44-43cc0e911008 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:45:04 devstack sudo[91076]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-3c6df81f-bbbd-477c-b51e-195a2f2d1e52.20f788dc-5f8d-48d4-9d44-43cc0e911008
Jul 02 19:45:04 devstack sudo[91076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:45:05 devstack sudo[91044]: pam_unix(sudo:session): session closed for user root
Jul 02 19:45:05 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-e5e02765-e70c-416a-9ed9-ed753a6e7fa4 tempest-TaggedAttachmentsTest-241125395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-d5e3a764-cfac-4230-aa76-026ddf2e9a5f" returned: 0 in 1.693s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:45:05 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-e5e02765-e70c-416a-9ed9-ed753a6e7fa4 tempest-TaggedAttachmentsTest-241125395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-d5e3a764-cfac-4230-aa76-026ddf2e9a5f {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:45:05 devstack sudo[91083]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-d5e3a764-cfac-4230-aa76-026ddf2e9a5f
Jul 02 19:45:05 devstack sudo[91083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:45:05 devstack sudo[91076]: pam_unix(sudo:session): session closed for user root
Jul 02 19:45:05 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-510bd123-8f4a-4a8c-9965-f63103da5cbc tempest-GroupSnapshotsTest-1838694738 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-3c6df81f-bbbd-477c-b51e-195a2f2d1e52.20f788dc-5f8d-48d4-9d44-43cc0e911008" returned: 0 in 1.087s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:45:05 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-510bd123-8f4a-4a8c-9965-f63103da5cbc tempest-GroupSnapshotsTest-1838694738 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3c6df81f-bbbd-477c-b51e-195a2f2d1e52(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86639) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 02 19:45:05 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[17353fe6-da62-40af-9509-d88cb983b764]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 19:45:05 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-510bd123-8f4a-4a8c-9965-f63103da5cbc tempest-GroupSnapshotsTest-1838694738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-3c6df81f-bbbd-477c-b51e-195a2f2d1e52 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:45:05 devstack sudo[91088]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-3c6df81f-bbbd-477c-b51e-195a2f2d1e52
Jul 02 19:45:05 devstack sudo[91088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:45:06 devstack sudo[91083]: pam_unix(sudo:session): session closed for user root
Jul 02 19:45:06 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-e5e02765-e70c-416a-9ed9-ed753a6e7fa4 tempest-TaggedAttachmentsTest-241125395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-d5e3a764-cfac-4230-aa76-026ddf2e9a5f" returned: 0 in 1.171s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:45:06 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-e5e02765-e70c-416a-9ed9-ed753a6e7fa4 tempest-TaggedAttachmentsTest-241125395 None] Lock "cinder-quobyte-d5e3a764-cfac-4230-aa76-026ddf2e9a5f" released by "delete_volume" :: held 2.972s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:45:06 devstack cinder-volume[86639]: DEBUG cinder.quota [None req-e5e02765-e70c-416a-9ed9-ed753a6e7fa4 tempest-TaggedAttachmentsTest-241125395 None] Created reservations ['6ee8d6c7-23a8-4ea7-bd38-b5ee75a267bd', '244c6955-1ebe-4c7d-9c80-80509865aa1b', 'c2df244c-1979-4724-a8f7-6aec9ca5c027', 'db963be2-287a-40e9-a397-9aedbaa08062'] {{(pid=86639) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 19:45:06 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-e5e02765-e70c-416a-9ed9-ed753a6e7fa4 tempest-TaggedAttachmentsTest-241125395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:45:06 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-e5e02765-e70c-416a-9ed9-ed753a6e7fa4 tempest-TaggedAttachmentsTest-241125395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:45:06 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-e5e02765-e70c-416a-9ed9-ed753a6e7fa4 tempest-TaggedAttachmentsTest-241125395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 19:45:06 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-e5e02765-e70c-416a-9ed9-ed753a6e7fa4 tempest-TaggedAttachmentsTest-241125395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 19:45:06 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-e5e02765-e70c-416a-9ed9-ed753a6e7fa4 tempest-TaggedAttachmentsTest-241125395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:45:06 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-e5e02765-e70c-416a-9ed9-ed753a6e7fa4 tempest-TaggedAttachmentsTest-241125395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:45:06 devstack sudo[91093]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e
Jul 02 19:45:06 devstack sudo[91093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:45:07 devstack sudo[91088]: pam_unix(sudo:session): session closed for user root
Jul 02 19:45:07 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-510bd123-8f4a-4a8c-9965-f63103da5cbc tempest-GroupSnapshotsTest-1838694738 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-3c6df81f-bbbd-477c-b51e-195a2f2d1e52" returned: 0 in 1.656s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:45:07 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-510bd123-8f4a-4a8c-9965-f63103da5cbc tempest-GroupSnapshotsTest-1838694738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-3c6df81f-bbbd-477c-b51e-195a2f2d1e52.20f788dc-5f8d-48d4-9d44-43cc0e911008 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:45:07 devstack sudo[91098]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-3c6df81f-bbbd-477c-b51e-195a2f2d1e52.20f788dc-5f8d-48d4-9d44-43cc0e911008
Jul 02 19:45:07 devstack sudo[91098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:45:08 devstack sudo[91093]: pam_unix(sudo:session): session closed for user root
Jul 02 19:45:08 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-e5e02765-e70c-416a-9ed9-ed753a6e7fa4 tempest-TaggedAttachmentsTest-241125395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e" returned: 0 in 1.855s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:45:08 devstack cinder-volume[86639]: DEBUG cinder.manager [None req-e5e02765-e70c-416a-9ed9-ed753a6e7fa4 tempest-TaggedAttachmentsTest-241125395 None] Notifying Schedulers of capabilities ... {{(pid=86639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 19:45:08 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-e5e02765-e70c-416a-9ed9-ed753a6e7fa4 tempest-TaggedAttachmentsTest-241125395 None] Deleted volume successfully.
Jul 02 19:45:08 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-e5e02765-e70c-416a-9ed9-ed753a6e7fa4 tempest-TaggedAttachmentsTest-241125395 None] Lock "cinder-d5e3a764-cfac-4230-aa76-026ddf2e9a5f-delete_volume" released by "delete_volume" :: held 5.260s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:45:08 devstack sudo[91098]: pam_unix(sudo:session): session closed for user root
Jul 02 19:45:08 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-510bd123-8f4a-4a8c-9965-f63103da5cbc tempest-GroupSnapshotsTest-1838694738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-3c6df81f-bbbd-477c-b51e-195a2f2d1e52.20f788dc-5f8d-48d4-9d44-43cc0e911008" returned: 0 in 1.445s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:45:08 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-510bd123-8f4a-4a8c-9965-f63103da5cbc tempest-GroupSnapshotsTest-1838694738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-3c6df81f-bbbd-477c-b51e-195a2f2d1e52.20f788dc-5f8d-48d4-9d44-43cc0e911008 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:45:08 devstack sudo[91109]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-3c6df81f-bbbd-477c-b51e-195a2f2d1e52.20f788dc-5f8d-48d4-9d44-43cc0e911008
Jul 02 19:45:08 devstack sudo[91109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:45:09 devstack sudo[91109]: pam_unix(sudo:session): session closed for user root
Jul 02 19:45:09 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-510bd123-8f4a-4a8c-9965-f63103da5cbc tempest-GroupSnapshotsTest-1838694738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-3c6df81f-bbbd-477c-b51e-195a2f2d1e52.20f788dc-5f8d-48d4-9d44-43cc0e911008" returned: 0 in 1.184s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:45:10 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-510bd123-8f4a-4a8c-9965-f63103da5cbc tempest-GroupSnapshotsTest-1838694738 None] Lock "cinder-quobyte-20f788dc-5f8d-48d4-9d44-43cc0e911008" released by "_delete_snapshot" :: held 5.582s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:45:10 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-510bd123-8f4a-4a8c-9965-f63103da5cbc tempest-GroupSnapshotsTest-1838694738 None] Lock "cinder-quobyte-3c6df81f-bbbd-477c-b51e-195a2f2d1e52" released by "delete_snapshot" :: held 5.651s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:45:10 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-510bd123-8f4a-4a8c-9965-f63103da5cbc tempest-GroupSnapshotsTest-1838694738 None] Acquiring lock "cinder-quobyte-8a515fcc-92ae-4757-8f52-edbde39fd487" by "delete_snapshot" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:45:10 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-510bd123-8f4a-4a8c-9965-f63103da5cbc tempest-GroupSnapshotsTest-1838694738 None] Lock "cinder-quobyte-8a515fcc-92ae-4757-8f52-edbde39fd487" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:45:10 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-510bd123-8f4a-4a8c-9965-f63103da5cbc tempest-GroupSnapshotsTest-1838694738 None] Acquiring lock "cinder-quobyte-42a20365-99d5-4c2e-a52f-f1b55361416f" by "_delete_snapshot" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:45:10 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-510bd123-8f4a-4a8c-9965-f63103da5cbc tempest-GroupSnapshotsTest-1838694738 None] Lock "cinder-quobyte-42a20365-99d5-4c2e-a52f-f1b55361416f" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:45:10 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-510bd123-8f4a-4a8c-9965-f63103da5cbc tempest-GroupSnapshotsTest-1838694738 None] Deleting offline snapshot 42a20365-99d5-4c2e-a52f-f1b55361416f of volume 8a515fcc-92ae-4757-8f52-edbde39fd487 {{(pid=86639) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 02 19:45:10 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-510bd123-8f4a-4a8c-9965-f63103da5cbc tempest-GroupSnapshotsTest-1838694738 None] snapshot_file for this snap is: volume-8a515fcc-92ae-4757-8f52-edbde39fd487.42a20365-99d5-4c2e-a52f-f1b55361416f {{(pid=86639) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 02 19:45:10 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e06ad8d-cdf6-403a-bd9d-3eb0ee75c901]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 19:45:10 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-510bd123-8f4a-4a8c-9965-f63103da5cbc tempest-GroupSnapshotsTest-1838694738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8a515fcc-92ae-4757-8f52-edbde39fd487.42a20365-99d5-4c2e-a52f-f1b55361416f {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:45:10 devstack sudo[91115]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8a515fcc-92ae-4757-8f52-edbde39fd487.42a20365-99d5-4c2e-a52f-f1b55361416f
Jul 02 19:45:10 devstack sudo[91115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:45:11 devstack sudo[91115]: pam_unix(sudo:session): session closed for user root
Jul 02 19:45:11 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-510bd123-8f4a-4a8c-9965-f63103da5cbc tempest-GroupSnapshotsTest-1838694738 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8a515fcc-92ae-4757-8f52-edbde39fd487.42a20365-99d5-4c2e-a52f-f1b55361416f" returned: 0 in 1.495s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:45:11 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-510bd123-8f4a-4a8c-9965-f63103da5cbc tempest-GroupSnapshotsTest-1838694738 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8a515fcc-92ae-4757-8f52-edbde39fd487(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86639) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 02 19:45:11 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bfc862f-dd71-43f6-8140-fc2572b3f1c2]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 19:45:11 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-510bd123-8f4a-4a8c-9965-f63103da5cbc tempest-GroupSnapshotsTest-1838694738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8a515fcc-92ae-4757-8f52-edbde39fd487 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:45:11 devstack sudo[91125]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8a515fcc-92ae-4757-8f52-edbde39fd487
Jul 02 19:45:11 devstack sudo[91125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:45:13 devstack sudo[91125]: pam_unix(sudo:session): session closed for user root
Jul 02 19:45:13 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-510bd123-8f4a-4a8c-9965-f63103da5cbc tempest-GroupSnapshotsTest-1838694738 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8a515fcc-92ae-4757-8f52-edbde39fd487" returned: 0 in 1.650s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:45:13 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-510bd123-8f4a-4a8c-9965-f63103da5cbc tempest-GroupSnapshotsTest-1838694738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8a515fcc-92ae-4757-8f52-edbde39fd487.42a20365-99d5-4c2e-a52f-f1b55361416f {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:45:13 devstack sudo[91131]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8a515fcc-92ae-4757-8f52-edbde39fd487.42a20365-99d5-4c2e-a52f-f1b55361416f
Jul 02 19:45:13 devstack sudo[91131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:45:14 devstack cinder-volume[86639]: DEBUG dbcounter [-] [86639] Writing DB stats cinder:UPDATE=61,cinder:SELECT=71,cinder:INSERT=9,cinder:DELETE=2 {{(pid=86639) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 02 19:45:14 devstack cinder-volume[86639]: DEBUG dbcounter [-] [86639] Writing DB stats cinder:UPDATE=60,cinder:SELECT=73,cinder:INSERT=15,cinder:DELETE=3 {{(pid=86639) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 02 19:45:14 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [req-803eae72-799b-40a1-bbd5-1aec4fed4389 req-1ddc514f-b717-419a-97ea-f2552f746d7b tempest-ServerActionsTestOtherA-1484119296 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:45:14 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [req-803eae72-799b-40a1-bbd5-1aec4fed4389 req-1ddc514f-b717-419a-97ea-f2552f746d7b tempest-ServerActionsTestOtherA-1484119296 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.010s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:45:14 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[e89df126-d6d5-4ffd-b7cb-a5da3830b733]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 19:45:14 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [req-803eae72-799b-40a1-bbd5-1aec4fed4389 req-1ddc514f-b717-419a-97ea-f2552f746d7b tempest-ServerActionsTestOtherA-1484119296 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-76021e4b-1f91-419e-8f4e-07e754df6bf3 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:45:14 devstack sudo[91131]: pam_unix(sudo:session): session closed for user root
Jul 02 19:45:14 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-510bd123-8f4a-4a8c-9965-f63103da5cbc tempest-GroupSnapshotsTest-1838694738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8a515fcc-92ae-4757-8f52-edbde39fd487.42a20365-99d5-4c2e-a52f-f1b55361416f" returned: 0 in 1.460s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:45:14 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-510bd123-8f4a-4a8c-9965-f63103da5cbc tempest-GroupSnapshotsTest-1838694738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8a515fcc-92ae-4757-8f52-edbde39fd487.42a20365-99d5-4c2e-a52f-f1b55361416f {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:45:14 devstack sudo[91147]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8a515fcc-92ae-4757-8f52-edbde39fd487.42a20365-99d5-4c2e-a52f-f1b55361416f
Jul 02 19:45:14 devstack sudo[91147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:45:15 devstack sudo[91146]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-76021e4b-1f91-419e-8f4e-07e754df6bf3
Jul 02 19:45:15 devstack sudo[91146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:45:15 devstack sudo[91147]: pam_unix(sudo:session): session closed for user root
Jul 02 19:45:15 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-510bd123-8f4a-4a8c-9965-f63103da5cbc tempest-GroupSnapshotsTest-1838694738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8a515fcc-92ae-4757-8f52-edbde39fd487.42a20365-99d5-4c2e-a52f-f1b55361416f" returned: 0 in 1.001s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:45:16 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-510bd123-8f4a-4a8c-9965-f63103da5cbc tempest-GroupSnapshotsTest-1838694738 None] Lock "cinder-quobyte-42a20365-99d5-4c2e-a52f-f1b55361416f" released by "_delete_snapshot" :: held 5.815s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:45:16 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-510bd123-8f4a-4a8c-9965-f63103da5cbc tempest-GroupSnapshotsTest-1838694738 None] Lock "cinder-quobyte-8a515fcc-92ae-4757-8f52-edbde39fd487" released by "delete_snapshot" :: held 5.877s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:45:16 devstack cinder-volume[86639]: WARNING cinder.quota [None req-510bd123-8f4a-4a8c-9965-f63103da5cbc tempest-GroupSnapshotsTest-1838694738 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1555076488 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1555076488, it is now deprecated. Please use the default quota class for default quota.
Jul 02 19:45:16 devstack cinder-volume[86639]: WARNING cinder.quota [None req-510bd123-8f4a-4a8c-9965-f63103da5cbc tempest-GroupSnapshotsTest-1838694738 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1555076488 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1555076488, it is now deprecated. Please use the default quota class for default quota.
Jul 02 19:45:16 devstack cinder-volume[86639]: DEBUG cinder.quota [None req-510bd123-8f4a-4a8c-9965-f63103da5cbc tempest-GroupSnapshotsTest-1838694738 None] Created reservations ['4fd6ca72-2380-4c4b-ac74-e18ef9f6c60d', 'b9618691-696c-47e6-8ede-3231fc104eee', 'db49aac9-e496-4347-ad68-922b55fa1441', 'b4fc5c1a-8fe2-4e15-8ca4-5570d4b1f282'] {{(pid=86639) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 19:45:16 devstack sudo[91146]: pam_unix(sudo:session): session closed for user root
Jul 02 19:45:16 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [req-803eae72-799b-40a1-bbd5-1aec4fed4389 req-1ddc514f-b717-419a-97ea-f2552f746d7b tempest-ServerActionsTestOtherA-1484119296 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-76021e4b-1f91-419e-8f4e-07e754df6bf3" returned: 0 in 1.647s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:45:16 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [req-803eae72-799b-40a1-bbd5-1aec4fed4389 req-1ddc514f-b717-419a-97ea-f2552f746d7b tempest-ServerActionsTestOtherA-1484119296 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.713s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:45:16 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [req-803eae72-799b-40a1-bbd5-1aec4fed4389 req-1ddc514f-b717-419a-97ea-f2552f746d7b tempest-ServerActionsTestOtherA-1484119296 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92', 'name': 'volume-76021e4b-1f91-419e-8f4e-07e754df6bf3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9103ce30-24c7-46f2-88c2-5b7952269a8e', 'enforce_multipath': True} {{(pid=86639) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 02 19:45:16 devstack cinder-volume[86639]: DEBUG cinder.quota [None req-510bd123-8f4a-4a8c-9965-f63103da5cbc tempest-GroupSnapshotsTest-1838694738 None] Created reservations ['e254305e-287f-4b4e-adac-2356ab1e6258', '6af10b40-e925-4db6-8cf8-81548bb5d6f5', 'af9f215d-c771-4f56-9017-ea55a0f1f85e', '2037423a-c772-4e2d-8ea8-abdc52cd1be6'] {{(pid=86639) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 19:45:16 devstack cinder-volume[86639]: INFO cinder.volume.manager [req-803eae72-799b-40a1-bbd5-1aec4fed4389 req-1ddc514f-b717-419a-97ea-f2552f746d7b tempest-ServerActionsTestOtherA-1484119296 None] attachment_update completed successfully.
Jul 02 19:45:16 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-510bd123-8f4a-4a8c-9965-f63103da5cbc tempest-GroupSnapshotsTest-1838694738 None] group_snapshot 0dd2994c-7463-4352-addb-2e2e32b6e821: deleted successfully
Jul 02 19:45:18 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-f7e0c75c-6c06-4bba-bb5e-905ed96cb741 tempest-GroupSnapshotsTest-1838694738 None] Acquiring lock "cinder-quobyte-3c6df81f-bbbd-477c-b51e-195a2f2d1e52" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:45:18 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-f7e0c75c-6c06-4bba-bb5e-905ed96cb741 tempest-GroupSnapshotsTest-1838694738 None] Lock "cinder-quobyte-3c6df81f-bbbd-477c-b51e-195a2f2d1e52" acquired by "delete_volume" :: waited 0.042s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:45:18 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b8e7008-c048-4c76-8b02-ec5989fc73a9]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 19:45:18 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-f7e0c75c-6c06-4bba-bb5e-905ed96cb741 tempest-GroupSnapshotsTest-1838694738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-3c6df81f-bbbd-477c-b51e-195a2f2d1e52 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:45:18 devstack sudo[91171]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-3c6df81f-bbbd-477c-b51e-195a2f2d1e52
Jul 02 19:45:18 devstack sudo[91171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:45:20 devstack sudo[91171]: pam_unix(sudo:session): session closed for user root
Jul 02 19:45:20 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-f7e0c75c-6c06-4bba-bb5e-905ed96cb741 tempest-GroupSnapshotsTest-1838694738 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-3c6df81f-bbbd-477c-b51e-195a2f2d1e52" returned: 0 in 1.581s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:45:20 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-f7e0c75c-6c06-4bba-bb5e-905ed96cb741 tempest-GroupSnapshotsTest-1838694738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-3c6df81f-bbbd-477c-b51e-195a2f2d1e52 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:45:20 devstack sudo[91245]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-3c6df81f-bbbd-477c-b51e-195a2f2d1e52
Jul 02 19:45:20 devstack sudo[91245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:45:21 devstack sudo[91245]: pam_unix(sudo:session): session closed for user root
Jul 02 19:45:21 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-f7e0c75c-6c06-4bba-bb5e-905ed96cb741 tempest-GroupSnapshotsTest-1838694738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-3c6df81f-bbbd-477c-b51e-195a2f2d1e52" returned: 0 in 1.291s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:45:21 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-f7e0c75c-6c06-4bba-bb5e-905ed96cb741 tempest-GroupSnapshotsTest-1838694738 None] Lock "cinder-quobyte-3c6df81f-bbbd-477c-b51e-195a2f2d1e52" released by "delete_volume" :: held 3.043s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:45:21 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-f7e0c75c-6c06-4bba-bb5e-905ed96cb741 tempest-GroupSnapshotsTest-1838694738 None] Acquiring lock "cinder-quobyte-8a515fcc-92ae-4757-8f52-edbde39fd487" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:45:21 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-f7e0c75c-6c06-4bba-bb5e-905ed96cb741 tempest-GroupSnapshotsTest-1838694738 None] Lock "cinder-quobyte-8a515fcc-92ae-4757-8f52-edbde39fd487" acquired by "delete_volume" :: waited 0.044s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:45:21 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b8f8904-5784-498c-a474-df81e8c291e3]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 19:45:21 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-f7e0c75c-6c06-4bba-bb5e-905ed96cb741 tempest-GroupSnapshotsTest-1838694738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8a515fcc-92ae-4757-8f52-edbde39fd487 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:45:21 devstack sudo[91250]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8a515fcc-92ae-4757-8f52-edbde39fd487
Jul 02 19:45:21 devstack sudo[91250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:45:22 devstack sudo[91250]: pam_unix(sudo:session): session closed for user root
Jul 02 19:45:22 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-f7e0c75c-6c06-4bba-bb5e-905ed96cb741 tempest-GroupSnapshotsTest-1838694738 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8a515fcc-92ae-4757-8f52-edbde39fd487" returned: 0 in 1.318s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:45:22 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-f7e0c75c-6c06-4bba-bb5e-905ed96cb741 tempest-GroupSnapshotsTest-1838694738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8a515fcc-92ae-4757-8f52-edbde39fd487 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:45:22 devstack sudo[91257]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8a515fcc-92ae-4757-8f52-edbde39fd487
Jul 02 19:45:22 devstack sudo[91257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:45:24 devstack sudo[91257]: pam_unix(sudo:session): session closed for user root
Jul 02 19:45:24 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-f7e0c75c-6c06-4bba-bb5e-905ed96cb741 tempest-GroupSnapshotsTest-1838694738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8a515fcc-92ae-4757-8f52-edbde39fd487" returned: 0 in 1.130s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:45:24 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-f7e0c75c-6c06-4bba-bb5e-905ed96cb741 tempest-GroupSnapshotsTest-1838694738 None] Lock "cinder-quobyte-8a515fcc-92ae-4757-8f52-edbde39fd487" released by "delete_volume" :: held 2.591s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:45:24 devstack cinder-volume[86639]: DEBUG cinder.quota [None req-f7e0c75c-6c06-4bba-bb5e-905ed96cb741 tempest-GroupSnapshotsTest-1838694738 None] Created reservations ['3b8b3849-a6bc-449a-9b55-f006783c6ad5'] {{(pid=86639) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 19:45:24 devstack cinder-volume[86639]: WARNING cinder.quota [None req-f7e0c75c-6c06-4bba-bb5e-905ed96cb741 tempest-GroupSnapshotsTest-1838694738 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1555076488 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1555076488, it is now deprecated. Please use the default quota class for default quota.
Jul 02 19:45:24 devstack cinder-volume[86639]: DEBUG cinder.quota [None req-f7e0c75c-6c06-4bba-bb5e-905ed96cb741 tempest-GroupSnapshotsTest-1838694738 None] Created reservations ['bdd41f7a-3d85-489a-ae80-23e6cdef7a84', '2514c99a-1d3e-40ec-8184-0cc36f8742d9', 'b869eacd-2ad0-4b76-b1fd-93a1d3c04bd3', 'c6924c89-e5f9-460b-8bde-ae4d21acb3fc'] {{(pid=86639) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 19:45:24 devstack cinder-volume[86639]: DEBUG cinder.quota [None req-f7e0c75c-6c06-4bba-bb5e-905ed96cb741 tempest-GroupSnapshotsTest-1838694738 None] Created reservations ['27fc0951-20f1-4668-9ace-5f2ea115ae15', 'e5a6508e-c9f0-44e0-a0ea-a2b99f4ac494', '4186d5c7-50e7-4eef-8055-0221748d8c9a', '1fef574e-d79f-498f-80a8-09987dc1e89d'] {{(pid=86639) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 19:45:24 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-f7e0c75c-6c06-4bba-bb5e-905ed96cb741 tempest-GroupSnapshotsTest-1838694738 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:45:24 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-f7e0c75c-6c06-4bba-bb5e-905ed96cb741 tempest-GroupSnapshotsTest-1838694738 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:45:24 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-f7e0c75c-6c06-4bba-bb5e-905ed96cb741 tempest-GroupSnapshotsTest-1838694738 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 19:45:24 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-f7e0c75c-6c06-4bba-bb5e-905ed96cb741 tempest-GroupSnapshotsTest-1838694738 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 19:45:24 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-f7e0c75c-6c06-4bba-bb5e-905ed96cb741 tempest-GroupSnapshotsTest-1838694738 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:45:24 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-f7e0c75c-6c06-4bba-bb5e-905ed96cb741 tempest-GroupSnapshotsTest-1838694738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:45:24 devstack sudo[91263]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e
Jul 02 19:45:24 devstack sudo[91263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:45:25 devstack sudo[91263]: pam_unix(sudo:session): session closed for user root
Jul 02 19:45:25 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-f7e0c75c-6c06-4bba-bb5e-905ed96cb741 tempest-GroupSnapshotsTest-1838694738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e" returned: 0 in 0.979s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:45:25 devstack cinder-volume[86639]: DEBUG cinder.manager [None req-f7e0c75c-6c06-4bba-bb5e-905ed96cb741 tempest-GroupSnapshotsTest-1838694738 None] Notifying Schedulers of capabilities ... {{(pid=86639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 19:45:25 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-f7e0c75c-6c06-4bba-bb5e-905ed96cb741 tempest-GroupSnapshotsTest-1838694738 None] Delete group completed successfully.
Jul 02 19:45:26 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-104a3b78-96ad-4306-a6b5-640403767d53 tempest-GroupSnapshotsTest-1838694738 None] Group tempest-GroupSnapshotsTest-Group-1610812333: creating
Jul 02 19:45:26 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-104a3b78-96ad-4306-a6b5-640403767d53 tempest-GroupSnapshotsTest-1838694738 None] Group tempest-GroupSnapshotsTest-Group-1610812333: created successfully
Jul 02 19:45:26 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-104a3b78-96ad-4306-a6b5-640403767d53 tempest-GroupSnapshotsTest-1838694738 None] Create group completed successfully.
Jul 02 19:45:27 devstack cinder-volume[86639]: INFO cinder.volume.manager [req-994ea432-1e17-485e-a0bf-40efb0d38d63 req-3fced9c6-5843-4efc-b3f4-0866a4b7ccc2 tempest-ServerActionsTestOtherA-1484119296 None] Terminate volume connection completed successfully.
Jul 02 19:45:27 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [req-994ea432-1e17-485e-a0bf-40efb0d38d63 req-3fced9c6-5843-4efc-b3f4-0866a4b7ccc2 tempest-ServerActionsTestOtherA-1484119296 None] Deleting attachment 9103ce30-24c7-46f2-88c2-5b7952269a8e. {{(pid=86639) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 02 19:45:28 devstack cinder-volume[86639]: DEBUG cinder.volume.flows.manager.create_volume [None req-4223a704-9850-40ef-b53e-78cc8cd19585 tempest-GroupSnapshotsTest-1838694738 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 19:45:28 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-4223a704-9850-40ef-b53e-78cc8cd19585 tempest-GroupSnapshotsTest-1838694738 None] Flow 'volume_create_manager' (67ab8a2d-8076-4e93-9661-352ef386ef44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 19:45:28 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-4223a704-9850-40ef-b53e-78cc8cd19585 tempest-GroupSnapshotsTest-1838694738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee4cd386-4664-46cf-aba8-8485dc6850ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:45:28 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-4223a704-9850-40ef-b53e-78cc8cd19585 tempest-GroupSnapshotsTest-1838694738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee4cd386-4664-46cf-aba8-8485dc6850ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T17:45:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-837036351',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=b37f3590-e687-4db0-b31c-6cafaf29555e,host='devstack@QuobyteHD#QuobyteHD',id=41421ebe-0fa2-4624-aeec-795b08ea4b61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccce40c931504b29be89afa73433e0c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T17:45:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T17:45:28Z,use_quota=True,user_id='cd296cf1e98f4d7da1f681631ac1253d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c74a6cbc-16ab-4827-9c25-efa482f413ff),volume_type_id=c74a6cbc-16ab-4827-9c25-efa482f413ff)' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:45:28 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-4223a704-9850-40ef-b53e-78cc8cd19585 tempest-GroupSnapshotsTest-1838694738 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (812ea4d9-d14a-4f0c-ac12-5eb60827066e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:45:28 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-4223a704-9850-40ef-b53e-78cc8cd19585 tempest-GroupSnapshotsTest-1838694738 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (812ea4d9-d14a-4f0c-ac12-5eb60827066e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:45:28 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-4223a704-9850-40ef-b53e-78cc8cd19585 tempest-GroupSnapshotsTest-1838694738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43d49bfe-0882-406f-b1ea-5a363c7f8500) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:45:28 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-4223a704-9850-40ef-b53e-78cc8cd19585 tempest-GroupSnapshotsTest-1838694738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43d49bfe-0882-406f-b1ea-5a363c7f8500) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '41421ebe-0fa2-4624-aeec-795b08ea4b61', 'volume_name': 'volume-41421ebe-0fa2-4624-aeec-795b08ea4b61', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:45:28 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-4223a704-9850-40ef-b53e-78cc8cd19585 tempest-GroupSnapshotsTest-1838694738 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0091ed7c-3865-4a66-ac68-e617a3766ddb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:45:28 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-4223a704-9850-40ef-b53e-78cc8cd19585 tempest-GroupSnapshotsTest-1838694738 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0091ed7c-3865-4a66-ac68-e617a3766ddb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:45:28 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-4223a704-9850-40ef-b53e-78cc8cd19585 tempest-GroupSnapshotsTest-1838694738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db55367c-730d-44e5-98da-0d41bec413fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:45:28 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-4223a704-9850-40ef-b53e-78cc8cd19585 tempest-GroupSnapshotsTest-1838694738 None] Volume 41421ebe-0fa2-4624-aeec-795b08ea4b61: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-41421ebe-0fa2-4624-aeec-795b08ea4b61', 'volume_size': 1}
Jul 02 19:45:28 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-4223a704-9850-40ef-b53e-78cc8cd19585 tempest-GroupSnapshotsTest-1838694738 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:45:28 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-4223a704-9850-40ef-b53e-78cc8cd19585 tempest-GroupSnapshotsTest-1838694738 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:45:28 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-4223a704-9850-40ef-b53e-78cc8cd19585 tempest-GroupSnapshotsTest-1838694738 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce906cb830>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=b37f3590-e687-4db0-b31c-6cafaf29555e,created_at=2026-07-02T17:45:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-837036351',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=b37f3590-e687-4db0-b31c-6cafaf29555e,host='devstack@QuobyteHD#QuobyteHD',id=41421ebe-0fa2-4624-aeec-795b08ea4b61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccce40c931504b29be89afa73433e0c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T17:45:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T17:45:28Z,use_quota=True,user_id='cd296cf1e98f4d7da1f681631ac1253d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c74a6cbc-16ab-4827-9c25-efa482f413ff),volume_type_id=c74a6cbc-16ab-4827-9c25-efa482f413ff)}" {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 19:45:28 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-4223a704-9850-40ef-b53e-78cc8cd19585 tempest-GroupSnapshotsTest-1838694738 None] Creating volume 41421ebe-0fa2-4624-aeec-795b08ea4b61 {{(pid=86639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 19:45:28 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-4223a704-9850-40ef-b53e-78cc8cd19585 tempest-GroupSnapshotsTest-1838694738 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:45:28 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-4223a704-9850-40ef-b53e-78cc8cd19585 tempest-GroupSnapshotsTest-1838694738 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:45:28 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-4223a704-9850-40ef-b53e-78cc8cd19585 tempest-GroupSnapshotsTest-1838694738 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 19:45:28 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-4223a704-9850-40ef-b53e-78cc8cd19585 tempest-GroupSnapshotsTest-1838694738 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 19:45:28 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-4223a704-9850-40ef-b53e-78cc8cd19585 tempest-GroupSnapshotsTest-1838694738 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:45:28 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-4223a704-9850-40ef-b53e-78cc8cd19585 tempest-GroupSnapshotsTest-1838694738 None] Selected osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92 as target Quobyte volume. {{(pid=86639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 19:45:28 devstack cinder-volume[86639]: INFO cinder.volume.drivers.remotefs [None req-4223a704-9850-40ef-b53e-78cc8cd19585 tempest-GroupSnapshotsTest-1838694738 None] casted to osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92
Jul 02 19:45:28 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-4223a704-9850-40ef-b53e-78cc8cd19585 tempest-GroupSnapshotsTest-1838694738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-41421ebe-0fa2-4624-aeec-795b08ea4b61 1073741824 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:45:28 devstack sudo[91311]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-41421ebe-0fa2-4624-aeec-795b08ea4b61 1073741824
Jul 02 19:45:28 devstack sudo[91311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:45:30 devstack sudo[91311]: pam_unix(sudo:session): session closed for user root
Jul 02 19:45:30 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-4223a704-9850-40ef-b53e-78cc8cd19585 tempest-GroupSnapshotsTest-1838694738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-41421ebe-0fa2-4624-aeec-795b08ea4b61 1073741824" returned: 0 in 1.492s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:45:30 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [req-994ea432-1e17-485e-a0bf-40efb0d38d63 req-35bd85dd-5305-488b-895c-7a0b2eb9ec96 tempest-ServerActionsTestOtherA-1484119296 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:45:30 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-4223a704-9850-40ef-b53e-78cc8cd19585 tempest-GroupSnapshotsTest-1838694738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-41421ebe-0fa2-4624-aeec-795b08ea4b61 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:45:30 devstack sudo[91344]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-41421ebe-0fa2-4624-aeec-795b08ea4b61
Jul 02 19:45:30 devstack sudo[91344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:45:31 devstack sudo[91344]: pam_unix(sudo:session): session closed for user root
Jul 02 19:45:31 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-4223a704-9850-40ef-b53e-78cc8cd19585 tempest-GroupSnapshotsTest-1838694738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-41421ebe-0fa2-4624-aeec-795b08ea4b61" returned: 0 in 0.849s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:45:31 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-4223a704-9850-40ef-b53e-78cc8cd19585 tempest-GroupSnapshotsTest-1838694738 None] <== create_volume: return (2418ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'} {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 19:45:31 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-4223a704-9850-40ef-b53e-78cc8cd19585 tempest-GroupSnapshotsTest-1838694738 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.424s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:45:31 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [req-994ea432-1e17-485e-a0bf-40efb0d38d63 req-35bd85dd-5305-488b-895c-7a0b2eb9ec96 tempest-ServerActionsTestOtherA-1484119296 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.900s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:45:31 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-4223a704-9850-40ef-b53e-78cc8cd19585 tempest-GroupSnapshotsTest-1838694738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db55367c-730d-44e5-98da-0d41bec413fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41421ebe-0fa2-4624-aeec-795b08ea4b61', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:45:31 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-4223a704-9850-40ef-b53e-78cc8cd19585 tempest-GroupSnapshotsTest-1838694738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2be729d7-0fef-45f8-bbe1-3c3a3daf089d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:45:31 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fa8c5c1-f7e8-4a05-91c3-00ac51114286]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 19:45:31 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [req-994ea432-1e17-485e-a0bf-40efb0d38d63 req-35bd85dd-5305-488b-895c-7a0b2eb9ec96 tempest-ServerActionsTestOtherA-1484119296 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-76021e4b-1f91-419e-8f4e-07e754df6bf3 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:45:31 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-4223a704-9850-40ef-b53e-78cc8cd19585 tempest-GroupSnapshotsTest-1838694738 None] Volume volume-41421ebe-0fa2-4624-aeec-795b08ea4b61 (41421ebe-0fa2-4624-aeec-795b08ea4b61): created successfully
Jul 02 19:45:31 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-4223a704-9850-40ef-b53e-78cc8cd19585 tempest-GroupSnapshotsTest-1838694738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2be729d7-0fef-45f8-bbe1-3c3a3daf089d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:45:31 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-4223a704-9850-40ef-b53e-78cc8cd19585 tempest-GroupSnapshotsTest-1838694738 None] Flow 'volume_create_manager' (67ab8a2d-8076-4e93-9661-352ef386ef44) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 19:45:31 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-4223a704-9850-40ef-b53e-78cc8cd19585 tempest-GroupSnapshotsTest-1838694738 None] Created volume successfully.
Jul 02 19:45:31 devstack sudo[91347]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-76021e4b-1f91-419e-8f4e-07e754df6bf3
Jul 02 19:45:31 devstack sudo[91347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:45:31 devstack cinder-volume[86639]: INFO cinder.volume.manager [req-36f3047f-c7ed-473f-92fc-bcc701c18014 req-71acb9f7-d924-4229-b3d4-5868b139a37f tempest-AttachVolumeTestJSON-1400825288 None] Terminate volume connection completed successfully.
Jul 02 19:45:31 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [req-36f3047f-c7ed-473f-92fc-bcc701c18014 req-71acb9f7-d924-4229-b3d4-5868b139a37f tempest-AttachVolumeTestJSON-1400825288 None] Deleting attachment 4edb7a37-ad5a-4f7c-a925-56cb0bedb8db. {{(pid=86639) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 02 19:45:32 devstack sudo[91347]: pam_unix(sudo:session): session closed for user root
Jul 02 19:45:32 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [req-994ea432-1e17-485e-a0bf-40efb0d38d63 req-35bd85dd-5305-488b-895c-7a0b2eb9ec96 tempest-ServerActionsTestOtherA-1484119296 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-76021e4b-1f91-419e-8f4e-07e754df6bf3" returned: 0 in 1.040s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:45:32 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [req-994ea432-1e17-485e-a0bf-40efb0d38d63 req-35bd85dd-5305-488b-895c-7a0b2eb9ec96 tempest-ServerActionsTestOtherA-1484119296 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.102s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:45:32 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [req-994ea432-1e17-485e-a0bf-40efb0d38d63 req-35bd85dd-5305-488b-895c-7a0b2eb9ec96 tempest-ServerActionsTestOtherA-1484119296 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92', 'name': 'volume-76021e4b-1f91-419e-8f4e-07e754df6bf3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6f4e023f-ea85-4f50-ac10-81b6f81c11f8', 'enforce_multipath': True} {{(pid=86639) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 02 19:45:32 devstack cinder-volume[86639]: INFO cinder.volume.manager [req-994ea432-1e17-485e-a0bf-40efb0d38d63 req-35bd85dd-5305-488b-895c-7a0b2eb9ec96 tempest-ServerActionsTestOtherA-1484119296 None] attachment_update completed successfully.
Jul 02 19:45:33 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-c3b05fee-5d7b-4f24-b3ee-a37ffba24fc7 tempest-GroupSnapshotsTest-1838694738 None] GroupSnapshot 62e9f30f-2ca6-4c4e-8fb0-02c7305f1ed4: creating.
Jul 02 19:45:33 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-c3b05fee-5d7b-4f24-b3ee-a37ffba24fc7 tempest-GroupSnapshotsTest-1838694738 None] Group snapshot 62e9f30f-2ca6-4c4e-8fb0-02c7305f1ed4: creating. {{(pid=86639) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Jul 02 19:45:33 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-c3b05fee-5d7b-4f24-b3ee-a37ffba24fc7 tempest-GroupSnapshotsTest-1838694738 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:45:33 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-c3b05fee-5d7b-4f24-b3ee-a37ffba24fc7 tempest-GroupSnapshotsTest-1838694738 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:45:33 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-c3b05fee-5d7b-4f24-b3ee-a37ffba24fc7 tempest-GroupSnapshotsTest-1838694738 None] Creating offline snapshot e72a3d0a-5741-48ad-8412-d89e2b6e24d3 of volume 41421ebe-0fa2-4624-aeec-795b08ea4b61 {{(pid=86639) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 02 19:45:33 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[5207a209-1902-40b9-adbe-af6fe030a8dc]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 19:45:33 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-c3b05fee-5d7b-4f24-b3ee-a37ffba24fc7 tempest-GroupSnapshotsTest-1838694738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-41421ebe-0fa2-4624-aeec-795b08ea4b61 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:45:33 devstack sudo[91364]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-41421ebe-0fa2-4624-aeec-795b08ea4b61
Jul 02 19:45:33 devstack sudo[91364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:45:34 devstack sudo[91364]: pam_unix(sudo:session): session closed for user root
Jul 02 19:45:34 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-c3b05fee-5d7b-4f24-b3ee-a37ffba24fc7 tempest-GroupSnapshotsTest-1838694738 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-41421ebe-0fa2-4624-aeec-795b08ea4b61" returned: 0 in 1.046s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:45:34 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-c3b05fee-5d7b-4f24-b3ee-a37ffba24fc7 tempest-GroupSnapshotsTest-1838694738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-41421ebe-0fa2-4624-aeec-795b08ea4b61,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-41421ebe-0fa2-4624-aeec-795b08ea4b61.e72a3d0a-5741-48ad-8412-d89e2b6e24d3 1G {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:45:34 devstack sudo[91369]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-41421ebe-0fa2-4624-aeec-795b08ea4b61,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-41421ebe-0fa2-4624-aeec-795b08ea4b61.e72a3d0a-5741-48ad-8412-d89e2b6e24d3 1G
Jul 02 19:45:34 devstack sudo[91369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:45:35 devstack sudo[91369]: pam_unix(sudo:session): session closed for user root
Jul 02 19:45:35 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-c3b05fee-5d7b-4f24-b3ee-a37ffba24fc7 tempest-GroupSnapshotsTest-1838694738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-41421ebe-0fa2-4624-aeec-795b08ea4b61,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-41421ebe-0fa2-4624-aeec-795b08ea4b61.e72a3d0a-5741-48ad-8412-d89e2b6e24d3 1G" returned: 0 in 1.638s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:45:35 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-c3b05fee-5d7b-4f24-b3ee-a37ffba24fc7 tempest-GroupSnapshotsTest-1838694738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-41421ebe-0fa2-4624-aeec-795b08ea4b61 -F qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-41421ebe-0fa2-4624-aeec-795b08ea4b61.e72a3d0a-5741-48ad-8412-d89e2b6e24d3 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:45:35 devstack sudo[91429]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-41421ebe-0fa2-4624-aeec-795b08ea4b61 -F qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-41421ebe-0fa2-4624-aeec-795b08ea4b61.e72a3d0a-5741-48ad-8412-d89e2b6e24d3
Jul 02 19:45:35 devstack sudo[91429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:45:36 devstack sudo[91429]: pam_unix(sudo:session): session closed for user root
Jul 02 19:45:36 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-c3b05fee-5d7b-4f24-b3ee-a37ffba24fc7 tempest-GroupSnapshotsTest-1838694738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-41421ebe-0fa2-4624-aeec-795b08ea4b61 -F qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-41421ebe-0fa2-4624-aeec-795b08ea4b61.e72a3d0a-5741-48ad-8412-d89e2b6e24d3" returned: 0 in 1.004s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:45:36 devstack cinder-volume[86639]: WARNING cinder.volume.drivers.remotefs [None req-c3b05fee-5d7b-4f24-b3ee-a37ffba24fc7 tempest-GroupSnapshotsTest-1838694738 None] /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-41421ebe-0fa2-4624-aeec-795b08ea4b61.e72a3d0a-5741-48ad-8412-d89e2b6e24d3 is being set with open permissions: ugo+rw: NotImplementedError
Jul 02 19:45:36 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-c3b05fee-5d7b-4f24-b3ee-a37ffba24fc7 tempest-GroupSnapshotsTest-1838694738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-41421ebe-0fa2-4624-aeec-795b08ea4b61.e72a3d0a-5741-48ad-8412-d89e2b6e24d3 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:45:36 devstack sudo[91500]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-41421ebe-0fa2-4624-aeec-795b08ea4b61.e72a3d0a-5741-48ad-8412-d89e2b6e24d3
Jul 02 19:45:36 devstack sudo[91500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:45:38 devstack sudo[91500]: pam_unix(sudo:session): session closed for user root
Jul 02 19:45:38 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-c3b05fee-5d7b-4f24-b3ee-a37ffba24fc7 tempest-GroupSnapshotsTest-1838694738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-41421ebe-0fa2-4624-aeec-795b08ea4b61.e72a3d0a-5741-48ad-8412-d89e2b6e24d3" returned: 0 in 1.208s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:45:38 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-c3b05fee-5d7b-4f24-b3ee-a37ffba24fc7 tempest-GroupSnapshotsTest-1838694738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-41421ebe-0fa2-4624-aeec-795b08ea4b61.info {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:45:38 devstack sudo[91514]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-41421ebe-0fa2-4624-aeec-795b08ea4b61.info
Jul 02 19:45:38 devstack sudo[91514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:45:39 devstack sudo[91514]: pam_unix(sudo:session): session closed for user root
Jul 02 19:45:39 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-c3b05fee-5d7b-4f24-b3ee-a37ffba24fc7 tempest-GroupSnapshotsTest-1838694738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-41421ebe-0fa2-4624-aeec-795b08ea4b61.info" returned: 0 in 1.086s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:45:39 devstack cinder-volume[86639]: WARNING cinder.volume.drivers.remotefs [None req-c3b05fee-5d7b-4f24-b3ee-a37ffba24fc7 tempest-GroupSnapshotsTest-1838694738 None] /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-41421ebe-0fa2-4624-aeec-795b08ea4b61.info is being set with open permissions: ugo+rw: NotImplementedError
Jul 02 19:45:39 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-c3b05fee-5d7b-4f24-b3ee-a37ffba24fc7 tempest-GroupSnapshotsTest-1838694738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-41421ebe-0fa2-4624-aeec-795b08ea4b61.info {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:45:39 devstack sudo[91858]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-41421ebe-0fa2-4624-aeec-795b08ea4b61.info
Jul 02 19:45:39 devstack sudo[91858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:45:40 devstack sudo[91858]: pam_unix(sudo:session): session closed for user root
Jul 02 19:45:40 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-c3b05fee-5d7b-4f24-b3ee-a37ffba24fc7 tempest-GroupSnapshotsTest-1838694738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-41421ebe-0fa2-4624-aeec-795b08ea4b61.info" returned: 0 in 1.289s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:45:40 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-c3b05fee-5d7b-4f24-b3ee-a37ffba24fc7 tempest-GroupSnapshotsTest-1838694738 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 7.437s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:45:40 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-c3b05fee-5d7b-4f24-b3ee-a37ffba24fc7 tempest-GroupSnapshotsTest-1838694738 None] group_snapshot 62e9f30f-2ca6-4c4e-8fb0-02c7305f1ed4: created successfully
Jul 02 19:45:41 devstack cinder-volume[86639]: DEBUG oslo_service.periodic_task [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86639) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 02 19:45:41 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:45:41 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:45:41 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 19:45:41 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 19:45:41 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.038s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:45:41 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:45:41 devstack sudo[91887]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e
Jul 02 19:45:41 devstack sudo[91887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:45:42 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-31500af8-2b27-47e8-a99a-888081a36bec tempest-GroupSnapshotsTest-1838694738 None] group_snapshot 62e9f30f-2ca6-4c4e-8fb0-02c7305f1ed4: deleting
Jul 02 19:45:42 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-31500af8-2b27-47e8-a99a-888081a36bec tempest-GroupSnapshotsTest-1838694738 None] group_snapshot 62e9f30f-2ca6-4c4e-8fb0-02c7305f1ed4: deleting {{(pid=86639) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Jul 02 19:45:42 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-31500af8-2b27-47e8-a99a-888081a36bec tempest-GroupSnapshotsTest-1838694738 None] Acquiring lock "cinder-quobyte-41421ebe-0fa2-4624-aeec-795b08ea4b61" by "delete_snapshot" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:45:42 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-31500af8-2b27-47e8-a99a-888081a36bec tempest-GroupSnapshotsTest-1838694738 None] Lock "cinder-quobyte-41421ebe-0fa2-4624-aeec-795b08ea4b61" acquired by "delete_snapshot" :: waited 0.080s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:45:42 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-31500af8-2b27-47e8-a99a-888081a36bec tempest-GroupSnapshotsTest-1838694738 None] Acquiring lock "cinder-quobyte-e72a3d0a-5741-48ad-8412-d89e2b6e24d3" by "_delete_snapshot" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:45:42 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-31500af8-2b27-47e8-a99a-888081a36bec tempest-GroupSnapshotsTest-1838694738 None] Lock "cinder-quobyte-e72a3d0a-5741-48ad-8412-d89e2b6e24d3" acquired by "_delete_snapshot" :: waited 0.107s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:45:42 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-31500af8-2b27-47e8-a99a-888081a36bec tempest-GroupSnapshotsTest-1838694738 None] Deleting offline snapshot e72a3d0a-5741-48ad-8412-d89e2b6e24d3 of volume 41421ebe-0fa2-4624-aeec-795b08ea4b61 {{(pid=86639) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 02 19:45:42 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-31500af8-2b27-47e8-a99a-888081a36bec tempest-GroupSnapshotsTest-1838694738 None] snapshot_file for this snap is: volume-41421ebe-0fa2-4624-aeec-795b08ea4b61.e72a3d0a-5741-48ad-8412-d89e2b6e24d3 {{(pid=86639) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 02 19:45:42 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e78b3ac-695b-4b84-9cca-5a717ff3363d]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 19:45:42 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-31500af8-2b27-47e8-a99a-888081a36bec tempest-GroupSnapshotsTest-1838694738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-41421ebe-0fa2-4624-aeec-795b08ea4b61.e72a3d0a-5741-48ad-8412-d89e2b6e24d3 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:45:43 devstack sudo[91890]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-41421ebe-0fa2-4624-aeec-795b08ea4b61.e72a3d0a-5741-48ad-8412-d89e2b6e24d3
Jul 02 19:45:43 devstack sudo[91890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:45:43 devstack sudo[91887]: pam_unix(sudo:session): session closed for user root
Jul 02 19:45:43 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e" returned: 0 in 1.920s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:45:43 devstack cinder-volume[86639]: DEBUG cinder.manager [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] Notifying Schedulers of capabilities ... {{(pid=86639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 19:45:43 devstack cinder-volume[86639]: DEBUG oslo_service.periodic_task [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] Running periodic task VolumeManager._thread_info {{(pid=86639) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 02 19:45:43 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] thread count: 8 {{(pid=86639) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 02 19:45:43 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] thread info: [<_MainThread(MainThread, started 140525261275264)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 140525150678016)>, <Thread(Thread-3 (stat_writer), started daemon 140525150025920)>, <Thread(Rabbit-heartbeat, started daemon 140525150500864)>, <Thread(Thread-5 (_runner), started daemon 140525149847296)>, <Thread(Thread-7 (_runner), started daemon 140525149863424)>, <Thread(fd_logger, started daemon 140525146589376)>, <Thread(privsep_reader, started daemon 140525144562432)>] {{(pid=86639) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 02 19:45:44 devstack sudo[91890]: pam_unix(sudo:session): session closed for user root
Jul 02 19:45:44 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-31500af8-2b27-47e8-a99a-888081a36bec tempest-GroupSnapshotsTest-1838694738 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-41421ebe-0fa2-4624-aeec-795b08ea4b61.e72a3d0a-5741-48ad-8412-d89e2b6e24d3" returned: 0 in 1.898s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:45:44 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-31500af8-2b27-47e8-a99a-888081a36bec tempest-GroupSnapshotsTest-1838694738 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-41421ebe-0fa2-4624-aeec-795b08ea4b61(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86639) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 02 19:45:44 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[28cd6f7b-2b42-4ab2-a656-dee115f503c1]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 19:45:44 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-31500af8-2b27-47e8-a99a-888081a36bec tempest-GroupSnapshotsTest-1838694738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-41421ebe-0fa2-4624-aeec-795b08ea4b61 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:45:45 devstack sudo[91899]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-41421ebe-0fa2-4624-aeec-795b08ea4b61
Jul 02 19:45:45 devstack sudo[91899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:45:46 devstack sudo[91899]: pam_unix(sudo:session): session closed for user root
Jul 02 19:45:46 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-31500af8-2b27-47e8-a99a-888081a36bec tempest-GroupSnapshotsTest-1838694738 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-41421ebe-0fa2-4624-aeec-795b08ea4b61" returned: 0 in 1.830s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:45:46 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-31500af8-2b27-47e8-a99a-888081a36bec tempest-GroupSnapshotsTest-1838694738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-41421ebe-0fa2-4624-aeec-795b08ea4b61.e72a3d0a-5741-48ad-8412-d89e2b6e24d3 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:45:46 devstack sudo[91909]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-41421ebe-0fa2-4624-aeec-795b08ea4b61.e72a3d0a-5741-48ad-8412-d89e2b6e24d3
Jul 02 19:45:46 devstack sudo[91909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:45:48 devstack sudo[91909]: pam_unix(sudo:session): session closed for user root
Jul 02 19:45:48 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-31500af8-2b27-47e8-a99a-888081a36bec tempest-GroupSnapshotsTest-1838694738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-41421ebe-0fa2-4624-aeec-795b08ea4b61.e72a3d0a-5741-48ad-8412-d89e2b6e24d3" returned: 0 in 1.489s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:45:48 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-31500af8-2b27-47e8-a99a-888081a36bec tempest-GroupSnapshotsTest-1838694738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-41421ebe-0fa2-4624-aeec-795b08ea4b61.e72a3d0a-5741-48ad-8412-d89e2b6e24d3 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:45:48 devstack sudo[91924]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-41421ebe-0fa2-4624-aeec-795b08ea4b61.e72a3d0a-5741-48ad-8412-d89e2b6e24d3
Jul 02 19:45:48 devstack sudo[91924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:45:49 devstack sudo[91924]: pam_unix(sudo:session): session closed for user root
Jul 02 19:45:49 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-31500af8-2b27-47e8-a99a-888081a36bec tempest-GroupSnapshotsTest-1838694738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-41421ebe-0fa2-4624-aeec-795b08ea4b61.e72a3d0a-5741-48ad-8412-d89e2b6e24d3" returned: 0 in 1.269s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:45:49 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-31500af8-2b27-47e8-a99a-888081a36bec tempest-GroupSnapshotsTest-1838694738 None] Lock "cinder-quobyte-e72a3d0a-5741-48ad-8412-d89e2b6e24d3" released by "_delete_snapshot" :: held 6.754s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:45:49 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-31500af8-2b27-47e8-a99a-888081a36bec tempest-GroupSnapshotsTest-1838694738 None] Lock "cinder-quobyte-41421ebe-0fa2-4624-aeec-795b08ea4b61" released by "delete_snapshot" :: held 6.891s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:45:49 devstack cinder-volume[86639]: WARNING cinder.quota [None req-31500af8-2b27-47e8-a99a-888081a36bec tempest-GroupSnapshotsTest-1838694738 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1865621166 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1865621166, it is now deprecated. Please use the default quota class for default quota.
Jul 02 19:45:49 devstack cinder-volume[86639]: WARNING cinder.quota [None req-31500af8-2b27-47e8-a99a-888081a36bec tempest-GroupSnapshotsTest-1838694738 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1865621166 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1865621166, it is now deprecated. Please use the default quota class for default quota.
Jul 02 19:45:49 devstack cinder-volume[86639]: DEBUG cinder.quota [None req-31500af8-2b27-47e8-a99a-888081a36bec tempest-GroupSnapshotsTest-1838694738 None] Created reservations ['7bfc046d-0c8e-486c-86d4-acec6beae965', 'df370a58-dca3-4646-8293-58106d3201c7', '06e430e3-e702-4e72-a88d-cf11e61980c3', 'e25c0d22-6316-40db-865c-bce5ed1da6d2'] {{(pid=86639) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 19:45:50 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-31500af8-2b27-47e8-a99a-888081a36bec tempest-GroupSnapshotsTest-1838694738 None] group_snapshot 62e9f30f-2ca6-4c4e-8fb0-02c7305f1ed4: deleted successfully
Jul 02 19:45:51 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-1577cb60-547f-4fc9-a538-90d1c1cb9b8b tempest-GroupSnapshotsTest-1838694738 None] Acquiring lock "cinder-quobyte-41421ebe-0fa2-4624-aeec-795b08ea4b61" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:45:51 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-1577cb60-547f-4fc9-a538-90d1c1cb9b8b tempest-GroupSnapshotsTest-1838694738 None] Lock "cinder-quobyte-41421ebe-0fa2-4624-aeec-795b08ea4b61" acquired by "delete_volume" :: waited 0.028s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:45:51 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f42a1b3-48d8-4f1e-b2f9-2e1230443564]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 19:45:51 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-1577cb60-547f-4fc9-a538-90d1c1cb9b8b tempest-GroupSnapshotsTest-1838694738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-41421ebe-0fa2-4624-aeec-795b08ea4b61 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:45:51 devstack sudo[92008]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-41421ebe-0fa2-4624-aeec-795b08ea4b61
Jul 02 19:45:51 devstack sudo[92008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:45:53 devstack sudo[92008]: pam_unix(sudo:session): session closed for user root
Jul 02 19:45:53 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-1577cb60-547f-4fc9-a538-90d1c1cb9b8b tempest-GroupSnapshotsTest-1838694738 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-41421ebe-0fa2-4624-aeec-795b08ea4b61" returned: 0 in 1.768s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:45:53 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-1577cb60-547f-4fc9-a538-90d1c1cb9b8b tempest-GroupSnapshotsTest-1838694738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-41421ebe-0fa2-4624-aeec-795b08ea4b61 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:45:53 devstack sudo[92017]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-41421ebe-0fa2-4624-aeec-795b08ea4b61
Jul 02 19:45:53 devstack sudo[92017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:45:55 devstack sudo[92017]: pam_unix(sudo:session): session closed for user root
Jul 02 19:45:55 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-1577cb60-547f-4fc9-a538-90d1c1cb9b8b tempest-GroupSnapshotsTest-1838694738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-41421ebe-0fa2-4624-aeec-795b08ea4b61" returned: 0 in 1.843s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:45:55 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-1577cb60-547f-4fc9-a538-90d1c1cb9b8b tempest-GroupSnapshotsTest-1838694738 None] Lock "cinder-quobyte-41421ebe-0fa2-4624-aeec-795b08ea4b61" released by "delete_volume" :: held 3.767s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:45:55 devstack cinder-volume[86639]: DEBUG cinder.quota [None req-1577cb60-547f-4fc9-a538-90d1c1cb9b8b tempest-GroupSnapshotsTest-1838694738 None] Created reservations ['aa8791d1-806f-4eba-9f82-d23b14736eb2'] {{(pid=86639) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 19:45:55 devstack cinder-volume[86639]: WARNING cinder.quota [None req-1577cb60-547f-4fc9-a538-90d1c1cb9b8b tempest-GroupSnapshotsTest-1838694738 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1865621166 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1865621166, it is now deprecated. Please use the default quota class for default quota.
Jul 02 19:45:55 devstack cinder-volume[86639]: DEBUG cinder.quota [None req-1577cb60-547f-4fc9-a538-90d1c1cb9b8b tempest-GroupSnapshotsTest-1838694738 None] Created reservations ['dfb764aa-4ee7-43be-8891-389f877afa50', 'b176072f-daee-4318-92c7-c9aabed90aa4', 'a27b90e1-4b83-44f1-b7ed-cc6351cf3363', '928db169-e2e3-4d36-a106-83c0835ef755'] {{(pid=86639) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 19:45:56 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-1577cb60-547f-4fc9-a538-90d1c1cb9b8b tempest-GroupSnapshotsTest-1838694738 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:45:56 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-1577cb60-547f-4fc9-a538-90d1c1cb9b8b tempest-GroupSnapshotsTest-1838694738 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:45:56 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-1577cb60-547f-4fc9-a538-90d1c1cb9b8b tempest-GroupSnapshotsTest-1838694738 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 19:45:56 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-1577cb60-547f-4fc9-a538-90d1c1cb9b8b tempest-GroupSnapshotsTest-1838694738 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 19:45:56 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-1577cb60-547f-4fc9-a538-90d1c1cb9b8b tempest-GroupSnapshotsTest-1838694738 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.045s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:45:56 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-1577cb60-547f-4fc9-a538-90d1c1cb9b8b tempest-GroupSnapshotsTest-1838694738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:45:56 devstack sudo[92061]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e
Jul 02 19:45:56 devstack sudo[92061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:45:57 devstack sudo[92061]: pam_unix(sudo:session): session closed for user root
Jul 02 19:45:57 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-1577cb60-547f-4fc9-a538-90d1c1cb9b8b tempest-GroupSnapshotsTest-1838694738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e" returned: 0 in 1.524s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:45:57 devstack cinder-volume[86639]: DEBUG cinder.manager [None req-1577cb60-547f-4fc9-a538-90d1c1cb9b8b tempest-GroupSnapshotsTest-1838694738 None] Notifying Schedulers of capabilities ... {{(pid=86639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 19:45:57 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-1577cb60-547f-4fc9-a538-90d1c1cb9b8b tempest-GroupSnapshotsTest-1838694738 None] Delete group completed successfully.
Jul 02 19:46:06 devstack cinder-volume[86639]: DEBUG dbcounter [-] [86639] Writing DB stats cinder:UPDATE=52,cinder:SELECT=54,cinder:INSERT=12,cinder:DELETE=1 {{(pid=86639) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 02 19:46:06 devstack cinder-volume[86639]: DEBUG dbcounter [-] [86639] Writing DB stats cinder:UPDATE=62,cinder:SELECT=64,cinder:INSERT=16 {{(pid=86639) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 02 19:46:08 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-f5d337d8-153c-4af2-81a2-e7f008401daf tempest-GroupSnapshotsV319Test-505938416 None] Group tempest-GroupSnapshotsV319Test-Group-1967074764: creating
Jul 02 19:46:08 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-f5d337d8-153c-4af2-81a2-e7f008401daf tempest-GroupSnapshotsV319Test-505938416 None] Group tempest-GroupSnapshotsV319Test-Group-1967074764: created successfully
Jul 02 19:46:08 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-f5d337d8-153c-4af2-81a2-e7f008401daf tempest-GroupSnapshotsV319Test-505938416 None] Create group completed successfully.
Jul 02 19:46:10 devstack cinder-volume[86639]: DEBUG cinder.volume.flows.manager.create_volume [None req-a94be176-4fd8-42e7-a60e-00fab2c7ea51 tempest-GroupSnapshotsV319Test-505938416 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 19:46:10 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-a94be176-4fd8-42e7-a60e-00fab2c7ea51 tempest-GroupSnapshotsV319Test-505938416 None] Flow 'volume_create_manager' (4faaedcd-ba7d-4c8f-aaea-1acdaf6ef9ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 19:46:10 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-a94be176-4fd8-42e7-a60e-00fab2c7ea51 tempest-GroupSnapshotsV319Test-505938416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8078496-6948-4d0f-892d-cfd962a1cee2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:46:10 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-a94be176-4fd8-42e7-a60e-00fab2c7ea51 tempest-GroupSnapshotsV319Test-505938416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8078496-6948-4d0f-892d-cfd962a1cee2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T17:46:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-259838219',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=526e629f-f347-486b-98c5-41b953370494,host='devstack@QuobyteHD#QuobyteHD',id=1a612760-1d17-415c-bcc7-95275e1775f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b656c66c92d421a934784c6820e6f48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T17:46:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T17:46:10Z,use_quota=True,user_id='06727c847f714b50ad94bfe158f8fb3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(575d48fd-5031-47d9-9db4-d2fcfe5a69ed),volume_type_id=575d48fd-5031-47d9-9db4-d2fcfe5a69ed)' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:46:10 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-a94be176-4fd8-42e7-a60e-00fab2c7ea51 tempest-GroupSnapshotsV319Test-505938416 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (982135f0-e44c-464d-8916-f11e0cd449f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:46:10 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-a94be176-4fd8-42e7-a60e-00fab2c7ea51 tempest-GroupSnapshotsV319Test-505938416 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (982135f0-e44c-464d-8916-f11e0cd449f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:46:10 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-a94be176-4fd8-42e7-a60e-00fab2c7ea51 tempest-GroupSnapshotsV319Test-505938416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d65f90ef-53a8-4562-95ea-b21779ddc290) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:46:10 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-a94be176-4fd8-42e7-a60e-00fab2c7ea51 tempest-GroupSnapshotsV319Test-505938416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d65f90ef-53a8-4562-95ea-b21779ddc290) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1a612760-1d17-415c-bcc7-95275e1775f6', 'volume_name': 'volume-1a612760-1d17-415c-bcc7-95275e1775f6', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:46:10 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-a94be176-4fd8-42e7-a60e-00fab2c7ea51 tempest-GroupSnapshotsV319Test-505938416 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b651dcd-d466-477f-b60e-0181157fb87b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:46:10 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-a94be176-4fd8-42e7-a60e-00fab2c7ea51 tempest-GroupSnapshotsV319Test-505938416 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b651dcd-d466-477f-b60e-0181157fb87b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:46:10 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-a94be176-4fd8-42e7-a60e-00fab2c7ea51 tempest-GroupSnapshotsV319Test-505938416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11f1966d-22c4-4336-89a4-6df253297bc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:46:10 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-a94be176-4fd8-42e7-a60e-00fab2c7ea51 tempest-GroupSnapshotsV319Test-505938416 None] Volume 1a612760-1d17-415c-bcc7-95275e1775f6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1a612760-1d17-415c-bcc7-95275e1775f6', 'volume_size': 1}
Jul 02 19:46:10 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-a94be176-4fd8-42e7-a60e-00fab2c7ea51 tempest-GroupSnapshotsV319Test-505938416 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:46:10 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-a94be176-4fd8-42e7-a60e-00fab2c7ea51 tempest-GroupSnapshotsV319Test-505938416 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:46:10 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-a94be176-4fd8-42e7-a60e-00fab2c7ea51 tempest-GroupSnapshotsV319Test-505938416 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce906cb830>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=526e629f-f347-486b-98c5-41b953370494,created_at=2026-07-02T17:46:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-259838219',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=526e629f-f347-486b-98c5-41b953370494,host='devstack@QuobyteHD#QuobyteHD',id=1a612760-1d17-415c-bcc7-95275e1775f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b656c66c92d421a934784c6820e6f48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T17:46:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T17:46:10Z,use_quota=True,user_id='06727c847f714b50ad94bfe158f8fb3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(575d48fd-5031-47d9-9db4-d2fcfe5a69ed),volume_type_id=575d48fd-5031-47d9-9db4-d2fcfe5a69ed)}" {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 19:46:10 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-a94be176-4fd8-42e7-a60e-00fab2c7ea51 tempest-GroupSnapshotsV319Test-505938416 None] Creating volume 1a612760-1d17-415c-bcc7-95275e1775f6 {{(pid=86639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 19:46:10 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-a94be176-4fd8-42e7-a60e-00fab2c7ea51 tempest-GroupSnapshotsV319Test-505938416 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:46:10 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-a94be176-4fd8-42e7-a60e-00fab2c7ea51 tempest-GroupSnapshotsV319Test-505938416 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:46:10 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-a94be176-4fd8-42e7-a60e-00fab2c7ea51 tempest-GroupSnapshotsV319Test-505938416 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 19:46:10 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-a94be176-4fd8-42e7-a60e-00fab2c7ea51 tempest-GroupSnapshotsV319Test-505938416 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 19:46:10 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-a94be176-4fd8-42e7-a60e-00fab2c7ea51 tempest-GroupSnapshotsV319Test-505938416 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:46:10 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-a94be176-4fd8-42e7-a60e-00fab2c7ea51 tempest-GroupSnapshotsV319Test-505938416 None] Selected osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92 as target Quobyte volume. {{(pid=86639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 19:46:10 devstack cinder-volume[86639]: INFO cinder.volume.drivers.remotefs [None req-a94be176-4fd8-42e7-a60e-00fab2c7ea51 tempest-GroupSnapshotsV319Test-505938416 None] casted to osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92
Jul 02 19:46:10 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-a94be176-4fd8-42e7-a60e-00fab2c7ea51 tempest-GroupSnapshotsV319Test-505938416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-1a612760-1d17-415c-bcc7-95275e1775f6 1073741824 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:46:10 devstack sudo[92263]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-1a612760-1d17-415c-bcc7-95275e1775f6 1073741824
Jul 02 19:46:10 devstack sudo[92263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:46:11 devstack sudo[92263]: pam_unix(sudo:session): session closed for user root
Jul 02 19:46:11 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-a94be176-4fd8-42e7-a60e-00fab2c7ea51 tempest-GroupSnapshotsV319Test-505938416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-1a612760-1d17-415c-bcc7-95275e1775f6 1073741824" returned: 0 in 1.555s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:46:11 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-a94be176-4fd8-42e7-a60e-00fab2c7ea51 tempest-GroupSnapshotsV319Test-505938416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-1a612760-1d17-415c-bcc7-95275e1775f6 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:46:12 devstack sudo[92270]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-1a612760-1d17-415c-bcc7-95275e1775f6
Jul 02 19:46:12 devstack sudo[92270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:46:13 devstack sudo[92270]: pam_unix(sudo:session): session closed for user root
Jul 02 19:46:13 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-a94be176-4fd8-42e7-a60e-00fab2c7ea51 tempest-GroupSnapshotsV319Test-505938416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-1a612760-1d17-415c-bcc7-95275e1775f6" returned: 0 in 1.092s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:46:13 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-a94be176-4fd8-42e7-a60e-00fab2c7ea51 tempest-GroupSnapshotsV319Test-505938416 None] <== create_volume: return (2749ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'} {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 19:46:13 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-a94be176-4fd8-42e7-a60e-00fab2c7ea51 tempest-GroupSnapshotsV319Test-505938416 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.753s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:46:13 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-a94be176-4fd8-42e7-a60e-00fab2c7ea51 tempest-GroupSnapshotsV319Test-505938416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11f1966d-22c4-4336-89a4-6df253297bc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a612760-1d17-415c-bcc7-95275e1775f6', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:46:13 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-a94be176-4fd8-42e7-a60e-00fab2c7ea51 tempest-GroupSnapshotsV319Test-505938416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66e4ca9a-f7d4-4d2a-9874-8d59feda4691) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:46:13 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-a94be176-4fd8-42e7-a60e-00fab2c7ea51 tempest-GroupSnapshotsV319Test-505938416 None] Volume volume-1a612760-1d17-415c-bcc7-95275e1775f6 (1a612760-1d17-415c-bcc7-95275e1775f6): created successfully
Jul 02 19:46:13 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-a94be176-4fd8-42e7-a60e-00fab2c7ea51 tempest-GroupSnapshotsV319Test-505938416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66e4ca9a-f7d4-4d2a-9874-8d59feda4691) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:46:13 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-a94be176-4fd8-42e7-a60e-00fab2c7ea51 tempest-GroupSnapshotsV319Test-505938416 None] Flow 'volume_create_manager' (4faaedcd-ba7d-4c8f-aaea-1acdaf6ef9ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 19:46:13 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-a94be176-4fd8-42e7-a60e-00fab2c7ea51 tempest-GroupSnapshotsV319Test-505938416 None] Created volume successfully.
Jul 02 19:46:13 devstack cinder-volume[86639]: INFO cinder.volume.manager [req-f2ba0b29-a994-4edf-aafd-ac08e55b65e1 req-5e88e96a-33e4-4989-9eea-3ed9f3389f4f tempest-ServerActionsTestOtherA-1484119296 None] Terminate volume connection completed successfully.
Jul 02 19:46:13 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [req-f2ba0b29-a994-4edf-aafd-ac08e55b65e1 req-5e88e96a-33e4-4989-9eea-3ed9f3389f4f tempest-ServerActionsTestOtherA-1484119296 None] Deleting attachment 6f4e023f-ea85-4f50-ac10-81b6f81c11f8. {{(pid=86639) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 02 19:46:14 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-ce709ce8-a39a-4288-9ab0-7eb59ff41f19 tempest-GroupSnapshotsV319Test-505938416 None] GroupSnapshot e66e1270-cf36-4b6a-bccd-77905f09229e: creating.
Jul 02 19:46:14 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-ce709ce8-a39a-4288-9ab0-7eb59ff41f19 tempest-GroupSnapshotsV319Test-505938416 None] Group snapshot e66e1270-cf36-4b6a-bccd-77905f09229e: creating. {{(pid=86639) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Jul 02 19:46:14 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-ce709ce8-a39a-4288-9ab0-7eb59ff41f19 tempest-GroupSnapshotsV319Test-505938416 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:46:14 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-ce709ce8-a39a-4288-9ab0-7eb59ff41f19 tempest-GroupSnapshotsV319Test-505938416 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:46:14 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-ce709ce8-a39a-4288-9ab0-7eb59ff41f19 tempest-GroupSnapshotsV319Test-505938416 None] Creating offline snapshot 93af05fd-d173-438d-aea5-fd82f5c7e91e of volume 1a612760-1d17-415c-bcc7-95275e1775f6 {{(pid=86639) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 02 19:46:14 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[1142e3ef-88ad-4ef0-9005-f27e4227e6a6]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 19:46:14 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-ce709ce8-a39a-4288-9ab0-7eb59ff41f19 tempest-GroupSnapshotsV319Test-505938416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-1a612760-1d17-415c-bcc7-95275e1775f6 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:46:15 devstack sudo[92278]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-1a612760-1d17-415c-bcc7-95275e1775f6
Jul 02 19:46:15 devstack sudo[92278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:46:16 devstack sudo[92278]: pam_unix(sudo:session): session closed for user root
Jul 02 19:46:16 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-ce709ce8-a39a-4288-9ab0-7eb59ff41f19 tempest-GroupSnapshotsV319Test-505938416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-1a612760-1d17-415c-bcc7-95275e1775f6" returned: 0 in 1.699s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:46:16 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-ce709ce8-a39a-4288-9ab0-7eb59ff41f19 tempest-GroupSnapshotsV319Test-505938416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-1a612760-1d17-415c-bcc7-95275e1775f6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-1a612760-1d17-415c-bcc7-95275e1775f6.93af05fd-d173-438d-aea5-fd82f5c7e91e 1G {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:46:16 devstack sudo[92286]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-1a612760-1d17-415c-bcc7-95275e1775f6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-1a612760-1d17-415c-bcc7-95275e1775f6.93af05fd-d173-438d-aea5-fd82f5c7e91e 1G
Jul 02 19:46:16 devstack sudo[92286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:46:19 devstack sudo[92286]: pam_unix(sudo:session): session closed for user root
Jul 02 19:46:19 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-ce709ce8-a39a-4288-9ab0-7eb59ff41f19 tempest-GroupSnapshotsV319Test-505938416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-1a612760-1d17-415c-bcc7-95275e1775f6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-1a612760-1d17-415c-bcc7-95275e1775f6.93af05fd-d173-438d-aea5-fd82f5c7e91e 1G" returned: 0 in 2.735s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:46:19 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-ce709ce8-a39a-4288-9ab0-7eb59ff41f19 tempest-GroupSnapshotsV319Test-505938416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a612760-1d17-415c-bcc7-95275e1775f6 -F qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-1a612760-1d17-415c-bcc7-95275e1775f6.93af05fd-d173-438d-aea5-fd82f5c7e91e {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:46:19 devstack sudo[92428]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a612760-1d17-415c-bcc7-95275e1775f6 -F qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-1a612760-1d17-415c-bcc7-95275e1775f6.93af05fd-d173-438d-aea5-fd82f5c7e91e
Jul 02 19:46:19 devstack sudo[92428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:46:21 devstack sudo[92428]: pam_unix(sudo:session): session closed for user root
Jul 02 19:46:21 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-ce709ce8-a39a-4288-9ab0-7eb59ff41f19 tempest-GroupSnapshotsV319Test-505938416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a612760-1d17-415c-bcc7-95275e1775f6 -F qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-1a612760-1d17-415c-bcc7-95275e1775f6.93af05fd-d173-438d-aea5-fd82f5c7e91e" returned: 0 in 1.901s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:46:21 devstack cinder-volume[86639]: WARNING cinder.volume.drivers.remotefs [None req-ce709ce8-a39a-4288-9ab0-7eb59ff41f19 tempest-GroupSnapshotsV319Test-505938416 None] /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-1a612760-1d17-415c-bcc7-95275e1775f6.93af05fd-d173-438d-aea5-fd82f5c7e91e is being set with open permissions: ugo+rw: NotImplementedError
Jul 02 19:46:21 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-ce709ce8-a39a-4288-9ab0-7eb59ff41f19 tempest-GroupSnapshotsV319Test-505938416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-1a612760-1d17-415c-bcc7-95275e1775f6.93af05fd-d173-438d-aea5-fd82f5c7e91e {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:46:21 devstack sudo[92475]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-1a612760-1d17-415c-bcc7-95275e1775f6.93af05fd-d173-438d-aea5-fd82f5c7e91e
Jul 02 19:46:21 devstack sudo[92475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:46:22 devstack sudo[92475]: pam_unix(sudo:session): session closed for user root
Jul 02 19:46:22 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-ce709ce8-a39a-4288-9ab0-7eb59ff41f19 tempest-GroupSnapshotsV319Test-505938416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-1a612760-1d17-415c-bcc7-95275e1775f6.93af05fd-d173-438d-aea5-fd82f5c7e91e" returned: 0 in 0.896s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:46:22 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-ce709ce8-a39a-4288-9ab0-7eb59ff41f19 tempest-GroupSnapshotsV319Test-505938416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-1a612760-1d17-415c-bcc7-95275e1775f6.info {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:46:22 devstack sudo[92482]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-1a612760-1d17-415c-bcc7-95275e1775f6.info
Jul 02 19:46:22 devstack sudo[92482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:46:24 devstack sudo[92482]: pam_unix(sudo:session): session closed for user root
Jul 02 19:46:24 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-ce709ce8-a39a-4288-9ab0-7eb59ff41f19 tempest-GroupSnapshotsV319Test-505938416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-1a612760-1d17-415c-bcc7-95275e1775f6.info" returned: 0 in 1.907s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:46:24 devstack cinder-volume[86639]: WARNING cinder.volume.drivers.remotefs [None req-ce709ce8-a39a-4288-9ab0-7eb59ff41f19 tempest-GroupSnapshotsV319Test-505938416 None] /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-1a612760-1d17-415c-bcc7-95275e1775f6.info is being set with open permissions: ugo+rw: NotImplementedError
Jul 02 19:46:24 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-ce709ce8-a39a-4288-9ab0-7eb59ff41f19 tempest-GroupSnapshotsV319Test-505938416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-1a612760-1d17-415c-bcc7-95275e1775f6.info {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:46:24 devstack sudo[92556]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-1a612760-1d17-415c-bcc7-95275e1775f6.info
Jul 02 19:46:24 devstack sudo[92556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:46:25 devstack sudo[92556]: pam_unix(sudo:session): session closed for user root
Jul 02 19:46:25 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-ce709ce8-a39a-4288-9ab0-7eb59ff41f19 tempest-GroupSnapshotsV319Test-505938416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-1a612760-1d17-415c-bcc7-95275e1775f6.info" returned: 0 in 1.305s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:46:25 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-ce709ce8-a39a-4288-9ab0-7eb59ff41f19 tempest-GroupSnapshotsV319Test-505938416 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 10.721s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:46:25 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-ce709ce8-a39a-4288-9ab0-7eb59ff41f19 tempest-GroupSnapshotsV319Test-505938416 None] group_snapshot e66e1270-cf36-4b6a-bccd-77905f09229e: created successfully
Jul 02 19:46:26 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-8cb66873-30ad-4a93-94f1-cb6fccbdcc38 tempest-GroupSnapshotsV319Test-505938416 None] group_snapshot e66e1270-cf36-4b6a-bccd-77905f09229e: deleting
Jul 02 19:46:26 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-8cb66873-30ad-4a93-94f1-cb6fccbdcc38 tempest-GroupSnapshotsV319Test-505938416 None] group_snapshot e66e1270-cf36-4b6a-bccd-77905f09229e: deleting {{(pid=86639) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Jul 02 19:46:26 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-8cb66873-30ad-4a93-94f1-cb6fccbdcc38 tempest-GroupSnapshotsV319Test-505938416 None] Acquiring lock "cinder-quobyte-1a612760-1d17-415c-bcc7-95275e1775f6" by "delete_snapshot" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:46:26 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-8cb66873-30ad-4a93-94f1-cb6fccbdcc38 tempest-GroupSnapshotsV319Test-505938416 None] Lock "cinder-quobyte-1a612760-1d17-415c-bcc7-95275e1775f6" acquired by "delete_snapshot" :: waited 0.044s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:46:26 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-8cb66873-30ad-4a93-94f1-cb6fccbdcc38 tempest-GroupSnapshotsV319Test-505938416 None] Acquiring lock "cinder-quobyte-93af05fd-d173-438d-aea5-fd82f5c7e91e" by "_delete_snapshot" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:46:26 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-8cb66873-30ad-4a93-94f1-cb6fccbdcc38 tempest-GroupSnapshotsV319Test-505938416 None] Lock "cinder-quobyte-93af05fd-d173-438d-aea5-fd82f5c7e91e" acquired by "_delete_snapshot" :: waited 0.036s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:46:26 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-8cb66873-30ad-4a93-94f1-cb6fccbdcc38 tempest-GroupSnapshotsV319Test-505938416 None] Deleting offline snapshot 93af05fd-d173-438d-aea5-fd82f5c7e91e of volume 1a612760-1d17-415c-bcc7-95275e1775f6 {{(pid=86639) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 02 19:46:27 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-8cb66873-30ad-4a93-94f1-cb6fccbdcc38 tempest-GroupSnapshotsV319Test-505938416 None] snapshot_file for this snap is: volume-1a612760-1d17-415c-bcc7-95275e1775f6.93af05fd-d173-438d-aea5-fd82f5c7e91e {{(pid=86639) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 02 19:46:27 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a5d538d-86a6-4509-88bf-87aaf9bd033a]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 19:46:27 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-8cb66873-30ad-4a93-94f1-cb6fccbdcc38 tempest-GroupSnapshotsV319Test-505938416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-1a612760-1d17-415c-bcc7-95275e1775f6.93af05fd-d173-438d-aea5-fd82f5c7e91e {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:46:27 devstack sudo[92568]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-1a612760-1d17-415c-bcc7-95275e1775f6.93af05fd-d173-438d-aea5-fd82f5c7e91e
Jul 02 19:46:27 devstack sudo[92568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:46:27 devstack cinder-volume[86639]: DEBUG cinder.volume.flows.manager.create_volume [None req-0956e5ff-29fe-4a39-bdf3-c015ed56fe73 tempest-ServerRescueNegativeTestJSON-1551243289 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 19:46:27 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-0956e5ff-29fe-4a39-bdf3-c015ed56fe73 tempest-ServerRescueNegativeTestJSON-1551243289 None] Flow 'volume_create_manager' (621cc3fc-899d-4ec3-b439-f1be983e16c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 19:46:27 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-0956e5ff-29fe-4a39-bdf3-c015ed56fe73 tempest-ServerRescueNegativeTestJSON-1551243289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76cd7c44-9113-4b4c-b3f5-fec31b9fa18e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:46:27 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-0956e5ff-29fe-4a39-bdf3-c015ed56fe73 tempest-ServerRescueNegativeTestJSON-1551243289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76cd7c44-9113-4b4c-b3f5-fec31b9fa18e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T17:46:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1560579561',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2eca4c51-4d2b-49ec-9d82-d9919d337365,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6165d3aa1ac44dcea45d38bc54f36cf7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T17:46:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T17:46:28Z,use_quota=True,user_id='0555d8f770a9440d802da9f1d8522940',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:46:27 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-0956e5ff-29fe-4a39-bdf3-c015ed56fe73 tempest-ServerRescueNegativeTestJSON-1551243289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3b245bc-b963-4159-990a-44a1de353485) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:46:27 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-0956e5ff-29fe-4a39-bdf3-c015ed56fe73 tempest-ServerRescueNegativeTestJSON-1551243289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3b245bc-b963-4159-990a-44a1de353485) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:46:27 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-0956e5ff-29fe-4a39-bdf3-c015ed56fe73 tempest-ServerRescueNegativeTestJSON-1551243289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ea1fd85-4150-4367-a7bf-ccc4c8c83a01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:46:28 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-0956e5ff-29fe-4a39-bdf3-c015ed56fe73 tempest-ServerRescueNegativeTestJSON-1551243289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ea1fd85-4150-4367-a7bf-ccc4c8c83a01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2eca4c51-4d2b-49ec-9d82-d9919d337365', 'volume_name': 'volume-2eca4c51-4d2b-49ec-9d82-d9919d337365', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:46:28 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-0956e5ff-29fe-4a39-bdf3-c015ed56fe73 tempest-ServerRescueNegativeTestJSON-1551243289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79a122df-f9b9-4bca-b624-4cc1b59dc245) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:46:28 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-0956e5ff-29fe-4a39-bdf3-c015ed56fe73 tempest-ServerRescueNegativeTestJSON-1551243289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79a122df-f9b9-4bca-b624-4cc1b59dc245) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:46:28 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-0956e5ff-29fe-4a39-bdf3-c015ed56fe73 tempest-ServerRescueNegativeTestJSON-1551243289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60564977-3c0f-43aa-928d-3f5a0e4e2508) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:46:28 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-0956e5ff-29fe-4a39-bdf3-c015ed56fe73 tempest-ServerRescueNegativeTestJSON-1551243289 None] Volume 2eca4c51-4d2b-49ec-9d82-d9919d337365: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2eca4c51-4d2b-49ec-9d82-d9919d337365', 'volume_size': 1}
Jul 02 19:46:28 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-0956e5ff-29fe-4a39-bdf3-c015ed56fe73 tempest-ServerRescueNegativeTestJSON-1551243289 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:46:28 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-0956e5ff-29fe-4a39-bdf3-c015ed56fe73 tempest-ServerRescueNegativeTestJSON-1551243289 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:46:28 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-0956e5ff-29fe-4a39-bdf3-c015ed56fe73 tempest-ServerRescueNegativeTestJSON-1551243289 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce906cb830>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T17:46:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1560579561',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2eca4c51-4d2b-49ec-9d82-d9919d337365,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6165d3aa1ac44dcea45d38bc54f36cf7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T17:46:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T17:46:28Z,use_quota=True,user_id='0555d8f770a9440d802da9f1d8522940',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)}" {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 19:46:28 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-0956e5ff-29fe-4a39-bdf3-c015ed56fe73 tempest-ServerRescueNegativeTestJSON-1551243289 None] Creating volume 2eca4c51-4d2b-49ec-9d82-d9919d337365 {{(pid=86639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 19:46:28 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-0956e5ff-29fe-4a39-bdf3-c015ed56fe73 tempest-ServerRescueNegativeTestJSON-1551243289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:46:28 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-0956e5ff-29fe-4a39-bdf3-c015ed56fe73 tempest-ServerRescueNegativeTestJSON-1551243289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:46:28 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-0956e5ff-29fe-4a39-bdf3-c015ed56fe73 tempest-ServerRescueNegativeTestJSON-1551243289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 19:46:28 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-0956e5ff-29fe-4a39-bdf3-c015ed56fe73 tempest-ServerRescueNegativeTestJSON-1551243289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 19:46:28 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-0956e5ff-29fe-4a39-bdf3-c015ed56fe73 tempest-ServerRescueNegativeTestJSON-1551243289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:46:28 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-0956e5ff-29fe-4a39-bdf3-c015ed56fe73 tempest-ServerRescueNegativeTestJSON-1551243289 None] Selected osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92 as target Quobyte volume. {{(pid=86639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 19:46:28 devstack cinder-volume[86639]: INFO cinder.volume.drivers.remotefs [None req-0956e5ff-29fe-4a39-bdf3-c015ed56fe73 tempest-ServerRescueNegativeTestJSON-1551243289 None] casted to osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92
Jul 02 19:46:28 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-0956e5ff-29fe-4a39-bdf3-c015ed56fe73 tempest-ServerRescueNegativeTestJSON-1551243289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-2eca4c51-4d2b-49ec-9d82-d9919d337365 1073741824 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:46:28 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-96794706-4ed2-44ff-b3fa-13a0eb840c1c tempest-ServerActionsTestOtherA-1484119296 None] Acquiring lock "cinder-76021e4b-1f91-419e-8f4e-07e754df6bf3-delete_volume" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:46:28 devstack sudo[92570]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-2eca4c51-4d2b-49ec-9d82-d9919d337365 1073741824
Jul 02 19:46:28 devstack sudo[92570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:46:28 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-96794706-4ed2-44ff-b3fa-13a0eb840c1c tempest-ServerActionsTestOtherA-1484119296 None] Lock "cinder-76021e4b-1f91-419e-8f4e-07e754df6bf3-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:46:28 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-96794706-4ed2-44ff-b3fa-13a0eb840c1c tempest-ServerActionsTestOtherA-1484119296 None] Acquiring lock "cinder-quobyte-76021e4b-1f91-419e-8f4e-07e754df6bf3" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:46:28 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-96794706-4ed2-44ff-b3fa-13a0eb840c1c tempest-ServerActionsTestOtherA-1484119296 None] Lock "cinder-quobyte-76021e4b-1f91-419e-8f4e-07e754df6bf3" acquired by "delete_volume" :: waited 0.024s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:46:28 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a3dd883-d04a-4aaf-8b04-70bfe31af228]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 19:46:28 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-96794706-4ed2-44ff-b3fa-13a0eb840c1c tempest-ServerActionsTestOtherA-1484119296 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-76021e4b-1f91-419e-8f4e-07e754df6bf3 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:46:28 devstack sudo[92576]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-76021e4b-1f91-419e-8f4e-07e754df6bf3
Jul 02 19:46:28 devstack sudo[92576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:46:28 devstack sudo[92568]: pam_unix(sudo:session): session closed for user root
Jul 02 19:46:28 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-8cb66873-30ad-4a93-94f1-cb6fccbdcc38 tempest-GroupSnapshotsV319Test-505938416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-1a612760-1d17-415c-bcc7-95275e1775f6.93af05fd-d173-438d-aea5-fd82f5c7e91e" returned: 0 in 1.768s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:46:28 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-8cb66873-30ad-4a93-94f1-cb6fccbdcc38 tempest-GroupSnapshotsV319Test-505938416 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1a612760-1d17-415c-bcc7-95275e1775f6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86639) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 02 19:46:28 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[13b1fecb-a677-40b8-8b3d-59369e81d578]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 19:46:28 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-8cb66873-30ad-4a93-94f1-cb6fccbdcc38 tempest-GroupSnapshotsV319Test-505938416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-1a612760-1d17-415c-bcc7-95275e1775f6 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:46:29 devstack sudo[92578]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-1a612760-1d17-415c-bcc7-95275e1775f6
Jul 02 19:46:29 devstack sudo[92578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:46:30 devstack sudo[92576]: pam_unix(sudo:session): session closed for user root
Jul 02 19:46:30 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-96794706-4ed2-44ff-b3fa-13a0eb840c1c tempest-ServerActionsTestOtherA-1484119296 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-76021e4b-1f91-419e-8f4e-07e754df6bf3" returned: 0 in 1.720s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:46:30 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-96794706-4ed2-44ff-b3fa-13a0eb840c1c tempest-ServerActionsTestOtherA-1484119296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-76021e4b-1f91-419e-8f4e-07e754df6bf3 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:46:30 devstack sudo[92595]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-76021e4b-1f91-419e-8f4e-07e754df6bf3
Jul 02 19:46:30 devstack sudo[92595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:46:30 devstack sudo[92570]: pam_unix(sudo:session): session closed for user root
Jul 02 19:46:30 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-0956e5ff-29fe-4a39-bdf3-c015ed56fe73 tempest-ServerRescueNegativeTestJSON-1551243289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-2eca4c51-4d2b-49ec-9d82-d9919d337365 1073741824" returned: 0 in 2.609s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:46:30 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-0956e5ff-29fe-4a39-bdf3-c015ed56fe73 tempest-ServerRescueNegativeTestJSON-1551243289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-2eca4c51-4d2b-49ec-9d82-d9919d337365 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:46:30 devstack sudo[92608]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-2eca4c51-4d2b-49ec-9d82-d9919d337365
Jul 02 19:46:30 devstack sudo[92608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:46:30 devstack sudo[92578]: pam_unix(sudo:session): session closed for user root
Jul 02 19:46:30 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-8cb66873-30ad-4a93-94f1-cb6fccbdcc38 tempest-GroupSnapshotsV319Test-505938416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-1a612760-1d17-415c-bcc7-95275e1775f6" returned: 0 in 2.017s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:46:30 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-8cb66873-30ad-4a93-94f1-cb6fccbdcc38 tempest-GroupSnapshotsV319Test-505938416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-1a612760-1d17-415c-bcc7-95275e1775f6.93af05fd-d173-438d-aea5-fd82f5c7e91e {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:46:31 devstack sudo[92610]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-1a612760-1d17-415c-bcc7-95275e1775f6.93af05fd-d173-438d-aea5-fd82f5c7e91e
Jul 02 19:46:31 devstack sudo[92610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:46:32 devstack sudo[92608]: pam_unix(sudo:session): session closed for user root
Jul 02 19:46:32 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-0956e5ff-29fe-4a39-bdf3-c015ed56fe73 tempest-ServerRescueNegativeTestJSON-1551243289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-2eca4c51-4d2b-49ec-9d82-d9919d337365" returned: 0 in 1.886s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:46:32 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-0956e5ff-29fe-4a39-bdf3-c015ed56fe73 tempest-ServerRescueNegativeTestJSON-1551243289 None] <== create_volume: return (4605ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'} {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 19:46:32 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-0956e5ff-29fe-4a39-bdf3-c015ed56fe73 tempest-ServerRescueNegativeTestJSON-1551243289 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 4.619s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:46:32 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-0956e5ff-29fe-4a39-bdf3-c015ed56fe73 tempest-ServerRescueNegativeTestJSON-1551243289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60564977-3c0f-43aa-928d-3f5a0e4e2508) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2eca4c51-4d2b-49ec-9d82-d9919d337365', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:46:32 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-0956e5ff-29fe-4a39-bdf3-c015ed56fe73 tempest-ServerRescueNegativeTestJSON-1551243289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a84ba693-082a-45c6-861f-13f8c8e8c206) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:46:32 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-0956e5ff-29fe-4a39-bdf3-c015ed56fe73 tempest-ServerRescueNegativeTestJSON-1551243289 None] Volume volume-2eca4c51-4d2b-49ec-9d82-d9919d337365 (2eca4c51-4d2b-49ec-9d82-d9919d337365): created successfully
Jul 02 19:46:32 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-0956e5ff-29fe-4a39-bdf3-c015ed56fe73 tempest-ServerRescueNegativeTestJSON-1551243289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a84ba693-082a-45c6-861f-13f8c8e8c206) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:46:32 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-0956e5ff-29fe-4a39-bdf3-c015ed56fe73 tempest-ServerRescueNegativeTestJSON-1551243289 None] Flow 'volume_create_manager' (621cc3fc-899d-4ec3-b439-f1be983e16c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 19:46:32 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-0956e5ff-29fe-4a39-bdf3-c015ed56fe73 tempest-ServerRescueNegativeTestJSON-1551243289 None] Created volume successfully.
Jul 02 19:46:32 devstack sudo[92595]: pam_unix(sudo:session): session closed for user root
Jul 02 19:46:32 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-96794706-4ed2-44ff-b3fa-13a0eb840c1c tempest-ServerActionsTestOtherA-1484119296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-76021e4b-1f91-419e-8f4e-07e754df6bf3" returned: 0 in 2.836s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:46:33 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-96794706-4ed2-44ff-b3fa-13a0eb840c1c tempest-ServerActionsTestOtherA-1484119296 None] Lock "cinder-quobyte-76021e4b-1f91-419e-8f4e-07e754df6bf3" released by "delete_volume" :: held 4.689s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:46:33 devstack sudo[92610]: pam_unix(sudo:session): session closed for user root
Jul 02 19:46:33 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-8cb66873-30ad-4a93-94f1-cb6fccbdcc38 tempest-GroupSnapshotsV319Test-505938416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-1a612760-1d17-415c-bcc7-95275e1775f6.93af05fd-d173-438d-aea5-fd82f5c7e91e" returned: 0 in 2.179s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:46:33 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-8cb66873-30ad-4a93-94f1-cb6fccbdcc38 tempest-GroupSnapshotsV319Test-505938416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-1a612760-1d17-415c-bcc7-95275e1775f6.93af05fd-d173-438d-aea5-fd82f5c7e91e {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:46:33 devstack sudo[92640]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-1a612760-1d17-415c-bcc7-95275e1775f6.93af05fd-d173-438d-aea5-fd82f5c7e91e
Jul 02 19:46:33 devstack sudo[92640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:46:33 devstack cinder-volume[86639]: DEBUG cinder.quota [None req-96794706-4ed2-44ff-b3fa-13a0eb840c1c tempest-ServerActionsTestOtherA-1484119296 None] Created reservations ['574e477c-3b83-4904-bbc8-160bd5682e90', '21af31fb-d330-410e-9561-0f9308bb1ec3', '4c43e585-efff-4b92-92ad-249e5f9f7b32', 'f9ed74ba-a3cc-4ee1-b44e-3edb383b48a0'] {{(pid=86639) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 19:46:33 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-96794706-4ed2-44ff-b3fa-13a0eb840c1c tempest-ServerActionsTestOtherA-1484119296 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:46:33 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-96794706-4ed2-44ff-b3fa-13a0eb840c1c tempest-ServerActionsTestOtherA-1484119296 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:46:33 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-96794706-4ed2-44ff-b3fa-13a0eb840c1c tempest-ServerActionsTestOtherA-1484119296 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 19:46:33 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-96794706-4ed2-44ff-b3fa-13a0eb840c1c tempest-ServerActionsTestOtherA-1484119296 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 19:46:33 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-96794706-4ed2-44ff-b3fa-13a0eb840c1c tempest-ServerActionsTestOtherA-1484119296 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:46:33 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-96794706-4ed2-44ff-b3fa-13a0eb840c1c tempest-ServerActionsTestOtherA-1484119296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:46:33 devstack sudo[92642]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e
Jul 02 19:46:33 devstack sudo[92642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:46:34 devstack sudo[92640]: pam_unix(sudo:session): session closed for user root
Jul 02 19:46:34 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-8cb66873-30ad-4a93-94f1-cb6fccbdcc38 tempest-GroupSnapshotsV319Test-505938416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-1a612760-1d17-415c-bcc7-95275e1775f6.93af05fd-d173-438d-aea5-fd82f5c7e91e" returned: 0 in 1.770s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:46:34 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-8cb66873-30ad-4a93-94f1-cb6fccbdcc38 tempest-GroupSnapshotsV319Test-505938416 None] Lock "cinder-quobyte-93af05fd-d173-438d-aea5-fd82f5c7e91e" released by "_delete_snapshot" :: held 7.996s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:46:34 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-8cb66873-30ad-4a93-94f1-cb6fccbdcc38 tempest-GroupSnapshotsV319Test-505938416 None] Lock "cinder-quobyte-1a612760-1d17-415c-bcc7-95275e1775f6" released by "delete_snapshot" :: held 8.060s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:46:35 devstack cinder-volume[86639]: WARNING cinder.quota [None req-8cb66873-30ad-4a93-94f1-cb6fccbdcc38 tempest-GroupSnapshotsV319Test-505938416 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1824583999 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1824583999, it is now deprecated. Please use the default quota class for default quota.
Jul 02 19:46:35 devstack cinder-volume[86639]: WARNING cinder.quota [None req-8cb66873-30ad-4a93-94f1-cb6fccbdcc38 tempest-GroupSnapshotsV319Test-505938416 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1824583999 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1824583999, it is now deprecated. Please use the default quota class for default quota.
Jul 02 19:46:35 devstack cinder-volume[86639]: DEBUG cinder.quota [None req-8cb66873-30ad-4a93-94f1-cb6fccbdcc38 tempest-GroupSnapshotsV319Test-505938416 None] Created reservations ['d678de58-e819-4158-a892-09452ac682da', '98117d40-bf5e-41a4-8586-7dab05a7aa74', 'fe5b6789-a581-4861-a0a8-55afdb98d7f2', '0c3fc0ac-19cf-4db4-bbf6-5ec8bb5bdde5'] {{(pid=86639) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 19:46:35 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-8cb66873-30ad-4a93-94f1-cb6fccbdcc38 tempest-GroupSnapshotsV319Test-505938416 None] group_snapshot e66e1270-cf36-4b6a-bccd-77905f09229e: deleted successfully
Jul 02 19:46:35 devstack sudo[92642]: pam_unix(sudo:session): session closed for user root
Jul 02 19:46:35 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-96794706-4ed2-44ff-b3fa-13a0eb840c1c tempest-ServerActionsTestOtherA-1484119296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e" returned: 0 in 1.987s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:46:35 devstack cinder-volume[86639]: DEBUG cinder.manager [None req-96794706-4ed2-44ff-b3fa-13a0eb840c1c tempest-ServerActionsTestOtherA-1484119296 None] Notifying Schedulers of capabilities ... {{(pid=86639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 19:46:35 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-96794706-4ed2-44ff-b3fa-13a0eb840c1c tempest-ServerActionsTestOtherA-1484119296 None] Deleted volume successfully.
Jul 02 19:46:35 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-96794706-4ed2-44ff-b3fa-13a0eb840c1c tempest-ServerActionsTestOtherA-1484119296 None] Lock "cinder-76021e4b-1f91-419e-8f4e-07e754df6bf3-delete_volume" released by "delete_volume" :: held 7.219s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:46:36 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-8509448f-49ed-4b4e-a0b6-912d82b57f31 tempest-GroupSnapshotsV319Test-505938416 None] Acquiring lock "cinder-quobyte-1a612760-1d17-415c-bcc7-95275e1775f6" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:46:36 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-8509448f-49ed-4b4e-a0b6-912d82b57f31 tempest-GroupSnapshotsV319Test-505938416 None] Lock "cinder-quobyte-1a612760-1d17-415c-bcc7-95275e1775f6" acquired by "delete_volume" :: waited 0.055s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:46:36 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2e1242d-3291-4966-a4a2-be8224a8eef9]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 19:46:36 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-8509448f-49ed-4b4e-a0b6-912d82b57f31 tempest-GroupSnapshotsV319Test-505938416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-1a612760-1d17-415c-bcc7-95275e1775f6 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:46:37 devstack sudo[92687]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-1a612760-1d17-415c-bcc7-95275e1775f6
Jul 02 19:46:37 devstack sudo[92687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:46:39 devstack sudo[92687]: pam_unix(sudo:session): session closed for user root
Jul 02 19:46:39 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-8509448f-49ed-4b4e-a0b6-912d82b57f31 tempest-GroupSnapshotsV319Test-505938416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-1a612760-1d17-415c-bcc7-95275e1775f6" returned: 0 in 2.123s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:46:39 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-8509448f-49ed-4b4e-a0b6-912d82b57f31 tempest-GroupSnapshotsV319Test-505938416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-1a612760-1d17-415c-bcc7-95275e1775f6 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:46:39 devstack sudo[92696]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-1a612760-1d17-415c-bcc7-95275e1775f6
Jul 02 19:46:39 devstack sudo[92696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:46:40 devstack sudo[92696]: pam_unix(sudo:session): session closed for user root
Jul 02 19:46:40 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-8509448f-49ed-4b4e-a0b6-912d82b57f31 tempest-GroupSnapshotsV319Test-505938416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-1a612760-1d17-415c-bcc7-95275e1775f6" returned: 0 in 1.832s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:46:40 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-8509448f-49ed-4b4e-a0b6-912d82b57f31 tempest-GroupSnapshotsV319Test-505938416 None] Lock "cinder-quobyte-1a612760-1d17-415c-bcc7-95275e1775f6" released by "delete_volume" :: held 4.134s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:46:41 devstack cinder-volume[86639]: DEBUG cinder.quota [None req-8509448f-49ed-4b4e-a0b6-912d82b57f31 tempest-GroupSnapshotsV319Test-505938416 None] Created reservations ['120f57fc-6c41-4eef-978d-b295f6cef3c9'] {{(pid=86639) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 19:46:41 devstack cinder-volume[86639]: WARNING cinder.quota [None req-8509448f-49ed-4b4e-a0b6-912d82b57f31 tempest-GroupSnapshotsV319Test-505938416 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1824583999 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1824583999, it is now deprecated. Please use the default quota class for default quota.
Jul 02 19:46:41 devstack cinder-volume[86639]: DEBUG cinder.quota [None req-8509448f-49ed-4b4e-a0b6-912d82b57f31 tempest-GroupSnapshotsV319Test-505938416 None] Created reservations ['75a00dbd-17d7-446c-b09f-35b5c84ab7c8', '95737a63-564b-4833-80ef-3ac9ee7d56f4', 'ad5024b5-d23c-4ae1-8767-5529aa2ade2b', '38948df1-ad22-4b7a-aa85-aa6950bc954d'] {{(pid=86639) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 19:46:41 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-8509448f-49ed-4b4e-a0b6-912d82b57f31 tempest-GroupSnapshotsV319Test-505938416 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:46:41 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-8509448f-49ed-4b4e-a0b6-912d82b57f31 tempest-GroupSnapshotsV319Test-505938416 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:46:41 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-8509448f-49ed-4b4e-a0b6-912d82b57f31 tempest-GroupSnapshotsV319Test-505938416 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 19:46:41 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-8509448f-49ed-4b4e-a0b6-912d82b57f31 tempest-GroupSnapshotsV319Test-505938416 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 19:46:41 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-8509448f-49ed-4b4e-a0b6-912d82b57f31 tempest-GroupSnapshotsV319Test-505938416 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:46:41 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-8509448f-49ed-4b4e-a0b6-912d82b57f31 tempest-GroupSnapshotsV319Test-505938416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:46:41 devstack sudo[92786]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e
Jul 02 19:46:41 devstack sudo[92786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:46:41 devstack cinder-volume[86639]: DEBUG oslo_service.periodic_task [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86639) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 02 19:46:41 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:46:41 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:46:41 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 19:46:41 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 19:46:41 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:46:41 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:46:41 devstack sudo[92788]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e
Jul 02 19:46:41 devstack sudo[92788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:46:42 devstack sudo[92786]: pam_unix(sudo:session): session closed for user root
Jul 02 19:46:42 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-8509448f-49ed-4b4e-a0b6-912d82b57f31 tempest-GroupSnapshotsV319Test-505938416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e" returned: 0 in 0.767s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:46:42 devstack cinder-volume[86639]: DEBUG cinder.manager [None req-8509448f-49ed-4b4e-a0b6-912d82b57f31 tempest-GroupSnapshotsV319Test-505938416 None] Notifying Schedulers of capabilities ... {{(pid=86639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 19:46:42 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-8509448f-49ed-4b4e-a0b6-912d82b57f31 tempest-GroupSnapshotsV319Test-505938416 None] Delete group completed successfully.
Jul 02 19:46:42 devstack sudo[92788]: pam_unix(sudo:session): session closed for user root
Jul 02 19:46:42 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e" returned: 0 in 0.972s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:46:42 devstack cinder-volume[86639]: DEBUG cinder.manager [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] Notifying Schedulers of capabilities ... {{(pid=86639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 19:46:42 devstack cinder-volume[86639]: DEBUG oslo_service.periodic_task [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] Running periodic task VolumeManager._thread_info {{(pid=86639) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 02 19:46:42 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] thread count: 8 {{(pid=86639) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 02 19:46:42 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] thread info: [<_MainThread(MainThread, started 140525261275264)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 140525150678016)>, <Thread(Thread-3 (stat_writer), started daemon 140525150025920)>, <Thread(Rabbit-heartbeat, started daemon 140525150500864)>, <Thread(Thread-5 (_runner), started daemon 140525149847296)>, <Thread(Thread-7 (_runner), started daemon 140525149863424)>, <Thread(fd_logger, started daemon 140525146589376)>, <Thread(privsep_reader, started daemon 140525144562432)>] {{(pid=86639) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 02 19:46:51 devstack cinder-volume[86639]: DEBUG dbcounter [-] [86639] Writing DB stats cinder:SELECT=36,cinder:UPDATE=35,cinder:INSERT=7 {{(pid=86639) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 02 19:46:51 devstack cinder-volume[86639]: DEBUG dbcounter [-] [86639] Writing DB stats cinder:SELECT=30,cinder:UPDATE=34,cinder:DELETE=3,cinder:INSERT=9 {{(pid=86639) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 02 19:46:53 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-62018993-6c23-4925-bc8f-cda95696be75 tempest-GroupsTest-83699162 None] Group tempest-Group1-29737669: creating
Jul 02 19:46:53 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-62018993-6c23-4925-bc8f-cda95696be75 tempest-GroupsTest-83699162 None] Group tempest-Group1-29737669: created successfully
Jul 02 19:46:53 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-62018993-6c23-4925-bc8f-cda95696be75 tempest-GroupsTest-83699162 None] Create group completed successfully.
Jul 02 19:46:54 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-51dae670-b256-45e8-abdc-bd14e0640626 tempest-GroupsTest-83699162 None] Group tempest-Group2-1238465393: creating
Jul 02 19:46:54 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-51dae670-b256-45e8-abdc-bd14e0640626 tempest-GroupsTest-83699162 None] Group tempest-Group2-1238465393: created successfully
Jul 02 19:46:54 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-51dae670-b256-45e8-abdc-bd14e0640626 tempest-GroupsTest-83699162 None] Create group completed successfully.
Jul 02 19:46:57 devstack cinder-volume[86639]: DEBUG cinder.volume.flows.manager.create_volume [None req-9cb8138d-d423-408e-b509-f35382f8420c tempest-GroupsTest-83699162 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 19:46:57 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-9cb8138d-d423-408e-b509-f35382f8420c tempest-GroupsTest-83699162 None] Flow 'volume_create_manager' (bc696fd4-a776-4c30-b14b-8c1172d2d9f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 19:46:57 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-9cb8138d-d423-408e-b509-f35382f8420c tempest-GroupsTest-83699162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fa4e507-3043-483a-a173-1e2e26e57f91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:46:57 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-9cb8138d-d423-408e-b509-f35382f8420c tempest-GroupsTest-83699162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fa4e507-3043-483a-a173-1e2e26e57f91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T17:46:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1169713370',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=868b6e30-a9f2-4f8e-8ddd-4882cc4ff583,host='devstack@QuobyteHD#QuobyteHD',id=9c675892-45aa-49e1-9fe9-3ca5dbf9e3ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2c8d1f7f4044ceabf88381219ee9128',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T17:46:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T17:46:57Z,use_quota=True,user_id='dc485e006fbf492bb9a7e2dc6245ae12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cdbe2c3-cf50-4dab-bc04-fe9e88d2dfea),volume_type_id=0cdbe2c3-cf50-4dab-bc04-fe9e88d2dfea)' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:46:57 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-9cb8138d-d423-408e-b509-f35382f8420c tempest-GroupsTest-83699162 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e55d4eb-6512-42a5-a000-85ef4a9d2c61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:46:57 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-9cb8138d-d423-408e-b509-f35382f8420c tempest-GroupsTest-83699162 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e55d4eb-6512-42a5-a000-85ef4a9d2c61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:46:57 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-9cb8138d-d423-408e-b509-f35382f8420c tempest-GroupsTest-83699162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e4932f6-6fd3-4aa6-96eb-af036e050b01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:46:57 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-9cb8138d-d423-408e-b509-f35382f8420c tempest-GroupsTest-83699162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e4932f6-6fd3-4aa6-96eb-af036e050b01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c675892-45aa-49e1-9fe9-3ca5dbf9e3ec', 'volume_name': 'volume-9c675892-45aa-49e1-9fe9-3ca5dbf9e3ec', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:46:57 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-9cb8138d-d423-408e-b509-f35382f8420c tempest-GroupsTest-83699162 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ffabb7a-669a-44bb-86ac-ed874bfdd5d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:46:57 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-9cb8138d-d423-408e-b509-f35382f8420c tempest-GroupsTest-83699162 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ffabb7a-669a-44bb-86ac-ed874bfdd5d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:46:57 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-9cb8138d-d423-408e-b509-f35382f8420c tempest-GroupsTest-83699162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea9b7264-bdd2-4726-b3da-e58eff38c0a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:46:57 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-9cb8138d-d423-408e-b509-f35382f8420c tempest-GroupsTest-83699162 None] Volume 9c675892-45aa-49e1-9fe9-3ca5dbf9e3ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c675892-45aa-49e1-9fe9-3ca5dbf9e3ec', 'volume_size': 1}
Jul 02 19:46:57 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-9cb8138d-d423-408e-b509-f35382f8420c tempest-GroupsTest-83699162 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:46:57 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-9cb8138d-d423-408e-b509-f35382f8420c tempest-GroupsTest-83699162 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:46:57 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-9cb8138d-d423-408e-b509-f35382f8420c tempest-GroupsTest-83699162 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce906cb830>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=868b6e30-a9f2-4f8e-8ddd-4882cc4ff583,created_at=2026-07-02T17:46:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1169713370',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=868b6e30-a9f2-4f8e-8ddd-4882cc4ff583,host='devstack@QuobyteHD#QuobyteHD',id=9c675892-45aa-49e1-9fe9-3ca5dbf9e3ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2c8d1f7f4044ceabf88381219ee9128',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T17:46:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T17:46:57Z,use_quota=True,user_id='dc485e006fbf492bb9a7e2dc6245ae12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cdbe2c3-cf50-4dab-bc04-fe9e88d2dfea),volume_type_id=0cdbe2c3-cf50-4dab-bc04-fe9e88d2dfea)}" {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 19:46:57 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-9cb8138d-d423-408e-b509-f35382f8420c tempest-GroupsTest-83699162 None] Creating volume 9c675892-45aa-49e1-9fe9-3ca5dbf9e3ec {{(pid=86639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 19:46:57 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-9cb8138d-d423-408e-b509-f35382f8420c tempest-GroupsTest-83699162 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:46:57 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-9cb8138d-d423-408e-b509-f35382f8420c tempest-GroupsTest-83699162 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:46:57 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-9cb8138d-d423-408e-b509-f35382f8420c tempest-GroupsTest-83699162 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 19:46:57 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-9cb8138d-d423-408e-b509-f35382f8420c tempest-GroupsTest-83699162 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 19:46:57 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-9cb8138d-d423-408e-b509-f35382f8420c tempest-GroupsTest-83699162 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:46:57 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-9cb8138d-d423-408e-b509-f35382f8420c tempest-GroupsTest-83699162 None] Selected osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92 as target Quobyte volume. {{(pid=86639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 19:46:57 devstack cinder-volume[86639]: INFO cinder.volume.drivers.remotefs [None req-9cb8138d-d423-408e-b509-f35382f8420c tempest-GroupsTest-83699162 None] casted to osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92
Jul 02 19:46:57 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-9cb8138d-d423-408e-b509-f35382f8420c tempest-GroupsTest-83699162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-9c675892-45aa-49e1-9fe9-3ca5dbf9e3ec 1073741824 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:46:57 devstack sudo[92943]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-9c675892-45aa-49e1-9fe9-3ca5dbf9e3ec 1073741824
Jul 02 19:46:57 devstack sudo[92943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:46:59 devstack sudo[92943]: pam_unix(sudo:session): session closed for user root
Jul 02 19:46:59 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-9cb8138d-d423-408e-b509-f35382f8420c tempest-GroupsTest-83699162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-9c675892-45aa-49e1-9fe9-3ca5dbf9e3ec 1073741824" returned: 0 in 1.704s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:46:59 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-9cb8138d-d423-408e-b509-f35382f8420c tempest-GroupsTest-83699162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-9c675892-45aa-49e1-9fe9-3ca5dbf9e3ec {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:46:59 devstack sudo[92995]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-9c675892-45aa-49e1-9fe9-3ca5dbf9e3ec
Jul 02 19:46:59 devstack sudo[92995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:46:59 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-8200045c-834d-40e7-aad7-4ef83898bce9 tempest-ServerRescueNegativeTestJSON-1551243289 None] Acquiring lock "cinder-2eca4c51-4d2b-49ec-9d82-d9919d337365-delete_volume" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:47:00 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-8200045c-834d-40e7-aad7-4ef83898bce9 tempest-ServerRescueNegativeTestJSON-1551243289 None] Lock "cinder-2eca4c51-4d2b-49ec-9d82-d9919d337365-delete_volume" acquired by "delete_volume" :: waited 0.104s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:47:00 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-8200045c-834d-40e7-aad7-4ef83898bce9 tempest-ServerRescueNegativeTestJSON-1551243289 None] Acquiring lock "cinder-quobyte-2eca4c51-4d2b-49ec-9d82-d9919d337365" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:47:00 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-8200045c-834d-40e7-aad7-4ef83898bce9 tempest-ServerRescueNegativeTestJSON-1551243289 None] Lock "cinder-quobyte-2eca4c51-4d2b-49ec-9d82-d9919d337365" acquired by "delete_volume" :: waited 0.052s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:47:00 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[e15f1653-15f0-46c7-8b5e-8b07e51f3cd7]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 19:47:00 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-8200045c-834d-40e7-aad7-4ef83898bce9 tempest-ServerRescueNegativeTestJSON-1551243289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-2eca4c51-4d2b-49ec-9d82-d9919d337365 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:47:00 devstack sudo[93012]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-2eca4c51-4d2b-49ec-9d82-d9919d337365
Jul 02 19:47:00 devstack sudo[93012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:47:01 devstack sudo[92995]: pam_unix(sudo:session): session closed for user root
Jul 02 19:47:01 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-9cb8138d-d423-408e-b509-f35382f8420c tempest-GroupsTest-83699162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-9c675892-45aa-49e1-9fe9-3ca5dbf9e3ec" returned: 0 in 2.512s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:47:01 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-9cb8138d-d423-408e-b509-f35382f8420c tempest-GroupsTest-83699162 None] <== create_volume: return (4388ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'} {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 19:47:01 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-9cb8138d-d423-408e-b509-f35382f8420c tempest-GroupsTest-83699162 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 4.398s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:47:01 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-9cb8138d-d423-408e-b509-f35382f8420c tempest-GroupsTest-83699162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea9b7264-bdd2-4726-b3da-e58eff38c0a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c675892-45aa-49e1-9fe9-3ca5dbf9e3ec', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:47:01 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-9cb8138d-d423-408e-b509-f35382f8420c tempest-GroupsTest-83699162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd590402-c6aa-4430-bef4-e0112cde4fc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:47:01 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-9cb8138d-d423-408e-b509-f35382f8420c tempest-GroupsTest-83699162 None] Volume volume-9c675892-45aa-49e1-9fe9-3ca5dbf9e3ec (9c675892-45aa-49e1-9fe9-3ca5dbf9e3ec): created successfully
Jul 02 19:47:02 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-9cb8138d-d423-408e-b509-f35382f8420c tempest-GroupsTest-83699162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd590402-c6aa-4430-bef4-e0112cde4fc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:47:02 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-9cb8138d-d423-408e-b509-f35382f8420c tempest-GroupsTest-83699162 None] Flow 'volume_create_manager' (bc696fd4-a776-4c30-b14b-8c1172d2d9f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 19:47:02 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-9cb8138d-d423-408e-b509-f35382f8420c tempest-GroupsTest-83699162 None] Created volume successfully.
Jul 02 19:47:02 devstack sudo[93012]: pam_unix(sudo:session): session closed for user root
Jul 02 19:47:02 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-8200045c-834d-40e7-aad7-4ef83898bce9 tempest-ServerRescueNegativeTestJSON-1551243289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-2eca4c51-4d2b-49ec-9d82-d9919d337365" returned: 0 in 2.074s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:47:02 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-8200045c-834d-40e7-aad7-4ef83898bce9 tempest-ServerRescueNegativeTestJSON-1551243289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-2eca4c51-4d2b-49ec-9d82-d9919d337365 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:47:02 devstack sudo[93023]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-2eca4c51-4d2b-49ec-9d82-d9919d337365
Jul 02 19:47:02 devstack sudo[93023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:47:04 devstack sudo[93023]: pam_unix(sudo:session): session closed for user root
Jul 02 19:47:04 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-8200045c-834d-40e7-aad7-4ef83898bce9 tempest-ServerRescueNegativeTestJSON-1551243289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-2eca4c51-4d2b-49ec-9d82-d9919d337365" returned: 0 in 1.555s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:47:04 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-8200045c-834d-40e7-aad7-4ef83898bce9 tempest-ServerRescueNegativeTestJSON-1551243289 None] Lock "cinder-quobyte-2eca4c51-4d2b-49ec-9d82-d9919d337365" released by "delete_volume" :: held 3.830s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:47:04 devstack cinder-volume[86639]: DEBUG cinder.quota [None req-8200045c-834d-40e7-aad7-4ef83898bce9 tempest-ServerRescueNegativeTestJSON-1551243289 None] Created reservations ['4cd051a1-1749-4c8c-8e4b-a9687dc0d713', 'c112c26a-945c-4ad2-9b87-8ef02352f4b9', '8b62d7d0-ca83-4e36-914b-6364024441bb', 'ab6dd0bd-94b1-4065-84eb-94cc03dedc04'] {{(pid=86639) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 19:47:04 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-8200045c-834d-40e7-aad7-4ef83898bce9 tempest-ServerRescueNegativeTestJSON-1551243289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:47:04 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-8200045c-834d-40e7-aad7-4ef83898bce9 tempest-ServerRescueNegativeTestJSON-1551243289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:47:04 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-8200045c-834d-40e7-aad7-4ef83898bce9 tempest-ServerRescueNegativeTestJSON-1551243289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 19:47:04 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-8200045c-834d-40e7-aad7-4ef83898bce9 tempest-ServerRescueNegativeTestJSON-1551243289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 19:47:04 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-8200045c-834d-40e7-aad7-4ef83898bce9 tempest-ServerRescueNegativeTestJSON-1551243289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:47:04 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-8200045c-834d-40e7-aad7-4ef83898bce9 tempest-ServerRescueNegativeTestJSON-1551243289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:47:04 devstack sudo[93027]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e
Jul 02 19:47:04 devstack sudo[93027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:47:05 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-e8e5084f-54f3-425b-9698-cbcb1ff67cf5 tempest-GroupsTest-83699162 None] Acquiring lock "cinder-quobyte-9c675892-45aa-49e1-9fe9-3ca5dbf9e3ec" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:47:05 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-e8e5084f-54f3-425b-9698-cbcb1ff67cf5 tempest-GroupsTest-83699162 None] Lock "cinder-quobyte-9c675892-45aa-49e1-9fe9-3ca5dbf9e3ec" acquired by "delete_volume" :: waited 0.059s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:47:05 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[8228610f-6888-486a-b1ff-742c7afcb569]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 19:47:05 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-e8e5084f-54f3-425b-9698-cbcb1ff67cf5 tempest-GroupsTest-83699162 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-9c675892-45aa-49e1-9fe9-3ca5dbf9e3ec {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:47:05 devstack sudo[93030]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-9c675892-45aa-49e1-9fe9-3ca5dbf9e3ec
Jul 02 19:47:05 devstack sudo[93030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:47:06 devstack sudo[93027]: pam_unix(sudo:session): session closed for user root
Jul 02 19:47:06 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-8200045c-834d-40e7-aad7-4ef83898bce9 tempest-ServerRescueNegativeTestJSON-1551243289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e" returned: 0 in 1.455s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:47:06 devstack cinder-volume[86639]: DEBUG cinder.manager [None req-8200045c-834d-40e7-aad7-4ef83898bce9 tempest-ServerRescueNegativeTestJSON-1551243289 None] Notifying Schedulers of capabilities ... {{(pid=86639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 19:47:06 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-8200045c-834d-40e7-aad7-4ef83898bce9 tempest-ServerRescueNegativeTestJSON-1551243289 None] Deleted volume successfully.
Jul 02 19:47:06 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-8200045c-834d-40e7-aad7-4ef83898bce9 tempest-ServerRescueNegativeTestJSON-1551243289 None] Lock "cinder-2eca4c51-4d2b-49ec-9d82-d9919d337365-delete_volume" released by "delete_volume" :: held 6.386s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:47:07 devstack sudo[93030]: pam_unix(sudo:session): session closed for user root
Jul 02 19:47:07 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-e8e5084f-54f3-425b-9698-cbcb1ff67cf5 tempest-GroupsTest-83699162 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-9c675892-45aa-49e1-9fe9-3ca5dbf9e3ec" returned: 0 in 1.352s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:47:07 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-e8e5084f-54f3-425b-9698-cbcb1ff67cf5 tempest-GroupsTest-83699162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-9c675892-45aa-49e1-9fe9-3ca5dbf9e3ec {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:47:07 devstack sudo[93044]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-9c675892-45aa-49e1-9fe9-3ca5dbf9e3ec
Jul 02 19:47:07 devstack sudo[93044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:47:08 devstack sudo[93044]: pam_unix(sudo:session): session closed for user root
Jul 02 19:47:08 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-e8e5084f-54f3-425b-9698-cbcb1ff67cf5 tempest-GroupsTest-83699162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-9c675892-45aa-49e1-9fe9-3ca5dbf9e3ec" returned: 0 in 1.460s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:47:08 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-e8e5084f-54f3-425b-9698-cbcb1ff67cf5 tempest-GroupsTest-83699162 None] Lock "cinder-quobyte-9c675892-45aa-49e1-9fe9-3ca5dbf9e3ec" released by "delete_volume" :: held 2.924s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:47:11 devstack cinder-volume[86639]: DEBUG cinder.quota [None req-e8e5084f-54f3-425b-9698-cbcb1ff67cf5 tempest-GroupsTest-83699162 None] Created reservations ['8a004c1e-d416-40c0-a47c-db805b34f08b'] {{(pid=86639) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 19:47:11 devstack cinder-volume[86639]: WARNING cinder.quota [None req-e8e5084f-54f3-425b-9698-cbcb1ff67cf5 tempest-GroupsTest-83699162 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-287235034 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-287235034, it is now deprecated. Please use the default quota class for default quota.
Jul 02 19:47:11 devstack cinder-volume[86639]: WARNING cinder.quota [None req-e8e5084f-54f3-425b-9698-cbcb1ff67cf5 tempest-GroupsTest-83699162 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-287235034 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-287235034, it is now deprecated. Please use the default quota class for default quota.
Jul 02 19:47:11 devstack cinder-volume[86639]: DEBUG cinder.quota [None req-e8e5084f-54f3-425b-9698-cbcb1ff67cf5 tempest-GroupsTest-83699162 None] Created reservations ['f19bdde3-40b5-4239-9f39-d70fc2d5ecc8', '9f2ac9f5-3f3f-4dbb-8119-a9ef7fa57193', '1f0d9657-a74b-451a-b7ab-1d8981ab83a7', '7f7600bf-4fe4-48c4-abbc-8dec4ce89977'] {{(pid=86639) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 19:47:12 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-e8e5084f-54f3-425b-9698-cbcb1ff67cf5 tempest-GroupsTest-83699162 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:47:12 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-e8e5084f-54f3-425b-9698-cbcb1ff67cf5 tempest-GroupsTest-83699162 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:47:12 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-e8e5084f-54f3-425b-9698-cbcb1ff67cf5 tempest-GroupsTest-83699162 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 19:47:12 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-e8e5084f-54f3-425b-9698-cbcb1ff67cf5 tempest-GroupsTest-83699162 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 19:47:12 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-e8e5084f-54f3-425b-9698-cbcb1ff67cf5 tempest-GroupsTest-83699162 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:47:12 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-e8e5084f-54f3-425b-9698-cbcb1ff67cf5 tempest-GroupsTest-83699162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:47:12 devstack sudo[93084]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e
Jul 02 19:47:12 devstack sudo[93084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:47:13 devstack sudo[93084]: pam_unix(sudo:session): session closed for user root
Jul 02 19:47:13 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-e8e5084f-54f3-425b-9698-cbcb1ff67cf5 tempest-GroupsTest-83699162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e" returned: 0 in 1.235s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:47:13 devstack cinder-volume[86639]: DEBUG cinder.manager [None req-e8e5084f-54f3-425b-9698-cbcb1ff67cf5 tempest-GroupsTest-83699162 None] Notifying Schedulers of capabilities ... {{(pid=86639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 19:47:13 devstack cinder-volume[86639]: DEBUG cinder.quota [None req-e3d0e5db-937d-4212-b1d1-1996e3a8ac88 tempest-GroupsTest-83699162 None] Created reservations ['17bc8fdf-768c-4c69-a5ca-4505dfbbbd0e'] {{(pid=86639) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 19:47:13 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-e8e5084f-54f3-425b-9698-cbcb1ff67cf5 tempest-GroupsTest-83699162 None] Delete group completed successfully.
Jul 02 19:47:13 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-e3d0e5db-937d-4212-b1d1-1996e3a8ac88 tempest-GroupsTest-83699162 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:47:13 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-e3d0e5db-937d-4212-b1d1-1996e3a8ac88 tempest-GroupsTest-83699162 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:47:13 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-e3d0e5db-937d-4212-b1d1-1996e3a8ac88 tempest-GroupsTest-83699162 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 19:47:13 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-e3d0e5db-937d-4212-b1d1-1996e3a8ac88 tempest-GroupsTest-83699162 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 19:47:13 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-e3d0e5db-937d-4212-b1d1-1996e3a8ac88 tempest-GroupsTest-83699162 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:47:13 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-e3d0e5db-937d-4212-b1d1-1996e3a8ac88 tempest-GroupsTest-83699162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:47:13 devstack sudo[93090]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e
Jul 02 19:47:13 devstack sudo[93090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:47:14 devstack sudo[93090]: pam_unix(sudo:session): session closed for user root
Jul 02 19:47:14 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-e3d0e5db-937d-4212-b1d1-1996e3a8ac88 tempest-GroupsTest-83699162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e" returned: 0 in 1.327s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:47:14 devstack cinder-volume[86639]: DEBUG cinder.manager [None req-e3d0e5db-937d-4212-b1d1-1996e3a8ac88 tempest-GroupsTest-83699162 None] Notifying Schedulers of capabilities ... {{(pid=86639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 19:47:14 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-e3d0e5db-937d-4212-b1d1-1996e3a8ac88 tempest-GroupsTest-83699162 None] Delete group completed successfully.
Jul 02 19:47:15 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-298b54b2-2781-4909-a486-57b78087280a tempest-GroupsTest-83699162 None] Group tempest-GroupsTest-Group-779162927: creating
Jul 02 19:47:15 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-298b54b2-2781-4909-a486-57b78087280a tempest-GroupsTest-83699162 None] Group tempest-GroupsTest-Group-779162927: created successfully
Jul 02 19:47:15 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-298b54b2-2781-4909-a486-57b78087280a tempest-GroupsTest-83699162 None] Create group completed successfully.
Jul 02 19:47:17 devstack cinder-volume[86639]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3ef2a5d-784b-4982-a8d5-c70455669722 tempest-GroupsTest-83699162 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 19:47:17 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-d3ef2a5d-784b-4982-a8d5-c70455669722 tempest-GroupsTest-83699162 None] Flow 'volume_create_manager' (7746abaf-9e7e-4753-94e6-ac5a2e1d6dee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 19:47:17 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-d3ef2a5d-784b-4982-a8d5-c70455669722 tempest-GroupsTest-83699162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37ddb60c-fbee-4407-a952-194e3358d598) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:47:17 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-d3ef2a5d-784b-4982-a8d5-c70455669722 tempest-GroupsTest-83699162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37ddb60c-fbee-4407-a952-194e3358d598) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T17:47:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-823400320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=78b97965-99a0-45e9-9400-1f652605f292,host='devstack@QuobyteHD#QuobyteHD',id=f14bfd27-5334-4e84-bac9-6b656205b1bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2c8d1f7f4044ceabf88381219ee9128',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T17:47:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T17:47:17Z,use_quota=True,user_id='dc485e006fbf492bb9a7e2dc6245ae12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90b04fbb-6294-4c07-97d3-efa2bbe9c6b4),volume_type_id=90b04fbb-6294-4c07-97d3-efa2bbe9c6b4)' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:47:17 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-d3ef2a5d-784b-4982-a8d5-c70455669722 tempest-GroupsTest-83699162 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55e07890-9da9-4cb3-8fb6-9e24ed113184) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:47:17 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-d3ef2a5d-784b-4982-a8d5-c70455669722 tempest-GroupsTest-83699162 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55e07890-9da9-4cb3-8fb6-9e24ed113184) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:47:17 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-d3ef2a5d-784b-4982-a8d5-c70455669722 tempest-GroupsTest-83699162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c6e55dc-8e34-4b2a-8aae-75b42b5e80ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:47:17 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-d3ef2a5d-784b-4982-a8d5-c70455669722 tempest-GroupsTest-83699162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c6e55dc-8e34-4b2a-8aae-75b42b5e80ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f14bfd27-5334-4e84-bac9-6b656205b1bb', 'volume_name': 'volume-f14bfd27-5334-4e84-bac9-6b656205b1bb', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:47:17 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-d3ef2a5d-784b-4982-a8d5-c70455669722 tempest-GroupsTest-83699162 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4310b0e4-3689-451d-9573-735c51140f09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:47:17 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-d3ef2a5d-784b-4982-a8d5-c70455669722 tempest-GroupsTest-83699162 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4310b0e4-3689-451d-9573-735c51140f09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:47:17 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-d3ef2a5d-784b-4982-a8d5-c70455669722 tempest-GroupsTest-83699162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (226dc262-6521-4fc2-a9fc-a64f53be2ecc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:47:17 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-d3ef2a5d-784b-4982-a8d5-c70455669722 tempest-GroupsTest-83699162 None] Volume f14bfd27-5334-4e84-bac9-6b656205b1bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f14bfd27-5334-4e84-bac9-6b656205b1bb', 'volume_size': 1}
Jul 02 19:47:17 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-d3ef2a5d-784b-4982-a8d5-c70455669722 tempest-GroupsTest-83699162 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:47:17 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-d3ef2a5d-784b-4982-a8d5-c70455669722 tempest-GroupsTest-83699162 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:47:17 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-d3ef2a5d-784b-4982-a8d5-c70455669722 tempest-GroupsTest-83699162 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce906cb830>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=78b97965-99a0-45e9-9400-1f652605f292,created_at=2026-07-02T17:47:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-823400320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=78b97965-99a0-45e9-9400-1f652605f292,host='devstack@QuobyteHD#QuobyteHD',id=f14bfd27-5334-4e84-bac9-6b656205b1bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2c8d1f7f4044ceabf88381219ee9128',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T17:47:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T17:47:17Z,use_quota=True,user_id='dc485e006fbf492bb9a7e2dc6245ae12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90b04fbb-6294-4c07-97d3-efa2bbe9c6b4),volume_type_id=90b04fbb-6294-4c07-97d3-efa2bbe9c6b4)}" {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 19:47:17 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-d3ef2a5d-784b-4982-a8d5-c70455669722 tempest-GroupsTest-83699162 None] Creating volume f14bfd27-5334-4e84-bac9-6b656205b1bb {{(pid=86639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 19:47:17 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-d3ef2a5d-784b-4982-a8d5-c70455669722 tempest-GroupsTest-83699162 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:47:17 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-d3ef2a5d-784b-4982-a8d5-c70455669722 tempest-GroupsTest-83699162 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:47:17 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-d3ef2a5d-784b-4982-a8d5-c70455669722 tempest-GroupsTest-83699162 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 19:47:17 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-d3ef2a5d-784b-4982-a8d5-c70455669722 tempest-GroupsTest-83699162 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 19:47:17 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-d3ef2a5d-784b-4982-a8d5-c70455669722 tempest-GroupsTest-83699162 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:47:17 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-d3ef2a5d-784b-4982-a8d5-c70455669722 tempest-GroupsTest-83699162 None] Selected osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92 as target Quobyte volume. {{(pid=86639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 19:47:17 devstack cinder-volume[86639]: INFO cinder.volume.drivers.remotefs [None req-d3ef2a5d-784b-4982-a8d5-c70455669722 tempest-GroupsTest-83699162 None] casted to osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92
Jul 02 19:47:17 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-d3ef2a5d-784b-4982-a8d5-c70455669722 tempest-GroupsTest-83699162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-f14bfd27-5334-4e84-bac9-6b656205b1bb 1073741824 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:47:17 devstack sudo[93113]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-f14bfd27-5334-4e84-bac9-6b656205b1bb 1073741824
Jul 02 19:47:17 devstack sudo[93113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:47:18 devstack sudo[93113]: pam_unix(sudo:session): session closed for user root
Jul 02 19:47:18 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-d3ef2a5d-784b-4982-a8d5-c70455669722 tempest-GroupsTest-83699162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-f14bfd27-5334-4e84-bac9-6b656205b1bb 1073741824" returned: 0 in 1.148s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:47:18 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-d3ef2a5d-784b-4982-a8d5-c70455669722 tempest-GroupsTest-83699162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-f14bfd27-5334-4e84-bac9-6b656205b1bb {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:47:18 devstack sudo[93154]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-f14bfd27-5334-4e84-bac9-6b656205b1bb
Jul 02 19:47:18 devstack sudo[93154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:47:19 devstack sudo[93154]: pam_unix(sudo:session): session closed for user root
Jul 02 19:47:19 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-d3ef2a5d-784b-4982-a8d5-c70455669722 tempest-GroupsTest-83699162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-f14bfd27-5334-4e84-bac9-6b656205b1bb" returned: 0 in 0.835s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:47:19 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-d3ef2a5d-784b-4982-a8d5-c70455669722 tempest-GroupsTest-83699162 None] <== create_volume: return (2056ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'} {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 19:47:19 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-d3ef2a5d-784b-4982-a8d5-c70455669722 tempest-GroupsTest-83699162 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.060s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:47:19 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-d3ef2a5d-784b-4982-a8d5-c70455669722 tempest-GroupsTest-83699162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (226dc262-6521-4fc2-a9fc-a64f53be2ecc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f14bfd27-5334-4e84-bac9-6b656205b1bb', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:47:19 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-d3ef2a5d-784b-4982-a8d5-c70455669722 tempest-GroupsTest-83699162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (472f80df-08e3-4e02-9fe1-bd036206c071) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:47:19 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-d3ef2a5d-784b-4982-a8d5-c70455669722 tempest-GroupsTest-83699162 None] Volume volume-f14bfd27-5334-4e84-bac9-6b656205b1bb (f14bfd27-5334-4e84-bac9-6b656205b1bb): created successfully
Jul 02 19:47:19 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-d3ef2a5d-784b-4982-a8d5-c70455669722 tempest-GroupsTest-83699162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (472f80df-08e3-4e02-9fe1-bd036206c071) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:47:19 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-d3ef2a5d-784b-4982-a8d5-c70455669722 tempest-GroupsTest-83699162 None] Flow 'volume_create_manager' (7746abaf-9e7e-4753-94e6-ac5a2e1d6dee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 19:47:19 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-d3ef2a5d-784b-4982-a8d5-c70455669722 tempest-GroupsTest-83699162 None] Created volume successfully.
Jul 02 19:47:20 devstack cinder-volume[86639]: DEBUG cinder.volume.flows.manager.create_volume [None req-2db6bc7b-7713-4da1-8734-898ab1eb5ddb tempest-GroupsTest-83699162 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 19:47:20 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-2db6bc7b-7713-4da1-8734-898ab1eb5ddb tempest-GroupsTest-83699162 None] Flow 'volume_create_manager' (00f590e4-3b98-495e-9638-25acf4420878) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 19:47:20 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-2db6bc7b-7713-4da1-8734-898ab1eb5ddb tempest-GroupsTest-83699162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76653aac-6a0c-4c6b-aa72-63ee3a503106) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:47:20 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-2db6bc7b-7713-4da1-8734-898ab1eb5ddb tempest-GroupsTest-83699162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76653aac-6a0c-4c6b-aa72-63ee3a503106) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T17:47:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1216240525',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=78b97965-99a0-45e9-9400-1f652605f292,host='devstack@QuobyteHD#QuobyteHD',id=7d29c09f-9990-45cb-bce9-e3e002d5d5de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2c8d1f7f4044ceabf88381219ee9128',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T17:47:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T17:47:21Z,use_quota=True,user_id='dc485e006fbf492bb9a7e2dc6245ae12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90b04fbb-6294-4c07-97d3-efa2bbe9c6b4),volume_type_id=90b04fbb-6294-4c07-97d3-efa2bbe9c6b4)' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:47:20 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-2db6bc7b-7713-4da1-8734-898ab1eb5ddb tempest-GroupsTest-83699162 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0561b8b-ba5e-435e-998e-08d8ac272cd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:47:20 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-2db6bc7b-7713-4da1-8734-898ab1eb5ddb tempest-GroupsTest-83699162 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0561b8b-ba5e-435e-998e-08d8ac272cd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:47:20 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-2db6bc7b-7713-4da1-8734-898ab1eb5ddb tempest-GroupsTest-83699162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10f6e744-5df6-4736-8e62-8f7a85606fdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:47:20 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-2db6bc7b-7713-4da1-8734-898ab1eb5ddb tempest-GroupsTest-83699162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10f6e744-5df6-4736-8e62-8f7a85606fdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d29c09f-9990-45cb-bce9-e3e002d5d5de', 'volume_name': 'volume-7d29c09f-9990-45cb-bce9-e3e002d5d5de', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:47:20 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-2db6bc7b-7713-4da1-8734-898ab1eb5ddb tempest-GroupsTest-83699162 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (849e1e3b-257e-43d4-b436-c84c94ae816c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:47:20 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-2db6bc7b-7713-4da1-8734-898ab1eb5ddb tempest-GroupsTest-83699162 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (849e1e3b-257e-43d4-b436-c84c94ae816c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:47:20 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-2db6bc7b-7713-4da1-8734-898ab1eb5ddb tempest-GroupsTest-83699162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26ffb0da-743b-4cdf-bc9a-78681867a3cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:47:20 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-2db6bc7b-7713-4da1-8734-898ab1eb5ddb tempest-GroupsTest-83699162 None] Volume 7d29c09f-9990-45cb-bce9-e3e002d5d5de: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d29c09f-9990-45cb-bce9-e3e002d5d5de', 'volume_size': 1}
Jul 02 19:47:20 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-2db6bc7b-7713-4da1-8734-898ab1eb5ddb tempest-GroupsTest-83699162 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:47:20 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-2db6bc7b-7713-4da1-8734-898ab1eb5ddb tempest-GroupsTest-83699162 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:47:20 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-2db6bc7b-7713-4da1-8734-898ab1eb5ddb tempest-GroupsTest-83699162 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce906cb830>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=78b97965-99a0-45e9-9400-1f652605f292,created_at=2026-07-02T17:47:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1216240525',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=78b97965-99a0-45e9-9400-1f652605f292,host='devstack@QuobyteHD#QuobyteHD',id=7d29c09f-9990-45cb-bce9-e3e002d5d5de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2c8d1f7f4044ceabf88381219ee9128',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T17:47:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T17:47:21Z,use_quota=True,user_id='dc485e006fbf492bb9a7e2dc6245ae12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90b04fbb-6294-4c07-97d3-efa2bbe9c6b4),volume_type_id=90b04fbb-6294-4c07-97d3-efa2bbe9c6b4)}" {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 19:47:20 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-2db6bc7b-7713-4da1-8734-898ab1eb5ddb tempest-GroupsTest-83699162 None] Creating volume 7d29c09f-9990-45cb-bce9-e3e002d5d5de {{(pid=86639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 19:47:20 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-2db6bc7b-7713-4da1-8734-898ab1eb5ddb tempest-GroupsTest-83699162 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:47:20 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-2db6bc7b-7713-4da1-8734-898ab1eb5ddb tempest-GroupsTest-83699162 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:47:20 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-2db6bc7b-7713-4da1-8734-898ab1eb5ddb tempest-GroupsTest-83699162 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 19:47:20 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-2db6bc7b-7713-4da1-8734-898ab1eb5ddb tempest-GroupsTest-83699162 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 19:47:20 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-2db6bc7b-7713-4da1-8734-898ab1eb5ddb tempest-GroupsTest-83699162 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:47:20 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-2db6bc7b-7713-4da1-8734-898ab1eb5ddb tempest-GroupsTest-83699162 None] Selected osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92 as target Quobyte volume. {{(pid=86639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 19:47:20 devstack cinder-volume[86639]: INFO cinder.volume.drivers.remotefs [None req-2db6bc7b-7713-4da1-8734-898ab1eb5ddb tempest-GroupsTest-83699162 None] casted to osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92
Jul 02 19:47:20 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-2db6bc7b-7713-4da1-8734-898ab1eb5ddb tempest-GroupsTest-83699162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-7d29c09f-9990-45cb-bce9-e3e002d5d5de 1073741824 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:47:20 devstack sudo[93160]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-7d29c09f-9990-45cb-bce9-e3e002d5d5de 1073741824
Jul 02 19:47:20 devstack sudo[93160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:47:21 devstack sudo[93160]: pam_unix(sudo:session): session closed for user root
Jul 02 19:47:21 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-2db6bc7b-7713-4da1-8734-898ab1eb5ddb tempest-GroupsTest-83699162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-7d29c09f-9990-45cb-bce9-e3e002d5d5de 1073741824" returned: 0 in 1.049s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:47:21 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-2db6bc7b-7713-4da1-8734-898ab1eb5ddb tempest-GroupsTest-83699162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-7d29c09f-9990-45cb-bce9-e3e002d5d5de {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:47:21 devstack sudo[93200]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-7d29c09f-9990-45cb-bce9-e3e002d5d5de
Jul 02 19:47:21 devstack sudo[93200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:47:22 devstack sudo[93200]: pam_unix(sudo:session): session closed for user root
Jul 02 19:47:22 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-2db6bc7b-7713-4da1-8734-898ab1eb5ddb tempest-GroupsTest-83699162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-7d29c09f-9990-45cb-bce9-e3e002d5d5de" returned: 0 in 0.804s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:47:22 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-2db6bc7b-7713-4da1-8734-898ab1eb5ddb tempest-GroupsTest-83699162 None] <== create_volume: return (1924ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'} {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 19:47:22 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-2db6bc7b-7713-4da1-8734-898ab1eb5ddb tempest-GroupsTest-83699162 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.927s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:47:22 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-2db6bc7b-7713-4da1-8734-898ab1eb5ddb tempest-GroupsTest-83699162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26ffb0da-743b-4cdf-bc9a-78681867a3cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d29c09f-9990-45cb-bce9-e3e002d5d5de', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:47:22 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-2db6bc7b-7713-4da1-8734-898ab1eb5ddb tempest-GroupsTest-83699162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c4bb553-4b87-43b6-a3f4-62c74935f4a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:47:22 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-2db6bc7b-7713-4da1-8734-898ab1eb5ddb tempest-GroupsTest-83699162 None] Volume volume-7d29c09f-9990-45cb-bce9-e3e002d5d5de (7d29c09f-9990-45cb-bce9-e3e002d5d5de): created successfully
Jul 02 19:47:22 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-2db6bc7b-7713-4da1-8734-898ab1eb5ddb tempest-GroupsTest-83699162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c4bb553-4b87-43b6-a3f4-62c74935f4a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:47:22 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-2db6bc7b-7713-4da1-8734-898ab1eb5ddb tempest-GroupsTest-83699162 None] Flow 'volume_create_manager' (00f590e4-3b98-495e-9638-25acf4420878) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 19:47:22 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-2db6bc7b-7713-4da1-8734-898ab1eb5ddb tempest-GroupsTest-83699162 None] Created volume successfully.
Jul 02 19:47:23 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-11deaa16-016b-409e-9cd2-f4c7a62d97f9 tempest-GroupsTest-83699162 None] Update group completed successfully.
Jul 02 19:47:25 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-6b376354-304e-4d38-bf2a-825705d82252 tempest-GroupsTest-83699162 None] Update group completed successfully.
Jul 02 19:47:26 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-e54b9c82-324d-421d-8108-b0023effc5a3 tempest-GroupsTest-83699162 None] Acquiring lock "cinder-quobyte-7d29c09f-9990-45cb-bce9-e3e002d5d5de" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:47:26 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-e54b9c82-324d-421d-8108-b0023effc5a3 tempest-GroupsTest-83699162 None] Lock "cinder-quobyte-7d29c09f-9990-45cb-bce9-e3e002d5d5de" acquired by "delete_volume" :: waited 0.023s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:47:26 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a082d4b-ff2e-4d17-850b-d3f04067851c]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 19:47:26 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-e54b9c82-324d-421d-8108-b0023effc5a3 tempest-GroupsTest-83699162 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-7d29c09f-9990-45cb-bce9-e3e002d5d5de {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:47:27 devstack sudo[93213]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-7d29c09f-9990-45cb-bce9-e3e002d5d5de
Jul 02 19:47:27 devstack sudo[93213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:47:27 devstack cinder-volume[86639]: DEBUG cinder.volume.flows.manager.create_volume [None req-0267f188-471b-4844-801e-02247bfa27eb tempest-AttachVolumeTestJSON-1400825288 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 19:47:27 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-0267f188-471b-4844-801e-02247bfa27eb tempest-AttachVolumeTestJSON-1400825288 None] Flow 'volume_create_manager' (9256ec9b-2dc1-488c-ba96-91d6c7a21833) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 19:47:27 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-0267f188-471b-4844-801e-02247bfa27eb tempest-AttachVolumeTestJSON-1400825288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a040d932-fabe-4b3d-81f1-ae65a9b8d968) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:47:27 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-0267f188-471b-4844-801e-02247bfa27eb tempest-AttachVolumeTestJSON-1400825288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a040d932-fabe-4b3d-81f1-ae65a9b8d968) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T17:47:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1621904597',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e389181-2bfe-4234-bb77-d4f4a7b5de07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f6a9a1c5d504a128308722e4f105bba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T17:47:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T17:47:28Z,use_quota=True,user_id='0bd5c732a9864ab3b47fb15ac6ec17ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:47:27 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-0267f188-471b-4844-801e-02247bfa27eb tempest-AttachVolumeTestJSON-1400825288 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d4580ac-30b8-470b-9844-7f33a580000a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:47:27 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-0267f188-471b-4844-801e-02247bfa27eb tempest-AttachVolumeTestJSON-1400825288 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d4580ac-30b8-470b-9844-7f33a580000a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:47:27 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-0267f188-471b-4844-801e-02247bfa27eb tempest-AttachVolumeTestJSON-1400825288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efe3bab7-29a3-4570-ba29-3f8cad61d3b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:47:28 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-0267f188-471b-4844-801e-02247bfa27eb tempest-AttachVolumeTestJSON-1400825288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efe3bab7-29a3-4570-ba29-3f8cad61d3b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2e389181-2bfe-4234-bb77-d4f4a7b5de07', 'volume_name': 'volume-2e389181-2bfe-4234-bb77-d4f4a7b5de07', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:47:28 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-0267f188-471b-4844-801e-02247bfa27eb tempest-AttachVolumeTestJSON-1400825288 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96de824c-b5f9-4a0e-869d-b307484328b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:47:28 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-0267f188-471b-4844-801e-02247bfa27eb tempest-AttachVolumeTestJSON-1400825288 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96de824c-b5f9-4a0e-869d-b307484328b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:47:28 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-0267f188-471b-4844-801e-02247bfa27eb tempest-AttachVolumeTestJSON-1400825288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b71e324-69b8-41f0-a0a4-39a4631d0fe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:47:28 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-0267f188-471b-4844-801e-02247bfa27eb tempest-AttachVolumeTestJSON-1400825288 None] Volume 2e389181-2bfe-4234-bb77-d4f4a7b5de07: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2e389181-2bfe-4234-bb77-d4f4a7b5de07', 'volume_size': 1}
Jul 02 19:47:28 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-0267f188-471b-4844-801e-02247bfa27eb tempest-AttachVolumeTestJSON-1400825288 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:47:28 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-0267f188-471b-4844-801e-02247bfa27eb tempest-AttachVolumeTestJSON-1400825288 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:47:28 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-0267f188-471b-4844-801e-02247bfa27eb tempest-AttachVolumeTestJSON-1400825288 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce906cb830>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T17:47:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1621904597',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e389181-2bfe-4234-bb77-d4f4a7b5de07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f6a9a1c5d504a128308722e4f105bba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T17:47:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T17:47:28Z,use_quota=True,user_id='0bd5c732a9864ab3b47fb15ac6ec17ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)}" {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 19:47:28 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-0267f188-471b-4844-801e-02247bfa27eb tempest-AttachVolumeTestJSON-1400825288 None] Creating volume 2e389181-2bfe-4234-bb77-d4f4a7b5de07 {{(pid=86639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 19:47:28 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-0267f188-471b-4844-801e-02247bfa27eb tempest-AttachVolumeTestJSON-1400825288 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:47:28 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-0267f188-471b-4844-801e-02247bfa27eb tempest-AttachVolumeTestJSON-1400825288 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:47:28 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-0267f188-471b-4844-801e-02247bfa27eb tempest-AttachVolumeTestJSON-1400825288 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 19:47:28 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-0267f188-471b-4844-801e-02247bfa27eb tempest-AttachVolumeTestJSON-1400825288 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 19:47:28 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-0267f188-471b-4844-801e-02247bfa27eb tempest-AttachVolumeTestJSON-1400825288 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:47:28 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-0267f188-471b-4844-801e-02247bfa27eb tempest-AttachVolumeTestJSON-1400825288 None] Selected osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92 as target Quobyte volume. {{(pid=86639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 19:47:28 devstack cinder-volume[86639]: INFO cinder.volume.drivers.remotefs [None req-0267f188-471b-4844-801e-02247bfa27eb tempest-AttachVolumeTestJSON-1400825288 None] casted to osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92
Jul 02 19:47:28 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-0267f188-471b-4844-801e-02247bfa27eb tempest-AttachVolumeTestJSON-1400825288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-2e389181-2bfe-4234-bb77-d4f4a7b5de07 1073741824 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:47:28 devstack sudo[93218]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-2e389181-2bfe-4234-bb77-d4f4a7b5de07 1073741824
Jul 02 19:47:28 devstack sudo[93218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:47:28 devstack sudo[93213]: pam_unix(sudo:session): session closed for user root
Jul 02 19:47:28 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-e54b9c82-324d-421d-8108-b0023effc5a3 tempest-GroupsTest-83699162 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-7d29c09f-9990-45cb-bce9-e3e002d5d5de" returned: 0 in 1.244s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:47:28 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-e54b9c82-324d-421d-8108-b0023effc5a3 tempest-GroupsTest-83699162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-7d29c09f-9990-45cb-bce9-e3e002d5d5de {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:47:28 devstack sudo[93220]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-7d29c09f-9990-45cb-bce9-e3e002d5d5de
Jul 02 19:47:28 devstack sudo[93220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:47:29 devstack sudo[93220]: pam_unix(sudo:session): session closed for user root
Jul 02 19:47:29 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-e54b9c82-324d-421d-8108-b0023effc5a3 tempest-GroupsTest-83699162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-7d29c09f-9990-45cb-bce9-e3e002d5d5de" returned: 0 in 0.868s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:47:29 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-e54b9c82-324d-421d-8108-b0023effc5a3 tempest-GroupsTest-83699162 None] Lock "cinder-quobyte-7d29c09f-9990-45cb-bce9-e3e002d5d5de" released by "delete_volume" :: held 2.197s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:47:29 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-e54b9c82-324d-421d-8108-b0023effc5a3 tempest-GroupsTest-83699162 None] Acquiring lock "cinder-quobyte-f14bfd27-5334-4e84-bac9-6b656205b1bb" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:47:29 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-e54b9c82-324d-421d-8108-b0023effc5a3 tempest-GroupsTest-83699162 None] Lock "cinder-quobyte-f14bfd27-5334-4e84-bac9-6b656205b1bb" acquired by "delete_volume" :: waited 0.030s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:47:29 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[b478a6f9-2acc-4def-8502-7ee066f5fcb4]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 19:47:29 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-e54b9c82-324d-421d-8108-b0023effc5a3 tempest-GroupsTest-83699162 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-f14bfd27-5334-4e84-bac9-6b656205b1bb {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:47:29 devstack sudo[93218]: pam_unix(sudo:session): session closed for user root
Jul 02 19:47:29 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-0267f188-471b-4844-801e-02247bfa27eb tempest-AttachVolumeTestJSON-1400825288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-2e389181-2bfe-4234-bb77-d4f4a7b5de07 1073741824" returned: 0 in 1.111s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:47:29 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-0267f188-471b-4844-801e-02247bfa27eb tempest-AttachVolumeTestJSON-1400825288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-2e389181-2bfe-4234-bb77-d4f4a7b5de07 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:47:29 devstack sudo[93229]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-2e389181-2bfe-4234-bb77-d4f4a7b5de07
Jul 02 19:47:29 devstack sudo[93229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:47:29 devstack sudo[93228]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-f14bfd27-5334-4e84-bac9-6b656205b1bb
Jul 02 19:47:29 devstack sudo[93228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:47:30 devstack sudo[93229]: pam_unix(sudo:session): session closed for user root
Jul 02 19:47:30 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-0267f188-471b-4844-801e-02247bfa27eb tempest-AttachVolumeTestJSON-1400825288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-2e389181-2bfe-4234-bb77-d4f4a7b5de07" returned: 0 in 0.795s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:47:30 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-0267f188-471b-4844-801e-02247bfa27eb tempest-AttachVolumeTestJSON-1400825288 None] <== create_volume: return (2012ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'} {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 19:47:30 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-0267f188-471b-4844-801e-02247bfa27eb tempest-AttachVolumeTestJSON-1400825288 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.020s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:47:30 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-0267f188-471b-4844-801e-02247bfa27eb tempest-AttachVolumeTestJSON-1400825288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b71e324-69b8-41f0-a0a4-39a4631d0fe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e389181-2bfe-4234-bb77-d4f4a7b5de07', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:47:30 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-0267f188-471b-4844-801e-02247bfa27eb tempest-AttachVolumeTestJSON-1400825288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74ad5452-dc11-4717-afbe-329c1dcc57a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:47:30 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-0267f188-471b-4844-801e-02247bfa27eb tempest-AttachVolumeTestJSON-1400825288 None] Volume volume-2e389181-2bfe-4234-bb77-d4f4a7b5de07 (2e389181-2bfe-4234-bb77-d4f4a7b5de07): created successfully
Jul 02 19:47:30 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-0267f188-471b-4844-801e-02247bfa27eb tempest-AttachVolumeTestJSON-1400825288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74ad5452-dc11-4717-afbe-329c1dcc57a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:47:30 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-0267f188-471b-4844-801e-02247bfa27eb tempest-AttachVolumeTestJSON-1400825288 None] Flow 'volume_create_manager' (9256ec9b-2dc1-488c-ba96-91d6c7a21833) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 19:47:30 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-0267f188-471b-4844-801e-02247bfa27eb tempest-AttachVolumeTestJSON-1400825288 None] Created volume successfully.
Jul 02 19:47:30 devstack sudo[93228]: pam_unix(sudo:session): session closed for user root
Jul 02 19:47:30 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-e54b9c82-324d-421d-8108-b0023effc5a3 tempest-GroupsTest-83699162 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-f14bfd27-5334-4e84-bac9-6b656205b1bb" returned: 0 in 0.997s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:47:30 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-e54b9c82-324d-421d-8108-b0023effc5a3 tempest-GroupsTest-83699162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-f14bfd27-5334-4e84-bac9-6b656205b1bb {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:47:30 devstack sudo[93237]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-f14bfd27-5334-4e84-bac9-6b656205b1bb
Jul 02 19:47:30 devstack sudo[93237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:47:31 devstack sudo[93237]: pam_unix(sudo:session): session closed for user root
Jul 02 19:47:31 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-e54b9c82-324d-421d-8108-b0023effc5a3 tempest-GroupsTest-83699162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-f14bfd27-5334-4e84-bac9-6b656205b1bb" returned: 0 in 1.001s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:47:31 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-e54b9c82-324d-421d-8108-b0023effc5a3 tempest-GroupsTest-83699162 None] Lock "cinder-quobyte-f14bfd27-5334-4e84-bac9-6b656205b1bb" released by "delete_volume" :: held 2.098s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:47:31 devstack cinder-volume[86639]: DEBUG cinder.quota [None req-e54b9c82-324d-421d-8108-b0023effc5a3 tempest-GroupsTest-83699162 None] Created reservations ['ce194eb5-36f2-41ac-8419-a4b46368e39b'] {{(pid=86639) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 19:47:31 devstack cinder-volume[86639]: WARNING cinder.quota [None req-e54b9c82-324d-421d-8108-b0023effc5a3 tempest-GroupsTest-83699162 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-558787142 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-558787142, it is now deprecated. Please use the default quota class for default quota.
Jul 02 19:47:31 devstack cinder-volume[86639]: WARNING cinder.quota [None req-e54b9c82-324d-421d-8108-b0023effc5a3 tempest-GroupsTest-83699162 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-558787142 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-558787142, it is now deprecated. Please use the default quota class for default quota.
Jul 02 19:47:31 devstack cinder-volume[86639]: DEBUG cinder.quota [None req-e54b9c82-324d-421d-8108-b0023effc5a3 tempest-GroupsTest-83699162 None] Created reservations ['35a2e1a5-95c5-4dea-80ab-b725427643cd', '22a6116e-89d1-4e15-867f-154a140c16f2', 'da7766ea-68f4-4775-a5aa-ea76f29fc216', '4ae302af-cafb-4d34-854b-01821b547422'] {{(pid=86639) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 19:47:31 devstack cinder-volume[86639]: DEBUG cinder.quota [None req-e54b9c82-324d-421d-8108-b0023effc5a3 tempest-GroupsTest-83699162 None] Created reservations ['6e631c98-7b49-4ddf-8c54-e64fefdf0269', '158bb0c1-701b-4d8b-ac4b-a4153a1ef31e', 'a8548e51-8ee0-49f4-b3b3-84db2771a1b2', 'a6994824-f91a-4f2d-9be4-984c59ade1e2'] {{(pid=86639) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 19:47:31 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-e54b9c82-324d-421d-8108-b0023effc5a3 tempest-GroupsTest-83699162 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:47:31 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-e54b9c82-324d-421d-8108-b0023effc5a3 tempest-GroupsTest-83699162 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:47:31 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-e54b9c82-324d-421d-8108-b0023effc5a3 tempest-GroupsTest-83699162 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 19:47:31 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-e54b9c82-324d-421d-8108-b0023effc5a3 tempest-GroupsTest-83699162 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 19:47:31 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-e54b9c82-324d-421d-8108-b0023effc5a3 tempest-GroupsTest-83699162 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.036s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:47:31 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-e54b9c82-324d-421d-8108-b0023effc5a3 tempest-GroupsTest-83699162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:47:31 devstack sudo[93254]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e
Jul 02 19:47:31 devstack sudo[93254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:47:32 devstack sudo[93254]: pam_unix(sudo:session): session closed for user root
Jul 02 19:47:32 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-e54b9c82-324d-421d-8108-b0023effc5a3 tempest-GroupsTest-83699162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e" returned: 0 in 1.159s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:47:32 devstack cinder-volume[86639]: DEBUG cinder.manager [None req-e54b9c82-324d-421d-8108-b0023effc5a3 tempest-GroupsTest-83699162 None] Notifying Schedulers of capabilities ... {{(pid=86639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 19:47:32 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-e54b9c82-324d-421d-8108-b0023effc5a3 tempest-GroupsTest-83699162 None] Delete group completed successfully.
Jul 02 19:47:34 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [req-074f4828-05b6-4582-bdaa-83093f0f1cfa req-02040a00-faf3-4582-b5a3-d6fafa79df67 tempest-AttachVolumeTestJSON-1400825288 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:47:34 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [req-074f4828-05b6-4582-bdaa-83093f0f1cfa req-02040a00-faf3-4582-b5a3-d6fafa79df67 tempest-AttachVolumeTestJSON-1400825288 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:47:34 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[82df2ea9-72ad-4893-b8f4-a7a744447b0d]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 19:47:34 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [req-074f4828-05b6-4582-bdaa-83093f0f1cfa req-02040a00-faf3-4582-b5a3-d6fafa79df67 tempest-AttachVolumeTestJSON-1400825288 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-2e389181-2bfe-4234-bb77-d4f4a7b5de07 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:47:34 devstack sudo[93289]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-2e389181-2bfe-4234-bb77-d4f4a7b5de07
Jul 02 19:47:34 devstack sudo[93289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:47:35 devstack sudo[93289]: pam_unix(sudo:session): session closed for user root
Jul 02 19:47:35 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [req-074f4828-05b6-4582-bdaa-83093f0f1cfa req-02040a00-faf3-4582-b5a3-d6fafa79df67 tempest-AttachVolumeTestJSON-1400825288 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-2e389181-2bfe-4234-bb77-d4f4a7b5de07" returned: 0 in 1.158s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:47:35 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [req-074f4828-05b6-4582-bdaa-83093f0f1cfa req-02040a00-faf3-4582-b5a3-d6fafa79df67 tempest-AttachVolumeTestJSON-1400825288 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.199s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:47:35 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [req-074f4828-05b6-4582-bdaa-83093f0f1cfa req-02040a00-faf3-4582-b5a3-d6fafa79df67 tempest-AttachVolumeTestJSON-1400825288 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92', 'name': 'volume-2e389181-2bfe-4234-bb77-d4f4a7b5de07', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5b237010-3f13-402c-8f59-b1d18ca368b4', 'enforce_multipath': True} {{(pid=86639) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 02 19:47:35 devstack cinder-volume[86639]: INFO cinder.volume.manager [req-074f4828-05b6-4582-bdaa-83093f0f1cfa req-02040a00-faf3-4582-b5a3-d6fafa79df67 tempest-AttachVolumeTestJSON-1400825288 None] attachment_update completed successfully.
Jul 02 19:47:41 devstack cinder-volume[86639]: DEBUG oslo_service.periodic_task [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86639) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 02 19:47:41 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:47:41 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:47:41 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 19:47:41 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 19:47:41 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:47:41 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:47:41 devstack sudo[93700]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e
Jul 02 19:47:41 devstack sudo[93700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:47:41 devstack cinder-volume[86639]: DEBUG cinder.volume.flows.manager.create_volume [None req-22dc24f6-fdc4-44b6-98da-72f3fd10b0a2 tempest-AttachVolumeTestJSON-1400825288 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 19:47:41 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-22dc24f6-fdc4-44b6-98da-72f3fd10b0a2 tempest-AttachVolumeTestJSON-1400825288 None] Flow 'volume_create_manager' (ae29fb18-7f8a-489b-8890-e52a81850bfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 19:47:41 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-22dc24f6-fdc4-44b6-98da-72f3fd10b0a2 tempest-AttachVolumeTestJSON-1400825288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6307230-012d-462f-97ed-0351e0ca3397) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:47:41 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-22dc24f6-fdc4-44b6-98da-72f3fd10b0a2 tempest-AttachVolumeTestJSON-1400825288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6307230-012d-462f-97ed-0351e0ca3397) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T17:47:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1739814953',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f0d2a59-cd97-442f-9c8d-8a750fbcd95f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f6a9a1c5d504a128308722e4f105bba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T17:47:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T17:47:41Z,use_quota=True,user_id='0bd5c732a9864ab3b47fb15ac6ec17ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:47:41 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-22dc24f6-fdc4-44b6-98da-72f3fd10b0a2 tempest-AttachVolumeTestJSON-1400825288 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac959a97-b211-4413-b6cc-5e86b3dcb697) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:47:41 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-22dc24f6-fdc4-44b6-98da-72f3fd10b0a2 tempest-AttachVolumeTestJSON-1400825288 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac959a97-b211-4413-b6cc-5e86b3dcb697) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:47:41 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-22dc24f6-fdc4-44b6-98da-72f3fd10b0a2 tempest-AttachVolumeTestJSON-1400825288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4b82c57-0f46-478d-803a-079c43405704) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:47:41 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-22dc24f6-fdc4-44b6-98da-72f3fd10b0a2 tempest-AttachVolumeTestJSON-1400825288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4b82c57-0f46-478d-803a-079c43405704) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f0d2a59-cd97-442f-9c8d-8a750fbcd95f', 'volume_name': 'volume-2f0d2a59-cd97-442f-9c8d-8a750fbcd95f', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:47:41 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-22dc24f6-fdc4-44b6-98da-72f3fd10b0a2 tempest-AttachVolumeTestJSON-1400825288 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05184e71-6d3f-42a9-971e-43b96bb2a56e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:47:41 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-22dc24f6-fdc4-44b6-98da-72f3fd10b0a2 tempest-AttachVolumeTestJSON-1400825288 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05184e71-6d3f-42a9-971e-43b96bb2a56e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:47:41 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-22dc24f6-fdc4-44b6-98da-72f3fd10b0a2 tempest-AttachVolumeTestJSON-1400825288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5cece00a-d3f2-4a8a-b18f-02e77fa43f62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:47:41 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-22dc24f6-fdc4-44b6-98da-72f3fd10b0a2 tempest-AttachVolumeTestJSON-1400825288 None] Volume 2f0d2a59-cd97-442f-9c8d-8a750fbcd95f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f0d2a59-cd97-442f-9c8d-8a750fbcd95f', 'volume_size': 1}
Jul 02 19:47:41 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-22dc24f6-fdc4-44b6-98da-72f3fd10b0a2 tempest-AttachVolumeTestJSON-1400825288 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:47:41 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-22dc24f6-fdc4-44b6-98da-72f3fd10b0a2 tempest-AttachVolumeTestJSON-1400825288 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:47:41 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-22dc24f6-fdc4-44b6-98da-72f3fd10b0a2 tempest-AttachVolumeTestJSON-1400825288 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce906cb830>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T17:47:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1739814953',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f0d2a59-cd97-442f-9c8d-8a750fbcd95f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f6a9a1c5d504a128308722e4f105bba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T17:47:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T17:47:41Z,use_quota=True,user_id='0bd5c732a9864ab3b47fb15ac6ec17ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)}" {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 19:47:41 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-22dc24f6-fdc4-44b6-98da-72f3fd10b0a2 tempest-AttachVolumeTestJSON-1400825288 None] Creating volume 2f0d2a59-cd97-442f-9c8d-8a750fbcd95f {{(pid=86639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 19:47:41 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-22dc24f6-fdc4-44b6-98da-72f3fd10b0a2 tempest-AttachVolumeTestJSON-1400825288 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:47:41 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-22dc24f6-fdc4-44b6-98da-72f3fd10b0a2 tempest-AttachVolumeTestJSON-1400825288 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:47:41 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-22dc24f6-fdc4-44b6-98da-72f3fd10b0a2 tempest-AttachVolumeTestJSON-1400825288 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 19:47:41 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-22dc24f6-fdc4-44b6-98da-72f3fd10b0a2 tempest-AttachVolumeTestJSON-1400825288 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 19:47:41 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-22dc24f6-fdc4-44b6-98da-72f3fd10b0a2 tempest-AttachVolumeTestJSON-1400825288 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:47:41 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-22dc24f6-fdc4-44b6-98da-72f3fd10b0a2 tempest-AttachVolumeTestJSON-1400825288 None] Selected osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92 as target Quobyte volume. {{(pid=86639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 19:47:41 devstack cinder-volume[86639]: INFO cinder.volume.drivers.remotefs [None req-22dc24f6-fdc4-44b6-98da-72f3fd10b0a2 tempest-AttachVolumeTestJSON-1400825288 None] casted to osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92
Jul 02 19:47:41 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-22dc24f6-fdc4-44b6-98da-72f3fd10b0a2 tempest-AttachVolumeTestJSON-1400825288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-2f0d2a59-cd97-442f-9c8d-8a750fbcd95f 1073741824 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:47:41 devstack sudo[93720]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-2f0d2a59-cd97-442f-9c8d-8a750fbcd95f 1073741824
Jul 02 19:47:41 devstack sudo[93720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:47:43 devstack sudo[93720]: pam_unix(sudo:session): session closed for user root
Jul 02 19:47:43 devstack sudo[93700]: pam_unix(sudo:session): session closed for user root
Jul 02 19:47:43 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-22dc24f6-fdc4-44b6-98da-72f3fd10b0a2 tempest-AttachVolumeTestJSON-1400825288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-2f0d2a59-cd97-442f-9c8d-8a750fbcd95f 1073741824" returned: 0 in 1.775s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:47:43 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e" returned: 0 in 1.932s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:47:43 devstack cinder-volume[86639]: DEBUG cinder.manager [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] Notifying Schedulers of capabilities ... {{(pid=86639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 19:47:43 devstack cinder-volume[86639]: DEBUG oslo_service.periodic_task [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] Running periodic task VolumeManager._thread_info {{(pid=86639) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 02 19:47:43 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] thread count: 8 {{(pid=86639) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 02 19:47:43 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] thread info: [<_MainThread(MainThread, started 140525261275264)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 140525150678016)>, <Thread(Thread-3 (stat_writer), started daemon 140525150025920)>, <Thread(Rabbit-heartbeat, started daemon 140525150500864)>, <Thread(Thread-5 (_runner), started daemon 140525149847296)>, <Thread(Thread-7 (_runner), started daemon 140525149863424)>, <Thread(fd_logger, started daemon 140525146589376)>, <Thread(privsep_reader, started daemon 140525144562432)>] {{(pid=86639) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 02 19:47:43 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-22dc24f6-fdc4-44b6-98da-72f3fd10b0a2 tempest-AttachVolumeTestJSON-1400825288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-2f0d2a59-cd97-442f-9c8d-8a750fbcd95f {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:47:43 devstack sudo[93757]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-2f0d2a59-cd97-442f-9c8d-8a750fbcd95f
Jul 02 19:47:43 devstack sudo[93757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:47:44 devstack sudo[93757]: pam_unix(sudo:session): session closed for user root
Jul 02 19:47:44 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-22dc24f6-fdc4-44b6-98da-72f3fd10b0a2 tempest-AttachVolumeTestJSON-1400825288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-2f0d2a59-cd97-442f-9c8d-8a750fbcd95f" returned: 0 in 1.315s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:47:44 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-22dc24f6-fdc4-44b6-98da-72f3fd10b0a2 tempest-AttachVolumeTestJSON-1400825288 None] <== create_volume: return (3177ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'} {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 19:47:44 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-22dc24f6-fdc4-44b6-98da-72f3fd10b0a2 tempest-AttachVolumeTestJSON-1400825288 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.184s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:47:44 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-22dc24f6-fdc4-44b6-98da-72f3fd10b0a2 tempest-AttachVolumeTestJSON-1400825288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5cece00a-d3f2-4a8a-b18f-02e77fa43f62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f0d2a59-cd97-442f-9c8d-8a750fbcd95f', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:47:44 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-22dc24f6-fdc4-44b6-98da-72f3fd10b0a2 tempest-AttachVolumeTestJSON-1400825288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad5e2cfa-27c6-4239-95e6-19f24549bb42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:47:44 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-22dc24f6-fdc4-44b6-98da-72f3fd10b0a2 tempest-AttachVolumeTestJSON-1400825288 None] Volume volume-2f0d2a59-cd97-442f-9c8d-8a750fbcd95f (2f0d2a59-cd97-442f-9c8d-8a750fbcd95f): created successfully
Jul 02 19:47:44 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-22dc24f6-fdc4-44b6-98da-72f3fd10b0a2 tempest-AttachVolumeTestJSON-1400825288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad5e2cfa-27c6-4239-95e6-19f24549bb42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:47:45 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-22dc24f6-fdc4-44b6-98da-72f3fd10b0a2 tempest-AttachVolumeTestJSON-1400825288 None] Flow 'volume_create_manager' (ae29fb18-7f8a-489b-8890-e52a81850bfa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 19:47:45 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-22dc24f6-fdc4-44b6-98da-72f3fd10b0a2 tempest-AttachVolumeTestJSON-1400825288 None] Created volume successfully.
Jul 02 19:47:50 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [req-3ff3fc52-dd02-45da-9e6a-841eaf6801ef req-506b5761-e135-4ee5-850f-07d78358dfce tempest-AttachVolumeTestJSON-1400825288 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:47:50 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [req-3ff3fc52-dd02-45da-9e6a-841eaf6801ef req-506b5761-e135-4ee5-850f-07d78358dfce tempest-AttachVolumeTestJSON-1400825288 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:47:50 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3b7470f-e66f-4aa7-b594-dd227f330810]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 19:47:50 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [req-3ff3fc52-dd02-45da-9e6a-841eaf6801ef req-506b5761-e135-4ee5-850f-07d78358dfce tempest-AttachVolumeTestJSON-1400825288 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-2f0d2a59-cd97-442f-9c8d-8a750fbcd95f {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:47:50 devstack sudo[93774]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-2f0d2a59-cd97-442f-9c8d-8a750fbcd95f
Jul 02 19:47:50 devstack sudo[93774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:47:51 devstack sudo[93774]: pam_unix(sudo:session): session closed for user root
Jul 02 19:47:51 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [req-3ff3fc52-dd02-45da-9e6a-841eaf6801ef req-506b5761-e135-4ee5-850f-07d78358dfce tempest-AttachVolumeTestJSON-1400825288 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-2f0d2a59-cd97-442f-9c8d-8a750fbcd95f" returned: 0 in 1.171s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:47:51 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [req-3ff3fc52-dd02-45da-9e6a-841eaf6801ef req-506b5761-e135-4ee5-850f-07d78358dfce tempest-AttachVolumeTestJSON-1400825288 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.203s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:47:51 devstack cinder-volume[86639]: DEBUG dbcounter [-] [86639] Writing DB stats cinder:SELECT=59,cinder:UPDATE=59,cinder:INSERT=9,cinder:DELETE=2 {{(pid=86639) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 02 19:47:51 devstack cinder-volume[86639]: DEBUG dbcounter [-] [86639] Writing DB stats cinder:SELECT=56,cinder:UPDATE=63,cinder:INSERT=15,cinder:DELETE=4 {{(pid=86639) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 02 19:47:51 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [req-3ff3fc52-dd02-45da-9e6a-841eaf6801ef req-506b5761-e135-4ee5-850f-07d78358dfce tempest-AttachVolumeTestJSON-1400825288 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92', 'name': 'volume-2f0d2a59-cd97-442f-9c8d-8a750fbcd95f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0c6fcadd-d0e6-4486-9af9-6e374e2aa243', 'enforce_multipath': True} {{(pid=86639) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 02 19:47:51 devstack cinder-volume[86639]: INFO cinder.volume.manager [req-3ff3fc52-dd02-45da-9e6a-841eaf6801ef req-506b5761-e135-4ee5-850f-07d78358dfce tempest-AttachVolumeTestJSON-1400825288 None] attachment_update completed successfully.
Jul 02 19:47:53 devstack cinder-volume[86639]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b7be28c-d12d-49bf-b4da-ae3be3ee5f98 tempest-VolumeQuotasNegativeTestJSON-1303767000 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 19:47:53 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-5b7be28c-d12d-49bf-b4da-ae3be3ee5f98 tempest-VolumeQuotasNegativeTestJSON-1303767000 None] Flow 'volume_create_manager' (f6bc73c5-cad6-4be4-b188-d3deb2c8876e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 19:47:53 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-5b7be28c-d12d-49bf-b4da-ae3be3ee5f98 tempest-VolumeQuotasNegativeTestJSON-1303767000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bde50e5b-1bc3-4005-bcde-bfd6ed7ab0d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:47:53 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-5b7be28c-d12d-49bf-b4da-ae3be3ee5f98 tempest-VolumeQuotasNegativeTestJSON-1303767000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bde50e5b-1bc3-4005-bcde-bfd6ed7ab0d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T17:47:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-447343117',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4bec5c7b-b786-44dd-a379-c5cad04e0ce5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76d51badab9841fcb32c8d8690f0267d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T17:47:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T17:47:53Z,use_quota=True,user_id='d695423f22f94f019afd4f8169a61e63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:47:53 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-5b7be28c-d12d-49bf-b4da-ae3be3ee5f98 tempest-VolumeQuotasNegativeTestJSON-1303767000 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7f2c3c7-3100-468c-97e4-e593778d36ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:47:53 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-5b7be28c-d12d-49bf-b4da-ae3be3ee5f98 tempest-VolumeQuotasNegativeTestJSON-1303767000 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7f2c3c7-3100-468c-97e4-e593778d36ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:47:53 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-5b7be28c-d12d-49bf-b4da-ae3be3ee5f98 tempest-VolumeQuotasNegativeTestJSON-1303767000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3de7f91d-497f-4a01-b725-2d3a0f57cf9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:47:53 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-5b7be28c-d12d-49bf-b4da-ae3be3ee5f98 tempest-VolumeQuotasNegativeTestJSON-1303767000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3de7f91d-497f-4a01-b725-2d3a0f57cf9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4bec5c7b-b786-44dd-a379-c5cad04e0ce5', 'volume_name': 'volume-4bec5c7b-b786-44dd-a379-c5cad04e0ce5', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:47:53 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-5b7be28c-d12d-49bf-b4da-ae3be3ee5f98 tempest-VolumeQuotasNegativeTestJSON-1303767000 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdb2d382-3ce7-433b-89d9-7e81aea3232a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:47:53 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-5b7be28c-d12d-49bf-b4da-ae3be3ee5f98 tempest-VolumeQuotasNegativeTestJSON-1303767000 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdb2d382-3ce7-433b-89d9-7e81aea3232a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:47:53 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-5b7be28c-d12d-49bf-b4da-ae3be3ee5f98 tempest-VolumeQuotasNegativeTestJSON-1303767000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81a11dc9-e587-4ea4-bedb-ce2bcbfab35a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:47:53 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-5b7be28c-d12d-49bf-b4da-ae3be3ee5f98 tempest-VolumeQuotasNegativeTestJSON-1303767000 None] Volume 4bec5c7b-b786-44dd-a379-c5cad04e0ce5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4bec5c7b-b786-44dd-a379-c5cad04e0ce5', 'volume_size': 1}
Jul 02 19:47:53 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-5b7be28c-d12d-49bf-b4da-ae3be3ee5f98 tempest-VolumeQuotasNegativeTestJSON-1303767000 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:47:53 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-5b7be28c-d12d-49bf-b4da-ae3be3ee5f98 tempest-VolumeQuotasNegativeTestJSON-1303767000 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:47:53 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-5b7be28c-d12d-49bf-b4da-ae3be3ee5f98 tempest-VolumeQuotasNegativeTestJSON-1303767000 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce906cb830>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T17:47:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-447343117',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4bec5c7b-b786-44dd-a379-c5cad04e0ce5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76d51badab9841fcb32c8d8690f0267d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T17:47:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T17:47:53Z,use_quota=True,user_id='d695423f22f94f019afd4f8169a61e63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)}" {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 19:47:53 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-5b7be28c-d12d-49bf-b4da-ae3be3ee5f98 tempest-VolumeQuotasNegativeTestJSON-1303767000 None] Creating volume 4bec5c7b-b786-44dd-a379-c5cad04e0ce5 {{(pid=86639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 19:47:53 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-5b7be28c-d12d-49bf-b4da-ae3be3ee5f98 tempest-VolumeQuotasNegativeTestJSON-1303767000 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:47:53 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-5b7be28c-d12d-49bf-b4da-ae3be3ee5f98 tempest-VolumeQuotasNegativeTestJSON-1303767000 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:47:53 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-5b7be28c-d12d-49bf-b4da-ae3be3ee5f98 tempest-VolumeQuotasNegativeTestJSON-1303767000 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 19:47:53 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-5b7be28c-d12d-49bf-b4da-ae3be3ee5f98 tempest-VolumeQuotasNegativeTestJSON-1303767000 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 19:47:53 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-5b7be28c-d12d-49bf-b4da-ae3be3ee5f98 tempest-VolumeQuotasNegativeTestJSON-1303767000 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:47:53 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-5b7be28c-d12d-49bf-b4da-ae3be3ee5f98 tempest-VolumeQuotasNegativeTestJSON-1303767000 None] Selected osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92 as target Quobyte volume. {{(pid=86639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 19:47:53 devstack cinder-volume[86639]: INFO cinder.volume.drivers.remotefs [None req-5b7be28c-d12d-49bf-b4da-ae3be3ee5f98 tempest-VolumeQuotasNegativeTestJSON-1303767000 None] casted to osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92
Jul 02 19:47:53 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-5b7be28c-d12d-49bf-b4da-ae3be3ee5f98 tempest-VolumeQuotasNegativeTestJSON-1303767000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-4bec5c7b-b786-44dd-a379-c5cad04e0ce5 1073741824 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:47:53 devstack sudo[93787]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-4bec5c7b-b786-44dd-a379-c5cad04e0ce5 1073741824
Jul 02 19:47:53 devstack sudo[93787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:47:54 devstack sudo[93787]: pam_unix(sudo:session): session closed for user root
Jul 02 19:47:54 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-5b7be28c-d12d-49bf-b4da-ae3be3ee5f98 tempest-VolumeQuotasNegativeTestJSON-1303767000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-4bec5c7b-b786-44dd-a379-c5cad04e0ce5 1073741824" returned: 0 in 1.102s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:47:54 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-5b7be28c-d12d-49bf-b4da-ae3be3ee5f98 tempest-VolumeQuotasNegativeTestJSON-1303767000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-4bec5c7b-b786-44dd-a379-c5cad04e0ce5 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:47:54 devstack sudo[93796]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-4bec5c7b-b786-44dd-a379-c5cad04e0ce5
Jul 02 19:47:54 devstack sudo[93796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:47:55 devstack sudo[93796]: pam_unix(sudo:session): session closed for user root
Jul 02 19:47:55 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-5b7be28c-d12d-49bf-b4da-ae3be3ee5f98 tempest-VolumeQuotasNegativeTestJSON-1303767000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-4bec5c7b-b786-44dd-a379-c5cad04e0ce5" returned: 0 in 0.787s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:47:55 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-5b7be28c-d12d-49bf-b4da-ae3be3ee5f98 tempest-VolumeQuotasNegativeTestJSON-1303767000 None] <== create_volume: return (1946ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'} {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 19:47:55 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-5b7be28c-d12d-49bf-b4da-ae3be3ee5f98 tempest-VolumeQuotasNegativeTestJSON-1303767000 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.949s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:47:55 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-5b7be28c-d12d-49bf-b4da-ae3be3ee5f98 tempest-VolumeQuotasNegativeTestJSON-1303767000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81a11dc9-e587-4ea4-bedb-ce2bcbfab35a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4bec5c7b-b786-44dd-a379-c5cad04e0ce5', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:47:55 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-5b7be28c-d12d-49bf-b4da-ae3be3ee5f98 tempest-VolumeQuotasNegativeTestJSON-1303767000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1be73af8-fab4-4252-ac4b-992e44539c5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:47:55 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-5b7be28c-d12d-49bf-b4da-ae3be3ee5f98 tempest-VolumeQuotasNegativeTestJSON-1303767000 None] Volume volume-4bec5c7b-b786-44dd-a379-c5cad04e0ce5 (4bec5c7b-b786-44dd-a379-c5cad04e0ce5): created successfully
Jul 02 19:47:55 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-5b7be28c-d12d-49bf-b4da-ae3be3ee5f98 tempest-VolumeQuotasNegativeTestJSON-1303767000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1be73af8-fab4-4252-ac4b-992e44539c5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:47:55 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-5b7be28c-d12d-49bf-b4da-ae3be3ee5f98 tempest-VolumeQuotasNegativeTestJSON-1303767000 None] Flow 'volume_create_manager' (f6bc73c5-cad6-4be4-b188-d3deb2c8876e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 19:47:55 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-5b7be28c-d12d-49bf-b4da-ae3be3ee5f98 tempest-VolumeQuotasNegativeTestJSON-1303767000 None] Created volume successfully.
Jul 02 19:47:57 devstack cinder-volume[86639]: INFO cinder.volume.manager [req-8c6f4373-eb14-4a8b-9357-5080ca508e3a req-7364f7bb-1c4d-4e4f-975e-3343bb7a47fe tempest-AttachVolumeTestJSON-1400825288 None] Terminate volume connection completed successfully.
Jul 02 19:47:57 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [req-8c6f4373-eb14-4a8b-9357-5080ca508e3a req-7364f7bb-1c4d-4e4f-975e-3343bb7a47fe tempest-AttachVolumeTestJSON-1400825288 None] Deleting attachment 5b237010-3f13-402c-8f59-b1d18ca368b4. {{(pid=86639) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 02 19:47:57 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-867f9b09-cf0e-4c07-b513-c337e1f29bbf tempest-VolumeQuotasNegativeTestJSON-1303767000 None] Acquiring lock "cinder-4bec5c7b-b786-44dd-a379-c5cad04e0ce5-delete_volume" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:47:57 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-867f9b09-cf0e-4c07-b513-c337e1f29bbf tempest-VolumeQuotasNegativeTestJSON-1303767000 None] Lock "cinder-4bec5c7b-b786-44dd-a379-c5cad04e0ce5-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:47:57 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-867f9b09-cf0e-4c07-b513-c337e1f29bbf tempest-VolumeQuotasNegativeTestJSON-1303767000 None] Acquiring lock "cinder-quobyte-4bec5c7b-b786-44dd-a379-c5cad04e0ce5" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:47:57 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-867f9b09-cf0e-4c07-b513-c337e1f29bbf tempest-VolumeQuotasNegativeTestJSON-1303767000 None] Lock "cinder-quobyte-4bec5c7b-b786-44dd-a379-c5cad04e0ce5" acquired by "delete_volume" :: waited 0.015s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:47:57 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ee0e9c1-77e7-403c-9f3a-a7a2ec2e2e23]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 19:47:57 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-867f9b09-cf0e-4c07-b513-c337e1f29bbf tempest-VolumeQuotasNegativeTestJSON-1303767000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-4bec5c7b-b786-44dd-a379-c5cad04e0ce5 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:47:57 devstack sudo[93849]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-4bec5c7b-b786-44dd-a379-c5cad04e0ce5
Jul 02 19:47:57 devstack sudo[93849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:47:58 devstack sudo[93849]: pam_unix(sudo:session): session closed for user root
Jul 02 19:47:58 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-867f9b09-cf0e-4c07-b513-c337e1f29bbf tempest-VolumeQuotasNegativeTestJSON-1303767000 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-4bec5c7b-b786-44dd-a379-c5cad04e0ce5" returned: 0 in 0.813s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:47:58 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-867f9b09-cf0e-4c07-b513-c337e1f29bbf tempest-VolumeQuotasNegativeTestJSON-1303767000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-4bec5c7b-b786-44dd-a379-c5cad04e0ce5 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:47:58 devstack sudo[93854]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-4bec5c7b-b786-44dd-a379-c5cad04e0ce5
Jul 02 19:47:58 devstack sudo[93854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:47:59 devstack sudo[93854]: pam_unix(sudo:session): session closed for user root
Jul 02 19:47:59 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-867f9b09-cf0e-4c07-b513-c337e1f29bbf tempest-VolumeQuotasNegativeTestJSON-1303767000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-4bec5c7b-b786-44dd-a379-c5cad04e0ce5" returned: 0 in 0.724s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:47:59 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-867f9b09-cf0e-4c07-b513-c337e1f29bbf tempest-VolumeQuotasNegativeTestJSON-1303767000 None] Lock "cinder-quobyte-4bec5c7b-b786-44dd-a379-c5cad04e0ce5" released by "delete_volume" :: held 1.576s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:47:59 devstack cinder-volume[86639]: DEBUG cinder.quota [None req-867f9b09-cf0e-4c07-b513-c337e1f29bbf tempest-VolumeQuotasNegativeTestJSON-1303767000 None] Created reservations ['5198100c-7b2f-4404-9262-f1ce567cf5d0', 'f1be944c-2a45-4670-82ee-05be6eb78c6e', '1e0dc5b9-73af-4ed2-8065-c4cc30e4bb7c', 'c84e2f36-3220-4705-abec-6b8a1ffcfdaa'] {{(pid=86639) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 19:47:59 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-867f9b09-cf0e-4c07-b513-c337e1f29bbf tempest-VolumeQuotasNegativeTestJSON-1303767000 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:47:59 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-867f9b09-cf0e-4c07-b513-c337e1f29bbf tempest-VolumeQuotasNegativeTestJSON-1303767000 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:47:59 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-867f9b09-cf0e-4c07-b513-c337e1f29bbf tempest-VolumeQuotasNegativeTestJSON-1303767000 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 19:47:59 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-867f9b09-cf0e-4c07-b513-c337e1f29bbf tempest-VolumeQuotasNegativeTestJSON-1303767000 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 19:47:59 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-867f9b09-cf0e-4c07-b513-c337e1f29bbf tempest-VolumeQuotasNegativeTestJSON-1303767000 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:47:59 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-867f9b09-cf0e-4c07-b513-c337e1f29bbf tempest-VolumeQuotasNegativeTestJSON-1303767000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:47:59 devstack sudo[93858]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e
Jul 02 19:47:59 devstack sudo[93858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:48:00 devstack cinder-volume[86639]: INFO cinder.volume.manager [req-9e1268c4-d56b-417b-8884-062294e7c6c5 req-f3910c69-9375-4889-ae63-a12ba0ff3a4a tempest-AttachVolumeTestJSON-1400825288 None] Terminate volume connection completed successfully.
Jul 02 19:48:00 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [req-9e1268c4-d56b-417b-8884-062294e7c6c5 req-f3910c69-9375-4889-ae63-a12ba0ff3a4a tempest-AttachVolumeTestJSON-1400825288 None] Deleting attachment 0c6fcadd-d0e6-4486-9af9-6e374e2aa243. {{(pid=86639) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 02 19:48:00 devstack sudo[93858]: pam_unix(sudo:session): session closed for user root
Jul 02 19:48:00 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-867f9b09-cf0e-4c07-b513-c337e1f29bbf tempest-VolumeQuotasNegativeTestJSON-1303767000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e" returned: 0 in 1.071s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:48:00 devstack cinder-volume[86639]: DEBUG cinder.manager [None req-867f9b09-cf0e-4c07-b513-c337e1f29bbf tempest-VolumeQuotasNegativeTestJSON-1303767000 None] Notifying Schedulers of capabilities ... {{(pid=86639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 19:48:00 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-867f9b09-cf0e-4c07-b513-c337e1f29bbf tempest-VolumeQuotasNegativeTestJSON-1303767000 None] Deleted volume successfully.
Jul 02 19:48:00 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-867f9b09-cf0e-4c07-b513-c337e1f29bbf tempest-VolumeQuotasNegativeTestJSON-1303767000 None] Lock "cinder-4bec5c7b-b786-44dd-a379-c5cad04e0ce5-delete_volume" released by "delete_volume" :: held 2.865s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:48:10 devstack cinder-volume[86639]: DEBUG dbcounter [-] [86639] Writing DB stats cinder:SELECT=13,cinder:UPDATE=10,cinder:INSERT=3 {{(pid=86639) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 02 19:48:10 devstack cinder-volume[86639]: DEBUG dbcounter [-] [86639] Writing DB stats cinder:SELECT=12,cinder:UPDATE=15,cinder:DELETE=2,cinder:INSERT=2 {{(pid=86639) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 02 19:48:10 devstack cinder-volume[86639]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5945c98-fd8d-43f3-9acd-98ab3bc7428b tempest-AttachVolumeShelveTestJSON-313905155 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 19:48:10 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-b5945c98-fd8d-43f3-9acd-98ab3bc7428b tempest-AttachVolumeShelveTestJSON-313905155 None] Flow 'volume_create_manager' (7a94a9b4-c9d4-4bfe-b494-5710e3aa6e1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 19:48:10 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-b5945c98-fd8d-43f3-9acd-98ab3bc7428b tempest-AttachVolumeShelveTestJSON-313905155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e66bfaeb-034d-46d7-8534-8fa3648d2c16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:48:10 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-b5945c98-fd8d-43f3-9acd-98ab3bc7428b tempest-AttachVolumeShelveTestJSON-313905155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e66bfaeb-034d-46d7-8534-8fa3648d2c16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T17:48:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1577260141',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1665c539-434a-4eef-8586-647abb2db7d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee601c80549b4b2190513f8becbbde90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T17:48:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T17:48:11Z,use_quota=True,user_id='03666a70bd404990932a0f79cbf52bd3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:48:10 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-b5945c98-fd8d-43f3-9acd-98ab3bc7428b tempest-AttachVolumeShelveTestJSON-313905155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f6a5183-b6c7-4a89-a511-f7686a2b47ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:48:10 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-b5945c98-fd8d-43f3-9acd-98ab3bc7428b tempest-AttachVolumeShelveTestJSON-313905155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f6a5183-b6c7-4a89-a511-f7686a2b47ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:48:10 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-b5945c98-fd8d-43f3-9acd-98ab3bc7428b tempest-AttachVolumeShelveTestJSON-313905155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7fa1634-60d3-4b7d-83d4-3904e76ea7fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:48:10 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-b5945c98-fd8d-43f3-9acd-98ab3bc7428b tempest-AttachVolumeShelveTestJSON-313905155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7fa1634-60d3-4b7d-83d4-3904e76ea7fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1665c539-434a-4eef-8586-647abb2db7d7', 'volume_name': 'volume-1665c539-434a-4eef-8586-647abb2db7d7', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:48:10 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-b5945c98-fd8d-43f3-9acd-98ab3bc7428b tempest-AttachVolumeShelveTestJSON-313905155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9717c479-8fc0-42a0-9ab5-e8153355fa74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:48:10 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-b5945c98-fd8d-43f3-9acd-98ab3bc7428b tempest-AttachVolumeShelveTestJSON-313905155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9717c479-8fc0-42a0-9ab5-e8153355fa74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:48:10 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-b5945c98-fd8d-43f3-9acd-98ab3bc7428b tempest-AttachVolumeShelveTestJSON-313905155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87b8515b-2f88-4eda-b4a9-a78ac74b64cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:48:10 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-b5945c98-fd8d-43f3-9acd-98ab3bc7428b tempest-AttachVolumeShelveTestJSON-313905155 None] Volume 1665c539-434a-4eef-8586-647abb2db7d7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1665c539-434a-4eef-8586-647abb2db7d7', 'volume_size': 1}
Jul 02 19:48:10 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-b5945c98-fd8d-43f3-9acd-98ab3bc7428b tempest-AttachVolumeShelveTestJSON-313905155 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:48:10 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-b5945c98-fd8d-43f3-9acd-98ab3bc7428b tempest-AttachVolumeShelveTestJSON-313905155 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:48:10 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-b5945c98-fd8d-43f3-9acd-98ab3bc7428b tempest-AttachVolumeShelveTestJSON-313905155 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce906cb830>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T17:48:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1577260141',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1665c539-434a-4eef-8586-647abb2db7d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee601c80549b4b2190513f8becbbde90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T17:48:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T17:48:11Z,use_quota=True,user_id='03666a70bd404990932a0f79cbf52bd3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)}" {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 19:48:10 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-b5945c98-fd8d-43f3-9acd-98ab3bc7428b tempest-AttachVolumeShelveTestJSON-313905155 None] Creating volume 1665c539-434a-4eef-8586-647abb2db7d7 {{(pid=86639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 19:48:10 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-b5945c98-fd8d-43f3-9acd-98ab3bc7428b tempest-AttachVolumeShelveTestJSON-313905155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:48:10 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-b5945c98-fd8d-43f3-9acd-98ab3bc7428b tempest-AttachVolumeShelveTestJSON-313905155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:48:10 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-b5945c98-fd8d-43f3-9acd-98ab3bc7428b tempest-AttachVolumeShelveTestJSON-313905155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 19:48:10 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-b5945c98-fd8d-43f3-9acd-98ab3bc7428b tempest-AttachVolumeShelveTestJSON-313905155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 19:48:10 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-b5945c98-fd8d-43f3-9acd-98ab3bc7428b tempest-AttachVolumeShelveTestJSON-313905155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:48:10 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-b5945c98-fd8d-43f3-9acd-98ab3bc7428b tempest-AttachVolumeShelveTestJSON-313905155 None] Selected osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92 as target Quobyte volume. {{(pid=86639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 19:48:10 devstack cinder-volume[86639]: INFO cinder.volume.drivers.remotefs [None req-b5945c98-fd8d-43f3-9acd-98ab3bc7428b tempest-AttachVolumeShelveTestJSON-313905155 None] casted to osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92
Jul 02 19:48:10 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-b5945c98-fd8d-43f3-9acd-98ab3bc7428b tempest-AttachVolumeShelveTestJSON-313905155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-1665c539-434a-4eef-8586-647abb2db7d7 1073741824 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:48:11 devstack sudo[93996]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-1665c539-434a-4eef-8586-647abb2db7d7 1073741824
Jul 02 19:48:11 devstack sudo[93996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:48:12 devstack sudo[93996]: pam_unix(sudo:session): session closed for user root
Jul 02 19:48:12 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-b5945c98-fd8d-43f3-9acd-98ab3bc7428b tempest-AttachVolumeShelveTestJSON-313905155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-1665c539-434a-4eef-8586-647abb2db7d7 1073741824" returned: 0 in 1.322s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:48:12 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-b5945c98-fd8d-43f3-9acd-98ab3bc7428b tempest-AttachVolumeShelveTestJSON-313905155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-1665c539-434a-4eef-8586-647abb2db7d7 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:48:12 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-c37b717d-8d5f-40a9-8f23-014d4ee57317 tempest-AttachVolumeTestJSON-1400825288 None] Acquiring lock "cinder-2f0d2a59-cd97-442f-9c8d-8a750fbcd95f-delete_volume" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:48:12 devstack sudo[94001]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-1665c539-434a-4eef-8586-647abb2db7d7
Jul 02 19:48:12 devstack sudo[94001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:48:12 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-c37b717d-8d5f-40a9-8f23-014d4ee57317 tempest-AttachVolumeTestJSON-1400825288 None] Lock "cinder-2f0d2a59-cd97-442f-9c8d-8a750fbcd95f-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:48:12 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-c37b717d-8d5f-40a9-8f23-014d4ee57317 tempest-AttachVolumeTestJSON-1400825288 None] Acquiring lock "cinder-quobyte-2f0d2a59-cd97-442f-9c8d-8a750fbcd95f" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:48:12 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-c37b717d-8d5f-40a9-8f23-014d4ee57317 tempest-AttachVolumeTestJSON-1400825288 None] Lock "cinder-quobyte-2f0d2a59-cd97-442f-9c8d-8a750fbcd95f" acquired by "delete_volume" :: waited 0.027s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:48:12 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6a5ecd9-3aa8-4412-9dca-ccbba264b51c]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 19:48:12 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-c37b717d-8d5f-40a9-8f23-014d4ee57317 tempest-AttachVolumeTestJSON-1400825288 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-2f0d2a59-cd97-442f-9c8d-8a750fbcd95f {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:48:12 devstack sudo[94003]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-2f0d2a59-cd97-442f-9c8d-8a750fbcd95f
Jul 02 19:48:12 devstack sudo[94003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:48:13 devstack sudo[94001]: pam_unix(sudo:session): session closed for user root
Jul 02 19:48:13 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-b5945c98-fd8d-43f3-9acd-98ab3bc7428b tempest-AttachVolumeShelveTestJSON-313905155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-1665c539-434a-4eef-8586-647abb2db7d7" returned: 0 in 1.134s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:48:13 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-b5945c98-fd8d-43f3-9acd-98ab3bc7428b tempest-AttachVolumeShelveTestJSON-313905155 None] <== create_volume: return (2541ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'} {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 19:48:13 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-b5945c98-fd8d-43f3-9acd-98ab3bc7428b tempest-AttachVolumeShelveTestJSON-313905155 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.548s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:48:13 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-b5945c98-fd8d-43f3-9acd-98ab3bc7428b tempest-AttachVolumeShelveTestJSON-313905155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87b8515b-2f88-4eda-b4a9-a78ac74b64cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1665c539-434a-4eef-8586-647abb2db7d7', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:48:13 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-b5945c98-fd8d-43f3-9acd-98ab3bc7428b tempest-AttachVolumeShelveTestJSON-313905155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71d688ba-f23c-4389-b301-20628f3d48da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:48:13 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-b5945c98-fd8d-43f3-9acd-98ab3bc7428b tempest-AttachVolumeShelveTestJSON-313905155 None] Volume volume-1665c539-434a-4eef-8586-647abb2db7d7 (1665c539-434a-4eef-8586-647abb2db7d7): created successfully
Jul 02 19:48:13 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-b5945c98-fd8d-43f3-9acd-98ab3bc7428b tempest-AttachVolumeShelveTestJSON-313905155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71d688ba-f23c-4389-b301-20628f3d48da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:48:13 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-b5945c98-fd8d-43f3-9acd-98ab3bc7428b tempest-AttachVolumeShelveTestJSON-313905155 None] Flow 'volume_create_manager' (7a94a9b4-c9d4-4bfe-b494-5710e3aa6e1e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 19:48:13 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-b5945c98-fd8d-43f3-9acd-98ab3bc7428b tempest-AttachVolumeShelveTestJSON-313905155 None] Created volume successfully.
Jul 02 19:48:13 devstack sudo[94003]: pam_unix(sudo:session): session closed for user root
Jul 02 19:48:13 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-c37b717d-8d5f-40a9-8f23-014d4ee57317 tempest-AttachVolumeTestJSON-1400825288 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-2f0d2a59-cd97-442f-9c8d-8a750fbcd95f" returned: 0 in 1.279s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:48:13 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-c37b717d-8d5f-40a9-8f23-014d4ee57317 tempest-AttachVolumeTestJSON-1400825288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-2f0d2a59-cd97-442f-9c8d-8a750fbcd95f {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:48:13 devstack sudo[94012]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-2f0d2a59-cd97-442f-9c8d-8a750fbcd95f
Jul 02 19:48:13 devstack sudo[94012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:48:14 devstack sudo[94012]: pam_unix(sudo:session): session closed for user root
Jul 02 19:48:14 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-c37b717d-8d5f-40a9-8f23-014d4ee57317 tempest-AttachVolumeTestJSON-1400825288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-2f0d2a59-cd97-442f-9c8d-8a750fbcd95f" returned: 0 in 1.022s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:48:14 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-c37b717d-8d5f-40a9-8f23-014d4ee57317 tempest-AttachVolumeTestJSON-1400825288 None] Lock "cinder-quobyte-2f0d2a59-cd97-442f-9c8d-8a750fbcd95f" released by "delete_volume" :: held 2.358s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:48:15 devstack cinder-volume[86639]: DEBUG cinder.quota [None req-c37b717d-8d5f-40a9-8f23-014d4ee57317 tempest-AttachVolumeTestJSON-1400825288 None] Created reservations ['db377bd0-898e-49b1-b934-d5242def73a7', 'd35abe41-60bc-483a-a724-df8c6861ab0b', '3efffbbc-fc16-4919-99fb-d14780645ebf', '3011150f-67ec-48a9-9b04-38a0c7551d1d'] {{(pid=86639) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 19:48:15 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-c37b717d-8d5f-40a9-8f23-014d4ee57317 tempest-AttachVolumeTestJSON-1400825288 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:48:15 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-c37b717d-8d5f-40a9-8f23-014d4ee57317 tempest-AttachVolumeTestJSON-1400825288 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:48:15 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-c37b717d-8d5f-40a9-8f23-014d4ee57317 tempest-AttachVolumeTestJSON-1400825288 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 19:48:15 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-c37b717d-8d5f-40a9-8f23-014d4ee57317 tempest-AttachVolumeTestJSON-1400825288 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 19:48:15 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-c37b717d-8d5f-40a9-8f23-014d4ee57317 tempest-AttachVolumeTestJSON-1400825288 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:48:15 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-c37b717d-8d5f-40a9-8f23-014d4ee57317 tempest-AttachVolumeTestJSON-1400825288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:48:15 devstack sudo[94019]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e
Jul 02 19:48:15 devstack sudo[94019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:48:15 devstack cinder-volume[86639]: DEBUG cinder.volume.flows.manager.create_volume [None req-3965e59e-77ab-4e7f-9ac6-ade81e3657e6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1906583416 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 19:48:15 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-3965e59e-77ab-4e7f-9ac6-ade81e3657e6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1906583416 None] Flow 'volume_create_manager' (ea47275d-b4f4-44da-8e24-002f53f8ab6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 19:48:15 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-3965e59e-77ab-4e7f-9ac6-ade81e3657e6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1906583416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c76e649-bfb9-4be2-bc67-97b0fe5d3b3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:48:15 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-3965e59e-77ab-4e7f-9ac6-ade81e3657e6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1906583416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c76e649-bfb9-4be2-bc67-97b0fe5d3b3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T17:48:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-895135072',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8743b380-bd98-4a78-ad65-0e9cf3b77143,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca38e7274a3145d3ad9937bf84cb5588',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T17:48:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T17:48:16Z,use_quota=True,user_id='cfcafb39a5874f719329175654270a14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:48:15 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-3965e59e-77ab-4e7f-9ac6-ade81e3657e6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1906583416 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (423bf1ba-1fec-44b2-b8f0-4a143bd9bcb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:48:15 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-3965e59e-77ab-4e7f-9ac6-ade81e3657e6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1906583416 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (423bf1ba-1fec-44b2-b8f0-4a143bd9bcb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:48:15 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-3965e59e-77ab-4e7f-9ac6-ade81e3657e6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1906583416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c5842ae-0990-4777-bddf-c4b5f4270939) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:48:15 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-3965e59e-77ab-4e7f-9ac6-ade81e3657e6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1906583416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c5842ae-0990-4777-bddf-c4b5f4270939) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8743b380-bd98-4a78-ad65-0e9cf3b77143', 'volume_name': 'volume-8743b380-bd98-4a78-ad65-0e9cf3b77143', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:48:15 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-3965e59e-77ab-4e7f-9ac6-ade81e3657e6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1906583416 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd07781c-8eba-4593-bfbb-09cebb8d2189) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:48:15 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-3965e59e-77ab-4e7f-9ac6-ade81e3657e6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1906583416 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd07781c-8eba-4593-bfbb-09cebb8d2189) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:48:15 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-3965e59e-77ab-4e7f-9ac6-ade81e3657e6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1906583416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae692cec-3fbc-4b68-b67a-799ace9b207a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:48:15 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-3965e59e-77ab-4e7f-9ac6-ade81e3657e6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1906583416 None] Volume 8743b380-bd98-4a78-ad65-0e9cf3b77143: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8743b380-bd98-4a78-ad65-0e9cf3b77143', 'volume_size': 1}
Jul 02 19:48:15 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-3965e59e-77ab-4e7f-9ac6-ade81e3657e6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1906583416 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:48:15 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-3965e59e-77ab-4e7f-9ac6-ade81e3657e6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1906583416 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:48:15 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-3965e59e-77ab-4e7f-9ac6-ade81e3657e6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1906583416 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce906cb830>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T17:48:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-895135072',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8743b380-bd98-4a78-ad65-0e9cf3b77143,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca38e7274a3145d3ad9937bf84cb5588',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T17:48:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T17:48:16Z,use_quota=True,user_id='cfcafb39a5874f719329175654270a14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)}" {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 19:48:15 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-3965e59e-77ab-4e7f-9ac6-ade81e3657e6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1906583416 None] Creating volume 8743b380-bd98-4a78-ad65-0e9cf3b77143 {{(pid=86639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 19:48:15 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-3965e59e-77ab-4e7f-9ac6-ade81e3657e6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1906583416 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:48:15 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-3965e59e-77ab-4e7f-9ac6-ade81e3657e6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1906583416 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:48:15 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-3965e59e-77ab-4e7f-9ac6-ade81e3657e6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1906583416 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 19:48:15 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-3965e59e-77ab-4e7f-9ac6-ade81e3657e6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1906583416 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 19:48:15 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-3965e59e-77ab-4e7f-9ac6-ade81e3657e6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1906583416 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:48:15 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-3965e59e-77ab-4e7f-9ac6-ade81e3657e6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1906583416 None] Selected osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92 as target Quobyte volume. {{(pid=86639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 19:48:15 devstack cinder-volume[86639]: INFO cinder.volume.drivers.remotefs [None req-3965e59e-77ab-4e7f-9ac6-ade81e3657e6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1906583416 None] casted to osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92
Jul 02 19:48:15 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-3965e59e-77ab-4e7f-9ac6-ade81e3657e6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1906583416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8743b380-bd98-4a78-ad65-0e9cf3b77143 1073741824 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:48:15 devstack sudo[94024]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8743b380-bd98-4a78-ad65-0e9cf3b77143 1073741824
Jul 02 19:48:15 devstack sudo[94024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:48:15 devstack sudo[94019]: pam_unix(sudo:session): session closed for user root
Jul 02 19:48:15 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-c37b717d-8d5f-40a9-8f23-014d4ee57317 tempest-AttachVolumeTestJSON-1400825288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e" returned: 0 in 0.845s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:48:15 devstack cinder-volume[86639]: DEBUG cinder.manager [None req-c37b717d-8d5f-40a9-8f23-014d4ee57317 tempest-AttachVolumeTestJSON-1400825288 None] Notifying Schedulers of capabilities ... {{(pid=86639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 19:48:15 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-c37b717d-8d5f-40a9-8f23-014d4ee57317 tempest-AttachVolumeTestJSON-1400825288 None] Deleted volume successfully.
Jul 02 19:48:16 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-c37b717d-8d5f-40a9-8f23-014d4ee57317 tempest-AttachVolumeTestJSON-1400825288 None] Lock "cinder-2f0d2a59-cd97-442f-9c8d-8a750fbcd95f-delete_volume" released by "delete_volume" :: held 3.566s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:48:16 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-827a6121-a175-43f5-8f84-b6c81a350782 tempest-AttachVolumeTestJSON-1400825288 None] Acquiring lock "cinder-2e389181-2bfe-4234-bb77-d4f4a7b5de07-delete_volume" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:48:16 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-827a6121-a175-43f5-8f84-b6c81a350782 tempest-AttachVolumeTestJSON-1400825288 None] Lock "cinder-2e389181-2bfe-4234-bb77-d4f4a7b5de07-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:48:16 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-827a6121-a175-43f5-8f84-b6c81a350782 tempest-AttachVolumeTestJSON-1400825288 None] Acquiring lock "cinder-quobyte-2e389181-2bfe-4234-bb77-d4f4a7b5de07" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:48:16 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-827a6121-a175-43f5-8f84-b6c81a350782 tempest-AttachVolumeTestJSON-1400825288 None] Lock "cinder-quobyte-2e389181-2bfe-4234-bb77-d4f4a7b5de07" acquired by "delete_volume" :: waited 0.027s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:48:16 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[10150f86-f78c-430c-bd27-15d2a931027d]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 19:48:16 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-827a6121-a175-43f5-8f84-b6c81a350782 tempest-AttachVolumeTestJSON-1400825288 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-2e389181-2bfe-4234-bb77-d4f4a7b5de07 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:48:16 devstack sudo[94026]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-2e389181-2bfe-4234-bb77-d4f4a7b5de07
Jul 02 19:48:16 devstack sudo[94026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:48:16 devstack sudo[94024]: pam_unix(sudo:session): session closed for user root
Jul 02 19:48:16 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-3965e59e-77ab-4e7f-9ac6-ade81e3657e6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1906583416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8743b380-bd98-4a78-ad65-0e9cf3b77143 1073741824" returned: 0 in 0.965s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:48:16 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-3965e59e-77ab-4e7f-9ac6-ade81e3657e6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1906583416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8743b380-bd98-4a78-ad65-0e9cf3b77143 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:48:16 devstack sudo[94032]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8743b380-bd98-4a78-ad65-0e9cf3b77143
Jul 02 19:48:16 devstack sudo[94032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:48:17 devstack sudo[94026]: pam_unix(sudo:session): session closed for user root
Jul 02 19:48:17 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-827a6121-a175-43f5-8f84-b6c81a350782 tempest-AttachVolumeTestJSON-1400825288 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-2e389181-2bfe-4234-bb77-d4f4a7b5de07" returned: 0 in 0.929s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:48:17 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-827a6121-a175-43f5-8f84-b6c81a350782 tempest-AttachVolumeTestJSON-1400825288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-2e389181-2bfe-4234-bb77-d4f4a7b5de07 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:48:17 devstack sudo[94037]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-2e389181-2bfe-4234-bb77-d4f4a7b5de07
Jul 02 19:48:17 devstack sudo[94037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:48:17 devstack sudo[94032]: pam_unix(sudo:session): session closed for user root
Jul 02 19:48:17 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-3965e59e-77ab-4e7f-9ac6-ade81e3657e6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1906583416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8743b380-bd98-4a78-ad65-0e9cf3b77143" returned: 0 in 1.098s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:48:17 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-3965e59e-77ab-4e7f-9ac6-ade81e3657e6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1906583416 None] <== create_volume: return (2135ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'} {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 19:48:17 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-3965e59e-77ab-4e7f-9ac6-ade81e3657e6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1906583416 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.145s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:48:18 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-3965e59e-77ab-4e7f-9ac6-ade81e3657e6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1906583416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae692cec-3fbc-4b68-b67a-799ace9b207a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8743b380-bd98-4a78-ad65-0e9cf3b77143', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:48:18 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-3965e59e-77ab-4e7f-9ac6-ade81e3657e6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1906583416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0ac353b-bf15-4be7-bcb7-08c08af41cf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:48:18 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-3965e59e-77ab-4e7f-9ac6-ade81e3657e6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1906583416 None] Volume volume-8743b380-bd98-4a78-ad65-0e9cf3b77143 (8743b380-bd98-4a78-ad65-0e9cf3b77143): created successfully
Jul 02 19:48:18 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-3965e59e-77ab-4e7f-9ac6-ade81e3657e6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1906583416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0ac353b-bf15-4be7-bcb7-08c08af41cf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:48:18 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-3965e59e-77ab-4e7f-9ac6-ade81e3657e6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1906583416 None] Flow 'volume_create_manager' (ea47275d-b4f4-44da-8e24-002f53f8ab6b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 19:48:18 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-3965e59e-77ab-4e7f-9ac6-ade81e3657e6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1906583416 None] Created volume successfully.
Jul 02 19:48:18 devstack sudo[94037]: pam_unix(sudo:session): session closed for user root
Jul 02 19:48:18 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-827a6121-a175-43f5-8f84-b6c81a350782 tempest-AttachVolumeTestJSON-1400825288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-2e389181-2bfe-4234-bb77-d4f4a7b5de07" returned: 0 in 1.249s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:48:18 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-827a6121-a175-43f5-8f84-b6c81a350782 tempest-AttachVolumeTestJSON-1400825288 None] Lock "cinder-quobyte-2e389181-2bfe-4234-bb77-d4f4a7b5de07" released by "delete_volume" :: held 2.236s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:48:18 devstack cinder-volume[86639]: DEBUG cinder.quota [None req-827a6121-a175-43f5-8f84-b6c81a350782 tempest-AttachVolumeTestJSON-1400825288 None] Created reservations ['7b0ed765-233c-4652-8bc5-f9621ff6cac0', '83a76e24-c6bf-491f-a405-362770bfef00', '00f52a11-4afd-43d8-b147-be3fc24f384d', '5d30a333-6e6d-4fba-96e7-0f4631744782'] {{(pid=86639) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 19:48:18 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-827a6121-a175-43f5-8f84-b6c81a350782 tempest-AttachVolumeTestJSON-1400825288 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:48:18 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-827a6121-a175-43f5-8f84-b6c81a350782 tempest-AttachVolumeTestJSON-1400825288 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:48:18 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-827a6121-a175-43f5-8f84-b6c81a350782 tempest-AttachVolumeTestJSON-1400825288 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 19:48:18 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-827a6121-a175-43f5-8f84-b6c81a350782 tempest-AttachVolumeTestJSON-1400825288 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 19:48:18 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-827a6121-a175-43f5-8f84-b6c81a350782 tempest-AttachVolumeTestJSON-1400825288 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:48:18 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-827a6121-a175-43f5-8f84-b6c81a350782 tempest-AttachVolumeTestJSON-1400825288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:48:18 devstack sudo[94079]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e
Jul 02 19:48:18 devstack sudo[94079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:48:19 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-d496db27-1652-4b8e-8933-fe2dde72da9e tempest-VolumeSnapshotQuotasNegativeTestJSON-1906583416 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:48:19 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-d496db27-1652-4b8e-8933-fe2dde72da9e tempest-VolumeSnapshotQuotasNegativeTestJSON-1906583416 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:48:19 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-d496db27-1652-4b8e-8933-fe2dde72da9e tempest-VolumeSnapshotQuotasNegativeTestJSON-1906583416 None] Creating offline snapshot 522f6d6a-d661-4c5b-a0e3-a3eb0e464cba of volume 8743b380-bd98-4a78-ad65-0e9cf3b77143 {{(pid=86639) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 02 19:48:19 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[c88a060f-68d6-47d9-af3a-c7e3806034b1]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 19:48:19 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-d496db27-1652-4b8e-8933-fe2dde72da9e tempest-VolumeSnapshotQuotasNegativeTestJSON-1906583416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8743b380-bd98-4a78-ad65-0e9cf3b77143 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:48:19 devstack sudo[94079]: pam_unix(sudo:session): session closed for user root
Jul 02 19:48:19 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-827a6121-a175-43f5-8f84-b6c81a350782 tempest-AttachVolumeTestJSON-1400825288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e" returned: 0 in 0.919s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:48:19 devstack cinder-volume[86639]: DEBUG cinder.manager [None req-827a6121-a175-43f5-8f84-b6c81a350782 tempest-AttachVolumeTestJSON-1400825288 None] Notifying Schedulers of capabilities ... {{(pid=86639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 19:48:19 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-827a6121-a175-43f5-8f84-b6c81a350782 tempest-AttachVolumeTestJSON-1400825288 None] Deleted volume successfully.
Jul 02 19:48:19 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-827a6121-a175-43f5-8f84-b6c81a350782 tempest-AttachVolumeTestJSON-1400825288 None] Lock "cinder-2e389181-2bfe-4234-bb77-d4f4a7b5de07-delete_volume" released by "delete_volume" :: held 3.557s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:48:19 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-410a9596-00b4-4ea7-96ba-3d18b83f0a81 tempest-AttachVolumeTestJSON-1400825288 None] Acquiring lock "cinder-1aa59cc9-9533-43b6-bf70-77d04e17a7ac-delete_volume" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:48:19 devstack sudo[94082]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8743b380-bd98-4a78-ad65-0e9cf3b77143
Jul 02 19:48:19 devstack sudo[94082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:48:19 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-410a9596-00b4-4ea7-96ba-3d18b83f0a81 tempest-AttachVolumeTestJSON-1400825288 None] Lock "cinder-1aa59cc9-9533-43b6-bf70-77d04e17a7ac-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:48:19 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-410a9596-00b4-4ea7-96ba-3d18b83f0a81 tempest-AttachVolumeTestJSON-1400825288 None] Acquiring lock "cinder-quobyte-1aa59cc9-9533-43b6-bf70-77d04e17a7ac" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:48:19 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-410a9596-00b4-4ea7-96ba-3d18b83f0a81 tempest-AttachVolumeTestJSON-1400825288 None] Lock "cinder-quobyte-1aa59cc9-9533-43b6-bf70-77d04e17a7ac" acquired by "delete_volume" :: waited 0.022s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:48:19 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9611b9f-4f8f-4b09-9872-928e28298ac3]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 19:48:19 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-410a9596-00b4-4ea7-96ba-3d18b83f0a81 tempest-AttachVolumeTestJSON-1400825288 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-1aa59cc9-9533-43b6-bf70-77d04e17a7ac {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:48:19 devstack sudo[94084]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-1aa59cc9-9533-43b6-bf70-77d04e17a7ac
Jul 02 19:48:19 devstack sudo[94084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:48:20 devstack sudo[94082]: pam_unix(sudo:session): session closed for user root
Jul 02 19:48:20 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-d496db27-1652-4b8e-8933-fe2dde72da9e tempest-VolumeSnapshotQuotasNegativeTestJSON-1906583416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8743b380-bd98-4a78-ad65-0e9cf3b77143" returned: 0 in 1.113s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:48:20 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-d496db27-1652-4b8e-8933-fe2dde72da9e tempest-VolumeSnapshotQuotasNegativeTestJSON-1906583416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8743b380-bd98-4a78-ad65-0e9cf3b77143,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8743b380-bd98-4a78-ad65-0e9cf3b77143.522f6d6a-d661-4c5b-a0e3-a3eb0e464cba 1G {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:48:20 devstack sudo[94095]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8743b380-bd98-4a78-ad65-0e9cf3b77143,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8743b380-bd98-4a78-ad65-0e9cf3b77143.522f6d6a-d661-4c5b-a0e3-a3eb0e464cba 1G
Jul 02 19:48:20 devstack sudo[94095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:48:20 devstack sudo[94084]: pam_unix(sudo:session): session closed for user root
Jul 02 19:48:20 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-410a9596-00b4-4ea7-96ba-3d18b83f0a81 tempest-AttachVolumeTestJSON-1400825288 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-1aa59cc9-9533-43b6-bf70-77d04e17a7ac" returned: 0 in 1.000s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:48:20 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-410a9596-00b4-4ea7-96ba-3d18b83f0a81 tempest-AttachVolumeTestJSON-1400825288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-1aa59cc9-9533-43b6-bf70-77d04e17a7ac {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:48:20 devstack sudo[94106]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-1aa59cc9-9533-43b6-bf70-77d04e17a7ac
Jul 02 19:48:20 devstack sudo[94106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:48:21 devstack sudo[94095]: pam_unix(sudo:session): session closed for user root
Jul 02 19:48:21 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-d496db27-1652-4b8e-8933-fe2dde72da9e tempest-VolumeSnapshotQuotasNegativeTestJSON-1906583416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8743b380-bd98-4a78-ad65-0e9cf3b77143,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8743b380-bd98-4a78-ad65-0e9cf3b77143.522f6d6a-d661-4c5b-a0e3-a3eb0e464cba 1G" returned: 0 in 1.154s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:48:21 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-d496db27-1652-4b8e-8933-fe2dde72da9e tempest-VolumeSnapshotQuotasNegativeTestJSON-1906583416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8743b380-bd98-4a78-ad65-0e9cf3b77143 -F qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8743b380-bd98-4a78-ad65-0e9cf3b77143.522f6d6a-d661-4c5b-a0e3-a3eb0e464cba {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:48:21 devstack sudo[94106]: pam_unix(sudo:session): session closed for user root
Jul 02 19:48:21 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-410a9596-00b4-4ea7-96ba-3d18b83f0a81 tempest-AttachVolumeTestJSON-1400825288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-1aa59cc9-9533-43b6-bf70-77d04e17a7ac" returned: 0 in 0.930s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:48:21 devstack sudo[94133]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8743b380-bd98-4a78-ad65-0e9cf3b77143 -F qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8743b380-bd98-4a78-ad65-0e9cf3b77143.522f6d6a-d661-4c5b-a0e3-a3eb0e464cba
Jul 02 19:48:21 devstack sudo[94133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:48:21 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-410a9596-00b4-4ea7-96ba-3d18b83f0a81 tempest-AttachVolumeTestJSON-1400825288 None] Lock "cinder-quobyte-1aa59cc9-9533-43b6-bf70-77d04e17a7ac" released by "delete_volume" :: held 1.997s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:48:21 devstack cinder-volume[86639]: DEBUG cinder.quota [None req-410a9596-00b4-4ea7-96ba-3d18b83f0a81 tempest-AttachVolumeTestJSON-1400825288 None] Created reservations ['a9efe9f2-a8d0-42aa-85a5-5e10908b8cfb', '05e4b9b9-2fb5-4f10-a850-c8b97ecb8f8b', 'a583bde9-a204-4d7f-931c-ddd910db5a8e', '53fa0a82-395f-4b3d-9da8-1ce3319323e7'] {{(pid=86639) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 19:48:21 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-410a9596-00b4-4ea7-96ba-3d18b83f0a81 tempest-AttachVolumeTestJSON-1400825288 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:48:21 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-410a9596-00b4-4ea7-96ba-3d18b83f0a81 tempest-AttachVolumeTestJSON-1400825288 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:48:21 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-410a9596-00b4-4ea7-96ba-3d18b83f0a81 tempest-AttachVolumeTestJSON-1400825288 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 19:48:21 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-410a9596-00b4-4ea7-96ba-3d18b83f0a81 tempest-AttachVolumeTestJSON-1400825288 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 19:48:21 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-410a9596-00b4-4ea7-96ba-3d18b83f0a81 tempest-AttachVolumeTestJSON-1400825288 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:48:21 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-410a9596-00b4-4ea7-96ba-3d18b83f0a81 tempest-AttachVolumeTestJSON-1400825288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:48:21 devstack sudo[94135]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e
Jul 02 19:48:21 devstack sudo[94135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:48:22 devstack sudo[94133]: pam_unix(sudo:session): session closed for user root
Jul 02 19:48:22 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-d496db27-1652-4b8e-8933-fe2dde72da9e tempest-VolumeSnapshotQuotasNegativeTestJSON-1906583416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8743b380-bd98-4a78-ad65-0e9cf3b77143 -F qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8743b380-bd98-4a78-ad65-0e9cf3b77143.522f6d6a-d661-4c5b-a0e3-a3eb0e464cba" returned: 0 in 1.034s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:48:22 devstack cinder-volume[86639]: WARNING cinder.volume.drivers.remotefs [None req-d496db27-1652-4b8e-8933-fe2dde72da9e tempest-VolumeSnapshotQuotasNegativeTestJSON-1906583416 None] /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8743b380-bd98-4a78-ad65-0e9cf3b77143.522f6d6a-d661-4c5b-a0e3-a3eb0e464cba is being set with open permissions: ugo+rw
Jul 02 19:48:22 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-d496db27-1652-4b8e-8933-fe2dde72da9e tempest-VolumeSnapshotQuotasNegativeTestJSON-1906583416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8743b380-bd98-4a78-ad65-0e9cf3b77143.522f6d6a-d661-4c5b-a0e3-a3eb0e464cba {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:48:22 devstack sudo[94174]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8743b380-bd98-4a78-ad65-0e9cf3b77143.522f6d6a-d661-4c5b-a0e3-a3eb0e464cba
Jul 02 19:48:22 devstack sudo[94174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:48:23 devstack sudo[94135]: pam_unix(sudo:session): session closed for user root
Jul 02 19:48:23 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-410a9596-00b4-4ea7-96ba-3d18b83f0a81 tempest-AttachVolumeTestJSON-1400825288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e" returned: 0 in 1.167s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:48:23 devstack cinder-volume[86639]: DEBUG cinder.manager [None req-410a9596-00b4-4ea7-96ba-3d18b83f0a81 tempest-AttachVolumeTestJSON-1400825288 None] Notifying Schedulers of capabilities ... {{(pid=86639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 19:48:23 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-410a9596-00b4-4ea7-96ba-3d18b83f0a81 tempest-AttachVolumeTestJSON-1400825288 None] Deleted volume successfully.
Jul 02 19:48:23 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-410a9596-00b4-4ea7-96ba-3d18b83f0a81 tempest-AttachVolumeTestJSON-1400825288 None] Lock "cinder-1aa59cc9-9533-43b6-bf70-77d04e17a7ac-delete_volume" released by "delete_volume" :: held 3.412s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:48:23 devstack sudo[94174]: pam_unix(sudo:session): session closed for user root
Jul 02 19:48:23 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-d496db27-1652-4b8e-8933-fe2dde72da9e tempest-VolumeSnapshotQuotasNegativeTestJSON-1906583416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8743b380-bd98-4a78-ad65-0e9cf3b77143.522f6d6a-d661-4c5b-a0e3-a3eb0e464cba" returned: 0 in 0.927s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:48:23 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-d496db27-1652-4b8e-8933-fe2dde72da9e tempest-VolumeSnapshotQuotasNegativeTestJSON-1906583416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8743b380-bd98-4a78-ad65-0e9cf3b77143.info {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:48:23 devstack sudo[94181]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8743b380-bd98-4a78-ad65-0e9cf3b77143.info
Jul 02 19:48:23 devstack sudo[94181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:48:24 devstack sudo[94181]: pam_unix(sudo:session): session closed for user root
Jul 02 19:48:24 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-d496db27-1652-4b8e-8933-fe2dde72da9e tempest-VolumeSnapshotQuotasNegativeTestJSON-1906583416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8743b380-bd98-4a78-ad65-0e9cf3b77143.info" returned: 0 in 0.953s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:48:24 devstack cinder-volume[86639]: WARNING cinder.volume.drivers.remotefs [None req-d496db27-1652-4b8e-8933-fe2dde72da9e tempest-VolumeSnapshotQuotasNegativeTestJSON-1906583416 None] /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8743b380-bd98-4a78-ad65-0e9cf3b77143.info is being set with open permissions: ugo+rw
Jul 02 19:48:24 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-d496db27-1652-4b8e-8933-fe2dde72da9e tempest-VolumeSnapshotQuotasNegativeTestJSON-1906583416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8743b380-bd98-4a78-ad65-0e9cf3b77143.info {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:48:24 devstack sudo[94185]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8743b380-bd98-4a78-ad65-0e9cf3b77143.info
Jul 02 19:48:24 devstack sudo[94185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:48:25 devstack sudo[94185]: pam_unix(sudo:session): session closed for user root
Jul 02 19:48:25 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-d496db27-1652-4b8e-8933-fe2dde72da9e tempest-VolumeSnapshotQuotasNegativeTestJSON-1906583416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8743b380-bd98-4a78-ad65-0e9cf3b77143.info" returned: 0 in 0.778s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:48:25 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-d496db27-1652-4b8e-8933-fe2dde72da9e tempest-VolumeSnapshotQuotasNegativeTestJSON-1906583416 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.118s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:48:25 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-d496db27-1652-4b8e-8933-fe2dde72da9e tempest-VolumeSnapshotQuotasNegativeTestJSON-1906583416 None] Create snapshot completed successfully
Jul 02 19:48:26 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-1c21c16a-c18a-4529-9583-4dac4f8748d0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1906583416 None] Acquiring lock "cinder-522f6d6a-d661-4c5b-a0e3-a3eb0e464cba-delete_snapshot" by "delete_snapshot" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:48:26 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-1c21c16a-c18a-4529-9583-4dac4f8748d0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1906583416 None] Lock "cinder-522f6d6a-d661-4c5b-a0e3-a3eb0e464cba-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:48:26 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-1c21c16a-c18a-4529-9583-4dac4f8748d0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1906583416 None] Acquiring lock "cinder-quobyte-8743b380-bd98-4a78-ad65-0e9cf3b77143" by "delete_snapshot" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:48:26 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-1c21c16a-c18a-4529-9583-4dac4f8748d0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1906583416 None] Lock "cinder-quobyte-8743b380-bd98-4a78-ad65-0e9cf3b77143" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:48:26 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-1c21c16a-c18a-4529-9583-4dac4f8748d0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1906583416 None] Acquiring lock "cinder-quobyte-522f6d6a-d661-4c5b-a0e3-a3eb0e464cba" by "_delete_snapshot" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:48:26 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-1c21c16a-c18a-4529-9583-4dac4f8748d0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1906583416 None] Lock "cinder-quobyte-522f6d6a-d661-4c5b-a0e3-a3eb0e464cba" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:48:26 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-1c21c16a-c18a-4529-9583-4dac4f8748d0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1906583416 None] Deleting offline snapshot 522f6d6a-d661-4c5b-a0e3-a3eb0e464cba of volume 8743b380-bd98-4a78-ad65-0e9cf3b77143 {{(pid=86639) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 02 19:48:26 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-1c21c16a-c18a-4529-9583-4dac4f8748d0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1906583416 None] snapshot_file for this snap is: volume-8743b380-bd98-4a78-ad65-0e9cf3b77143.522f6d6a-d661-4c5b-a0e3-a3eb0e464cba {{(pid=86639) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 02 19:48:26 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[b22f2a2f-3750-4b32-a132-5ef44594ce47]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 19:48:26 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-1c21c16a-c18a-4529-9583-4dac4f8748d0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1906583416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8743b380-bd98-4a78-ad65-0e9cf3b77143.522f6d6a-d661-4c5b-a0e3-a3eb0e464cba {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:48:26 devstack sudo[94189]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8743b380-bd98-4a78-ad65-0e9cf3b77143.522f6d6a-d661-4c5b-a0e3-a3eb0e464cba
Jul 02 19:48:26 devstack sudo[94189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:48:27 devstack sudo[94189]: pam_unix(sudo:session): session closed for user root
Jul 02 19:48:27 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-1c21c16a-c18a-4529-9583-4dac4f8748d0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1906583416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8743b380-bd98-4a78-ad65-0e9cf3b77143.522f6d6a-d661-4c5b-a0e3-a3eb0e464cba" returned: 0 in 1.070s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:48:27 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-1c21c16a-c18a-4529-9583-4dac4f8748d0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1906583416 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8743b380-bd98-4a78-ad65-0e9cf3b77143(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86639) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 02 19:48:27 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[1308945d-b6c0-4c63-9ee5-7be11fa91928]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 19:48:27 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-1c21c16a-c18a-4529-9583-4dac4f8748d0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1906583416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8743b380-bd98-4a78-ad65-0e9cf3b77143 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:48:27 devstack sudo[94194]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8743b380-bd98-4a78-ad65-0e9cf3b77143
Jul 02 19:48:27 devstack sudo[94194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:48:28 devstack sudo[94194]: pam_unix(sudo:session): session closed for user root
Jul 02 19:48:28 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-1c21c16a-c18a-4529-9583-4dac4f8748d0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1906583416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8743b380-bd98-4a78-ad65-0e9cf3b77143" returned: 0 in 0.962s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:48:28 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-1c21c16a-c18a-4529-9583-4dac4f8748d0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1906583416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8743b380-bd98-4a78-ad65-0e9cf3b77143.522f6d6a-d661-4c5b-a0e3-a3eb0e464cba {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:48:28 devstack sudo[94200]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8743b380-bd98-4a78-ad65-0e9cf3b77143.522f6d6a-d661-4c5b-a0e3-a3eb0e464cba
Jul 02 19:48:28 devstack sudo[94200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:48:29 devstack sudo[94200]: pam_unix(sudo:session): session closed for user root
Jul 02 19:48:29 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-1c21c16a-c18a-4529-9583-4dac4f8748d0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1906583416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8743b380-bd98-4a78-ad65-0e9cf3b77143.522f6d6a-d661-4c5b-a0e3-a3eb0e464cba" returned: 0 in 1.204s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:48:29 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-1c21c16a-c18a-4529-9583-4dac4f8748d0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1906583416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8743b380-bd98-4a78-ad65-0e9cf3b77143.522f6d6a-d661-4c5b-a0e3-a3eb0e464cba {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:48:29 devstack sudo[94207]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8743b380-bd98-4a78-ad65-0e9cf3b77143.522f6d6a-d661-4c5b-a0e3-a3eb0e464cba
Jul 02 19:48:29 devstack sudo[94207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:48:30 devstack sudo[94207]: pam_unix(sudo:session): session closed for user root
Jul 02 19:48:30 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-1c21c16a-c18a-4529-9583-4dac4f8748d0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1906583416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8743b380-bd98-4a78-ad65-0e9cf3b77143.522f6d6a-d661-4c5b-a0e3-a3eb0e464cba" returned: 0 in 0.865s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:48:30 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-1c21c16a-c18a-4529-9583-4dac4f8748d0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1906583416 None] Lock "cinder-quobyte-522f6d6a-d661-4c5b-a0e3-a3eb0e464cba" released by "_delete_snapshot" :: held 4.293s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:48:30 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-1c21c16a-c18a-4529-9583-4dac4f8748d0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1906583416 None] Lock "cinder-quobyte-8743b380-bd98-4a78-ad65-0e9cf3b77143" released by "delete_snapshot" :: held 4.325s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:48:30 devstack cinder-volume[86639]: WARNING cinder.quota [None req-1c21c16a-c18a-4529-9583-4dac4f8748d0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1906583416 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Jul 02 19:48:30 devstack cinder-volume[86639]: DEBUG cinder.quota [None req-1c21c16a-c18a-4529-9583-4dac4f8748d0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1906583416 None] Created reservations ['0fe8753b-cd41-4d4b-b666-794e9a6299cb', 'f898d90a-7afb-457a-9971-f3c801f7a312', '4d3c110a-6895-481b-a421-77b5d1224d41', '7e9b0597-ce50-412c-a45a-2049cebfaba6'] {{(pid=86639) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 19:48:30 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-1c21c16a-c18a-4529-9583-4dac4f8748d0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1906583416 None] Delete snapshot completed successfully.
Jul 02 19:48:30 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-1c21c16a-c18a-4529-9583-4dac4f8748d0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1906583416 None] Lock "cinder-522f6d6a-d661-4c5b-a0e3-a3eb0e464cba-delete_snapshot" released by "delete_snapshot" :: held 4.526s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:48:31 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-56a8a641-c604-48d7-8949-5d21a11e381a tempest-VolumeSnapshotQuotasNegativeTestJSON-1906583416 None] Acquiring lock "cinder-8743b380-bd98-4a78-ad65-0e9cf3b77143-delete_volume" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:48:31 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-56a8a641-c604-48d7-8949-5d21a11e381a tempest-VolumeSnapshotQuotasNegativeTestJSON-1906583416 None] Lock "cinder-8743b380-bd98-4a78-ad65-0e9cf3b77143-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:48:31 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-56a8a641-c604-48d7-8949-5d21a11e381a tempest-VolumeSnapshotQuotasNegativeTestJSON-1906583416 None] Acquiring lock "cinder-quobyte-8743b380-bd98-4a78-ad65-0e9cf3b77143" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:48:31 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-56a8a641-c604-48d7-8949-5d21a11e381a tempest-VolumeSnapshotQuotasNegativeTestJSON-1906583416 None] Lock "cinder-quobyte-8743b380-bd98-4a78-ad65-0e9cf3b77143" acquired by "delete_volume" :: waited 0.017s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:48:31 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[011167be-cac5-427c-8eb0-95859db12ada]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 19:48:31 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-56a8a641-c604-48d7-8949-5d21a11e381a tempest-VolumeSnapshotQuotasNegativeTestJSON-1906583416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8743b380-bd98-4a78-ad65-0e9cf3b77143 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:48:32 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [req-a41f45df-1691-451d-96b5-7f51c764cc30 req-9826e07e-fd61-4531-80aa-d9f0bc251a53 tempest-AttachVolumeShelveTestJSON-313905155 None] No connector for attachment dded1bb6-eeef-48be-a444-8fd40078033f; skipping storage backend terminate_connection call. {{(pid=86639) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}}
Jul 02 19:48:32 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [req-a41f45df-1691-451d-96b5-7f51c764cc30 req-9826e07e-fd61-4531-80aa-d9f0bc251a53 tempest-AttachVolumeShelveTestJSON-313905155 None] Deleting attachment dded1bb6-eeef-48be-a444-8fd40078033f. {{(pid=86639) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 02 19:48:32 devstack sudo[94218]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8743b380-bd98-4a78-ad65-0e9cf3b77143
Jul 02 19:48:32 devstack sudo[94218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:48:32 devstack cinder-volume[86639]: DEBUG cinder.volume.flows.manager.create_volume [req-49a11f68-a73d-4c52-bc9e-af79208f0270 req-b8e14a6d-c6e3-4215-bf2b-342a26186266 tempest-VolumesSnapshotsTestJSON-555900694 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 19:48:32 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [req-49a11f68-a73d-4c52-bc9e-af79208f0270 req-b8e14a6d-c6e3-4215-bf2b-342a26186266 tempest-VolumesSnapshotsTestJSON-555900694 None] Flow 'volume_create_manager' (c9181b44-256e-4f4b-913e-3bb3b2fccc7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 19:48:32 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [req-49a11f68-a73d-4c52-bc9e-af79208f0270 req-b8e14a6d-c6e3-4215-bf2b-342a26186266 tempest-VolumesSnapshotsTestJSON-555900694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5cf94f45-3a75-4899-83f1-cf6dea074f3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:48:32 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [req-49a11f68-a73d-4c52-bc9e-af79208f0270 req-b8e14a6d-c6e3-4215-bf2b-342a26186266 tempest-VolumesSnapshotsTestJSON-555900694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5cf94f45-3a75-4899-83f1-cf6dea074f3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T17:48:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1666837695',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59904172-12f9-4def-b713-1e337844251b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26fada0b7ef44dcc9b82bc02ecb21ada',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T17:48:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T17:48:32Z,use_quota=True,user_id='6b6f6c6768bf49558ba7cb72e906b3a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:48:32 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [req-49a11f68-a73d-4c52-bc9e-af79208f0270 req-b8e14a6d-c6e3-4215-bf2b-342a26186266 tempest-VolumesSnapshotsTestJSON-555900694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1bb582f3-08be-44b0-9f4a-05523bb7964f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:48:32 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [req-49a11f68-a73d-4c52-bc9e-af79208f0270 req-b8e14a6d-c6e3-4215-bf2b-342a26186266 tempest-VolumesSnapshotsTestJSON-555900694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1bb582f3-08be-44b0-9f4a-05523bb7964f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:48:32 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [req-49a11f68-a73d-4c52-bc9e-af79208f0270 req-b8e14a6d-c6e3-4215-bf2b-342a26186266 tempest-VolumesSnapshotsTestJSON-555900694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9c61fe0-ef27-439b-8bcb-88d4f51ca440) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:48:32 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [req-49a11f68-a73d-4c52-bc9e-af79208f0270 req-b8e14a6d-c6e3-4215-bf2b-342a26186266 tempest-VolumesSnapshotsTestJSON-555900694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9c61fe0-ef27-439b-8bcb-88d4f51ca440) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '59904172-12f9-4def-b713-1e337844251b', 'volume_name': 'volume-59904172-12f9-4def-b713-1e337844251b', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:48:32 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [req-49a11f68-a73d-4c52-bc9e-af79208f0270 req-b8e14a6d-c6e3-4215-bf2b-342a26186266 tempest-VolumesSnapshotsTestJSON-555900694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3de738e-dc3c-409f-a61e-22772d908c11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:48:32 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [req-49a11f68-a73d-4c52-bc9e-af79208f0270 req-b8e14a6d-c6e3-4215-bf2b-342a26186266 tempest-VolumesSnapshotsTestJSON-555900694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3de738e-dc3c-409f-a61e-22772d908c11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:48:32 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [req-49a11f68-a73d-4c52-bc9e-af79208f0270 req-b8e14a6d-c6e3-4215-bf2b-342a26186266 tempest-VolumesSnapshotsTestJSON-555900694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90f5dd97-3975-4d76-89bc-eda02cfe1fee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:48:32 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [req-49a11f68-a73d-4c52-bc9e-af79208f0270 req-b8e14a6d-c6e3-4215-bf2b-342a26186266 tempest-VolumesSnapshotsTestJSON-555900694 None] Volume 59904172-12f9-4def-b713-1e337844251b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-59904172-12f9-4def-b713-1e337844251b', 'volume_size': 1}
Jul 02 19:48:32 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [req-49a11f68-a73d-4c52-bc9e-af79208f0270 req-b8e14a6d-c6e3-4215-bf2b-342a26186266 tempest-VolumesSnapshotsTestJSON-555900694 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:48:32 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [req-49a11f68-a73d-4c52-bc9e-af79208f0270 req-b8e14a6d-c6e3-4215-bf2b-342a26186266 tempest-VolumesSnapshotsTestJSON-555900694 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:48:32 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [req-49a11f68-a73d-4c52-bc9e-af79208f0270 req-b8e14a6d-c6e3-4215-bf2b-342a26186266 tempest-VolumesSnapshotsTestJSON-555900694 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce906cb830>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T17:48:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1666837695',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59904172-12f9-4def-b713-1e337844251b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26fada0b7ef44dcc9b82bc02ecb21ada',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T17:48:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T17:48:32Z,use_quota=True,user_id='6b6f6c6768bf49558ba7cb72e906b3a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)}" {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 19:48:32 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [req-49a11f68-a73d-4c52-bc9e-af79208f0270 req-b8e14a6d-c6e3-4215-bf2b-342a26186266 tempest-VolumesSnapshotsTestJSON-555900694 None] Creating volume 59904172-12f9-4def-b713-1e337844251b {{(pid=86639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 19:48:32 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [req-49a11f68-a73d-4c52-bc9e-af79208f0270 req-b8e14a6d-c6e3-4215-bf2b-342a26186266 tempest-VolumesSnapshotsTestJSON-555900694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:48:32 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [req-49a11f68-a73d-4c52-bc9e-af79208f0270 req-b8e14a6d-c6e3-4215-bf2b-342a26186266 tempest-VolumesSnapshotsTestJSON-555900694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:48:32 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [req-49a11f68-a73d-4c52-bc9e-af79208f0270 req-b8e14a6d-c6e3-4215-bf2b-342a26186266 tempest-VolumesSnapshotsTestJSON-555900694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 19:48:32 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [req-49a11f68-a73d-4c52-bc9e-af79208f0270 req-b8e14a6d-c6e3-4215-bf2b-342a26186266 tempest-VolumesSnapshotsTestJSON-555900694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 19:48:32 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [req-49a11f68-a73d-4c52-bc9e-af79208f0270 req-b8e14a6d-c6e3-4215-bf2b-342a26186266 tempest-VolumesSnapshotsTestJSON-555900694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:48:32 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [req-49a11f68-a73d-4c52-bc9e-af79208f0270 req-b8e14a6d-c6e3-4215-bf2b-342a26186266 tempest-VolumesSnapshotsTestJSON-555900694 None] Selected osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92 as target Quobyte volume. {{(pid=86639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 19:48:32 devstack cinder-volume[86639]: INFO cinder.volume.drivers.remotefs [req-49a11f68-a73d-4c52-bc9e-af79208f0270 req-b8e14a6d-c6e3-4215-bf2b-342a26186266 tempest-VolumesSnapshotsTestJSON-555900694 None] casted to osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92
Jul 02 19:48:32 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [req-49a11f68-a73d-4c52-bc9e-af79208f0270 req-b8e14a6d-c6e3-4215-bf2b-342a26186266 tempest-VolumesSnapshotsTestJSON-555900694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-59904172-12f9-4def-b713-1e337844251b 1073741824 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:48:32 devstack sudo[94226]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-59904172-12f9-4def-b713-1e337844251b 1073741824
Jul 02 19:48:32 devstack sudo[94226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:48:33 devstack sudo[94218]: pam_unix(sudo:session): session closed for user root
Jul 02 19:48:33 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-56a8a641-c604-48d7-8949-5d21a11e381a tempest-VolumeSnapshotQuotasNegativeTestJSON-1906583416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8743b380-bd98-4a78-ad65-0e9cf3b77143" returned: 0 in 1.070s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:48:33 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-56a8a641-c604-48d7-8949-5d21a11e381a tempest-VolumeSnapshotQuotasNegativeTestJSON-1906583416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8743b380-bd98-4a78-ad65-0e9cf3b77143 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:48:33 devstack sudo[94234]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8743b380-bd98-4a78-ad65-0e9cf3b77143
Jul 02 19:48:33 devstack sudo[94234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:48:33 devstack sudo[94226]: pam_unix(sudo:session): session closed for user root
Jul 02 19:48:33 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [req-49a11f68-a73d-4c52-bc9e-af79208f0270 req-b8e14a6d-c6e3-4215-bf2b-342a26186266 tempest-VolumesSnapshotsTestJSON-555900694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-59904172-12f9-4def-b713-1e337844251b 1073741824" returned: 0 in 1.235s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:48:33 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [req-49a11f68-a73d-4c52-bc9e-af79208f0270 req-b8e14a6d-c6e3-4215-bf2b-342a26186266 tempest-VolumesSnapshotsTestJSON-555900694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-59904172-12f9-4def-b713-1e337844251b {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:48:33 devstack sudo[94242]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-59904172-12f9-4def-b713-1e337844251b
Jul 02 19:48:33 devstack sudo[94242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:48:33 devstack cinder-volume[86639]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4855a6e-646b-408b-95e4-37ac86e2180f tempest-AttachVolumeNegativeTest-732301193 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 19:48:33 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-a4855a6e-646b-408b-95e4-37ac86e2180f tempest-AttachVolumeNegativeTest-732301193 None] Flow 'volume_create_manager' (2cbb67d7-c1e0-45a8-b60f-f9dcb13530a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 19:48:33 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-a4855a6e-646b-408b-95e4-37ac86e2180f tempest-AttachVolumeNegativeTest-732301193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e8e74e1-e263-4493-a14a-33f789a0e0b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:48:33 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-a4855a6e-646b-408b-95e4-37ac86e2180f tempest-AttachVolumeNegativeTest-732301193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e8e74e1-e263-4493-a14a-33f789a0e0b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T17:48:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1704978008',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0d8d55a-8d45-43e2-9cfe-74c280ab466f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07c1a061c5c147f690026cea928da2e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T17:48:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T17:48:34Z,use_quota=True,user_id='3be7789436f643fe94460f153a717254',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:48:34 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-a4855a6e-646b-408b-95e4-37ac86e2180f tempest-AttachVolumeNegativeTest-732301193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efda541a-9305-4f69-a729-932a311158ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:48:34 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-a4855a6e-646b-408b-95e4-37ac86e2180f tempest-AttachVolumeNegativeTest-732301193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efda541a-9305-4f69-a729-932a311158ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:48:34 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-a4855a6e-646b-408b-95e4-37ac86e2180f tempest-AttachVolumeNegativeTest-732301193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3f16533-4dfe-4c21-b0fe-069bdd3eec06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:48:34 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-a4855a6e-646b-408b-95e4-37ac86e2180f tempest-AttachVolumeNegativeTest-732301193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3f16533-4dfe-4c21-b0fe-069bdd3eec06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f0d8d55a-8d45-43e2-9cfe-74c280ab466f', 'volume_name': 'volume-f0d8d55a-8d45-43e2-9cfe-74c280ab466f', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:48:34 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-a4855a6e-646b-408b-95e4-37ac86e2180f tempest-AttachVolumeNegativeTest-732301193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fa6eae7-af9f-4719-8561-f911990f1276) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:48:34 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-a4855a6e-646b-408b-95e4-37ac86e2180f tempest-AttachVolumeNegativeTest-732301193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fa6eae7-af9f-4719-8561-f911990f1276) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:48:34 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-a4855a6e-646b-408b-95e4-37ac86e2180f tempest-AttachVolumeNegativeTest-732301193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b81e8357-e84a-4336-854c-04df8bb4e34e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:48:34 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-a4855a6e-646b-408b-95e4-37ac86e2180f tempest-AttachVolumeNegativeTest-732301193 None] Volume f0d8d55a-8d45-43e2-9cfe-74c280ab466f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f0d8d55a-8d45-43e2-9cfe-74c280ab466f', 'volume_size': 1}
Jul 02 19:48:34 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-a4855a6e-646b-408b-95e4-37ac86e2180f tempest-AttachVolumeNegativeTest-732301193 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:48:34 devstack sudo[94234]: pam_unix(sudo:session): session closed for user root
Jul 02 19:48:34 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-56a8a641-c604-48d7-8949-5d21a11e381a tempest-VolumeSnapshotQuotasNegativeTestJSON-1906583416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8743b380-bd98-4a78-ad65-0e9cf3b77143" returned: 0 in 1.010s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:48:34 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-56a8a641-c604-48d7-8949-5d21a11e381a tempest-VolumeSnapshotQuotasNegativeTestJSON-1906583416 None] Lock "cinder-quobyte-8743b380-bd98-4a78-ad65-0e9cf3b77143" released by "delete_volume" :: held 2.173s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:48:34 devstack cinder-volume[86639]: DEBUG cinder.quota [None req-56a8a641-c604-48d7-8949-5d21a11e381a tempest-VolumeSnapshotQuotasNegativeTestJSON-1906583416 None] Created reservations ['9d1bcf77-2986-4347-b8b9-5a935553c5e4', '08b11b65-ee48-4af8-8fc3-a52dd819a2a7', 'd65c3fe7-63f1-4727-baa8-8ddd9424d0a0', '8af5c744-9bfa-411b-9bc8-fd6ff4ef1581'] {{(pid=86639) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 19:48:34 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-56a8a641-c604-48d7-8949-5d21a11e381a tempest-VolumeSnapshotQuotasNegativeTestJSON-1906583416 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:48:34 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-56a8a641-c604-48d7-8949-5d21a11e381a tempest-VolumeSnapshotQuotasNegativeTestJSON-1906583416 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:48:34 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-56a8a641-c604-48d7-8949-5d21a11e381a tempest-VolumeSnapshotQuotasNegativeTestJSON-1906583416 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 19:48:34 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-56a8a641-c604-48d7-8949-5d21a11e381a tempest-VolumeSnapshotQuotasNegativeTestJSON-1906583416 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 19:48:34 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-56a8a641-c604-48d7-8949-5d21a11e381a tempest-VolumeSnapshotQuotasNegativeTestJSON-1906583416 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:48:34 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-56a8a641-c604-48d7-8949-5d21a11e381a tempest-VolumeSnapshotQuotasNegativeTestJSON-1906583416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:48:34 devstack sudo[94247]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e
Jul 02 19:48:34 devstack sudo[94247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:48:34 devstack sudo[94242]: pam_unix(sudo:session): session closed for user root
Jul 02 19:48:34 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [req-49a11f68-a73d-4c52-bc9e-af79208f0270 req-b8e14a6d-c6e3-4215-bf2b-342a26186266 tempest-VolumesSnapshotsTestJSON-555900694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-59904172-12f9-4def-b713-1e337844251b" returned: 0 in 0.832s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:48:34 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [req-49a11f68-a73d-4c52-bc9e-af79208f0270 req-b8e14a6d-c6e3-4215-bf2b-342a26186266 tempest-VolumesSnapshotsTestJSON-555900694 None] <== create_volume: return (2225ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'} {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 19:48:34 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [req-49a11f68-a73d-4c52-bc9e-af79208f0270 req-b8e14a6d-c6e3-4215-bf2b-342a26186266 tempest-VolumesSnapshotsTestJSON-555900694 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.228s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:48:34 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-a4855a6e-646b-408b-95e4-37ac86e2180f tempest-AttachVolumeNegativeTest-732301193 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.612s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:48:34 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-a4855a6e-646b-408b-95e4-37ac86e2180f tempest-AttachVolumeNegativeTest-732301193 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce906cb830>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T17:48:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1704978008',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0d8d55a-8d45-43e2-9cfe-74c280ab466f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07c1a061c5c147f690026cea928da2e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T17:48:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T17:48:34Z,use_quota=True,user_id='3be7789436f643fe94460f153a717254',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)}" {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 19:48:34 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-a4855a6e-646b-408b-95e4-37ac86e2180f tempest-AttachVolumeNegativeTest-732301193 None] Creating volume f0d8d55a-8d45-43e2-9cfe-74c280ab466f {{(pid=86639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 19:48:34 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-a4855a6e-646b-408b-95e4-37ac86e2180f tempest-AttachVolumeNegativeTest-732301193 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:48:34 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-a4855a6e-646b-408b-95e4-37ac86e2180f tempest-AttachVolumeNegativeTest-732301193 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:48:34 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-a4855a6e-646b-408b-95e4-37ac86e2180f tempest-AttachVolumeNegativeTest-732301193 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 19:48:34 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-a4855a6e-646b-408b-95e4-37ac86e2180f tempest-AttachVolumeNegativeTest-732301193 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 19:48:34 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-a4855a6e-646b-408b-95e4-37ac86e2180f tempest-AttachVolumeNegativeTest-732301193 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:48:34 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-a4855a6e-646b-408b-95e4-37ac86e2180f tempest-AttachVolumeNegativeTest-732301193 None] Selected osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92 as target Quobyte volume. {{(pid=86639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 19:48:34 devstack cinder-volume[86639]: INFO cinder.volume.drivers.remotefs [None req-a4855a6e-646b-408b-95e4-37ac86e2180f tempest-AttachVolumeNegativeTest-732301193 None] casted to osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92
Jul 02 19:48:34 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-a4855a6e-646b-408b-95e4-37ac86e2180f tempest-AttachVolumeNegativeTest-732301193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-f0d8d55a-8d45-43e2-9cfe-74c280ab466f 1073741824 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:48:34 devstack sudo[94250]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-f0d8d55a-8d45-43e2-9cfe-74c280ab466f 1073741824
Jul 02 19:48:34 devstack sudo[94250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:48:34 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [req-49a11f68-a73d-4c52-bc9e-af79208f0270 req-b8e14a6d-c6e3-4215-bf2b-342a26186266 tempest-VolumesSnapshotsTestJSON-555900694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90f5dd97-3975-4d76-89bc-eda02cfe1fee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-59904172-12f9-4def-b713-1e337844251b', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:48:34 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [req-49a11f68-a73d-4c52-bc9e-af79208f0270 req-b8e14a6d-c6e3-4215-bf2b-342a26186266 tempest-VolumesSnapshotsTestJSON-555900694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49e796dc-0f62-4222-87d9-e0f178ccb514) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:48:34 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [req-49a11f68-a73d-4c52-bc9e-af79208f0270 req-b8e14a6d-c6e3-4215-bf2b-342a26186266 tempest-VolumesSnapshotsTestJSON-555900694 None] Volume volume-59904172-12f9-4def-b713-1e337844251b (59904172-12f9-4def-b713-1e337844251b): created successfully
Jul 02 19:48:34 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [req-49a11f68-a73d-4c52-bc9e-af79208f0270 req-b8e14a6d-c6e3-4215-bf2b-342a26186266 tempest-VolumesSnapshotsTestJSON-555900694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49e796dc-0f62-4222-87d9-e0f178ccb514) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:48:34 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [req-49a11f68-a73d-4c52-bc9e-af79208f0270 req-b8e14a6d-c6e3-4215-bf2b-342a26186266 tempest-VolumesSnapshotsTestJSON-555900694 None] Flow 'volume_create_manager' (c9181b44-256e-4f4b-913e-3bb3b2fccc7e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 19:48:34 devstack cinder-volume[86639]: INFO cinder.volume.manager [req-49a11f68-a73d-4c52-bc9e-af79208f0270 req-b8e14a6d-c6e3-4215-bf2b-342a26186266 tempest-VolumesSnapshotsTestJSON-555900694 None] Created volume successfully.
Jul 02 19:48:35 devstack sudo[94247]: pam_unix(sudo:session): session closed for user root
Jul 02 19:48:35 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-56a8a641-c604-48d7-8949-5d21a11e381a tempest-VolumeSnapshotQuotasNegativeTestJSON-1906583416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e" returned: 0 in 0.840s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:48:35 devstack cinder-volume[86639]: DEBUG cinder.manager [None req-56a8a641-c604-48d7-8949-5d21a11e381a tempest-VolumeSnapshotQuotasNegativeTestJSON-1906583416 None] Notifying Schedulers of capabilities ... {{(pid=86639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 19:48:35 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-56a8a641-c604-48d7-8949-5d21a11e381a tempest-VolumeSnapshotQuotasNegativeTestJSON-1906583416 None] Deleted volume successfully.
Jul 02 19:48:35 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-56a8a641-c604-48d7-8949-5d21a11e381a tempest-VolumeSnapshotQuotasNegativeTestJSON-1906583416 None] Lock "cinder-8743b380-bd98-4a78-ad65-0e9cf3b77143-delete_volume" released by "delete_volume" :: held 3.289s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:48:35 devstack sudo[94250]: pam_unix(sudo:session): session closed for user root
Jul 02 19:48:35 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-a4855a6e-646b-408b-95e4-37ac86e2180f tempest-AttachVolumeNegativeTest-732301193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-f0d8d55a-8d45-43e2-9cfe-74c280ab466f 1073741824" returned: 0 in 1.013s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:48:35 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-a4855a6e-646b-408b-95e4-37ac86e2180f tempest-AttachVolumeNegativeTest-732301193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-f0d8d55a-8d45-43e2-9cfe-74c280ab466f {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:48:35 devstack sudo[94258]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-f0d8d55a-8d45-43e2-9cfe-74c280ab466f
Jul 02 19:48:35 devstack sudo[94258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:48:36 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [req-3f33efe5-2e13-41b5-a680-dc3ccf014ace req-3b62b80c-1e31-487c-9e85-040c9cd81296 tempest-VolumesSnapshotsTestJSON-555900694 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:48:36 devstack sudo[94258]: pam_unix(sudo:session): session closed for user root
Jul 02 19:48:36 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-a4855a6e-646b-408b-95e4-37ac86e2180f tempest-AttachVolumeNegativeTest-732301193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-f0d8d55a-8d45-43e2-9cfe-74c280ab466f" returned: 0 in 0.866s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:48:36 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-a4855a6e-646b-408b-95e4-37ac86e2180f tempest-AttachVolumeNegativeTest-732301193 None] <== create_volume: return (1940ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'} {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 19:48:36 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-a4855a6e-646b-408b-95e4-37ac86e2180f tempest-AttachVolumeNegativeTest-732301193 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.944s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:48:36 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [req-3f33efe5-2e13-41b5-a680-dc3ccf014ace req-3b62b80c-1e31-487c-9e85-040c9cd81296 tempest-VolumesSnapshotsTestJSON-555900694 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.507s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:48:36 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-a4855a6e-646b-408b-95e4-37ac86e2180f tempest-AttachVolumeNegativeTest-732301193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b81e8357-e84a-4336-854c-04df8bb4e34e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f0d8d55a-8d45-43e2-9cfe-74c280ab466f', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:48:36 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-a4855a6e-646b-408b-95e4-37ac86e2180f tempest-AttachVolumeNegativeTest-732301193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9c23859-5d65-427b-b4be-db873faa9d6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:48:36 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [req-3f33efe5-2e13-41b5-a680-dc3ccf014ace req-3b62b80c-1e31-487c-9e85-040c9cd81296 tempest-VolumesSnapshotsTestJSON-555900694 None] Creating offline snapshot 12a099c6-4eaf-4850-9a69-3f1bdba53d79 of volume 59904172-12f9-4def-b713-1e337844251b {{(pid=86639) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 02 19:48:36 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-a4855a6e-646b-408b-95e4-37ac86e2180f tempest-AttachVolumeNegativeTest-732301193 None] Volume volume-f0d8d55a-8d45-43e2-9cfe-74c280ab466f (f0d8d55a-8d45-43e2-9cfe-74c280ab466f): created successfully
Jul 02 19:48:36 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-a4855a6e-646b-408b-95e4-37ac86e2180f tempest-AttachVolumeNegativeTest-732301193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9c23859-5d65-427b-b4be-db873faa9d6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:48:36 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-a4855a6e-646b-408b-95e4-37ac86e2180f tempest-AttachVolumeNegativeTest-732301193 None] Flow 'volume_create_manager' (2cbb67d7-c1e0-45a8-b60f-f9dcb13530a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 19:48:36 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[849efaff-1bdc-463e-947d-7366e6538f54]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 19:48:36 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [req-3f33efe5-2e13-41b5-a680-dc3ccf014ace req-3b62b80c-1e31-487c-9e85-040c9cd81296 tempest-VolumesSnapshotsTestJSON-555900694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-59904172-12f9-4def-b713-1e337844251b {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:48:36 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-a4855a6e-646b-408b-95e4-37ac86e2180f tempest-AttachVolumeNegativeTest-732301193 None] Created volume successfully.
Jul 02 19:48:36 devstack sudo[94261]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-59904172-12f9-4def-b713-1e337844251b
Jul 02 19:48:36 devstack sudo[94261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:48:37 devstack sudo[94261]: pam_unix(sudo:session): session closed for user root
Jul 02 19:48:37 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [req-3f33efe5-2e13-41b5-a680-dc3ccf014ace req-3b62b80c-1e31-487c-9e85-040c9cd81296 tempest-VolumesSnapshotsTestJSON-555900694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-59904172-12f9-4def-b713-1e337844251b" returned: 0 in 0.975s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:48:37 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [req-3f33efe5-2e13-41b5-a680-dc3ccf014ace req-3b62b80c-1e31-487c-9e85-040c9cd81296 tempest-VolumesSnapshotsTestJSON-555900694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-59904172-12f9-4def-b713-1e337844251b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-59904172-12f9-4def-b713-1e337844251b.12a099c6-4eaf-4850-9a69-3f1bdba53d79 1G {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:48:37 devstack sudo[94270]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-59904172-12f9-4def-b713-1e337844251b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-59904172-12f9-4def-b713-1e337844251b.12a099c6-4eaf-4850-9a69-3f1bdba53d79 1G
Jul 02 19:48:37 devstack sudo[94270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:48:38 devstack sudo[94270]: pam_unix(sudo:session): session closed for user root
Jul 02 19:48:38 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [req-3f33efe5-2e13-41b5-a680-dc3ccf014ace req-3b62b80c-1e31-487c-9e85-040c9cd81296 tempest-VolumesSnapshotsTestJSON-555900694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-59904172-12f9-4def-b713-1e337844251b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-59904172-12f9-4def-b713-1e337844251b.12a099c6-4eaf-4850-9a69-3f1bdba53d79 1G" returned: 0 in 0.975s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:48:38 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [req-3f33efe5-2e13-41b5-a680-dc3ccf014ace req-3b62b80c-1e31-487c-9e85-040c9cd81296 tempest-VolumesSnapshotsTestJSON-555900694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-59904172-12f9-4def-b713-1e337844251b -F qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-59904172-12f9-4def-b713-1e337844251b.12a099c6-4eaf-4850-9a69-3f1bdba53d79 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:48:38 devstack sudo[94277]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-59904172-12f9-4def-b713-1e337844251b -F qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-59904172-12f9-4def-b713-1e337844251b.12a099c6-4eaf-4850-9a69-3f1bdba53d79
Jul 02 19:48:38 devstack sudo[94277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:48:39 devstack sudo[94277]: pam_unix(sudo:session): session closed for user root
Jul 02 19:48:39 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [req-3f33efe5-2e13-41b5-a680-dc3ccf014ace req-3b62b80c-1e31-487c-9e85-040c9cd81296 tempest-VolumesSnapshotsTestJSON-555900694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-59904172-12f9-4def-b713-1e337844251b -F qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-59904172-12f9-4def-b713-1e337844251b.12a099c6-4eaf-4850-9a69-3f1bdba53d79" returned: 0 in 0.819s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:48:39 devstack cinder-volume[86639]: WARNING cinder.volume.drivers.remotefs [req-3f33efe5-2e13-41b5-a680-dc3ccf014ace req-3b62b80c-1e31-487c-9e85-040c9cd81296 tempest-VolumesSnapshotsTestJSON-555900694 None] /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-59904172-12f9-4def-b713-1e337844251b.12a099c6-4eaf-4850-9a69-3f1bdba53d79 is being set with open permissions: ugo+rw
Jul 02 19:48:39 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [req-3f33efe5-2e13-41b5-a680-dc3ccf014ace req-3b62b80c-1e31-487c-9e85-040c9cd81296 tempest-VolumesSnapshotsTestJSON-555900694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-59904172-12f9-4def-b713-1e337844251b.12a099c6-4eaf-4850-9a69-3f1bdba53d79 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:48:39 devstack sudo[94282]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-59904172-12f9-4def-b713-1e337844251b.12a099c6-4eaf-4850-9a69-3f1bdba53d79
Jul 02 19:48:39 devstack sudo[94282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:48:40 devstack sudo[94282]: pam_unix(sudo:session): session closed for user root
Jul 02 19:48:40 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [req-3f33efe5-2e13-41b5-a680-dc3ccf014ace req-3b62b80c-1e31-487c-9e85-040c9cd81296 tempest-VolumesSnapshotsTestJSON-555900694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-59904172-12f9-4def-b713-1e337844251b.12a099c6-4eaf-4850-9a69-3f1bdba53d79" returned: 0 in 0.985s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:48:40 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [req-4105a424-d700-417b-a673-395d6165c71d req-5a6d6922-7444-402c-934a-c498f94b6887 tempest-AttachVolumeNegativeTest-732301193 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:48:40 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [req-3f33efe5-2e13-41b5-a680-dc3ccf014ace req-3b62b80c-1e31-487c-9e85-040c9cd81296 tempest-VolumesSnapshotsTestJSON-555900694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-59904172-12f9-4def-b713-1e337844251b.info {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:48:40 devstack sudo[94294]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-59904172-12f9-4def-b713-1e337844251b.info
Jul 02 19:48:40 devstack sudo[94294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:48:41 devstack sudo[94294]: pam_unix(sudo:session): session closed for user root
Jul 02 19:48:41 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [req-3f33efe5-2e13-41b5-a680-dc3ccf014ace req-3b62b80c-1e31-487c-9e85-040c9cd81296 tempest-VolumesSnapshotsTestJSON-555900694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-59904172-12f9-4def-b713-1e337844251b.info" returned: 0 in 0.885s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:48:41 devstack cinder-volume[86639]: WARNING cinder.volume.drivers.remotefs [req-3f33efe5-2e13-41b5-a680-dc3ccf014ace req-3b62b80c-1e31-487c-9e85-040c9cd81296 tempest-VolumesSnapshotsTestJSON-555900694 None] /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-59904172-12f9-4def-b713-1e337844251b.info is being set with open permissions: ugo+rw
Jul 02 19:48:41 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [req-3f33efe5-2e13-41b5-a680-dc3ccf014ace req-3b62b80c-1e31-487c-9e85-040c9cd81296 tempest-VolumesSnapshotsTestJSON-555900694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-59904172-12f9-4def-b713-1e337844251b.info {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:48:41 devstack sudo[94298]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-59904172-12f9-4def-b713-1e337844251b.info
Jul 02 19:48:41 devstack sudo[94298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:48:41 devstack cinder-volume[86639]: DEBUG oslo_service.periodic_task [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86639) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 02 19:48:41 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:48:41 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:48:41 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 19:48:41 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 19:48:41 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:48:41 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:48:41 devstack sudo[94300]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e
Jul 02 19:48:41 devstack sudo[94300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:48:42 devstack sudo[94298]: pam_unix(sudo:session): session closed for user root
Jul 02 19:48:42 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [req-3f33efe5-2e13-41b5-a680-dc3ccf014ace req-3b62b80c-1e31-487c-9e85-040c9cd81296 tempest-VolumesSnapshotsTestJSON-555900694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-59904172-12f9-4def-b713-1e337844251b.info" returned: 0 in 0.856s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:48:42 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [req-3f33efe5-2e13-41b5-a680-dc3ccf014ace req-3b62b80c-1e31-487c-9e85-040c9cd81296 tempest-VolumesSnapshotsTestJSON-555900694 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.661s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:48:42 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [req-4105a424-d700-417b-a673-395d6165c71d req-5a6d6922-7444-402c-934a-c498f94b6887 tempest-AttachVolumeNegativeTest-732301193 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.801s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:48:42 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd362f5d-2a24-4ebb-967a-415cfe2b61c7]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 19:48:42 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [req-4105a424-d700-417b-a673-395d6165c71d req-5a6d6922-7444-402c-934a-c498f94b6887 tempest-AttachVolumeNegativeTest-732301193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-f0d8d55a-8d45-43e2-9cfe-74c280ab466f {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:48:42 devstack cinder-volume[86639]: INFO cinder.volume.manager [req-3f33efe5-2e13-41b5-a680-dc3ccf014ace req-3b62b80c-1e31-487c-9e85-040c9cd81296 tempest-VolumesSnapshotsTestJSON-555900694 None] Create snapshot completed successfully
Jul 02 19:48:42 devstack sudo[94300]: pam_unix(sudo:session): session closed for user root
Jul 02 19:48:42 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e" returned: 0 in 0.890s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:48:42 devstack cinder-volume[86639]: DEBUG cinder.manager [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] Notifying Schedulers of capabilities ... {{(pid=86639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 19:48:42 devstack cinder-volume[86639]: DEBUG oslo_service.periodic_task [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] Running periodic task VolumeManager._thread_info {{(pid=86639) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 02 19:48:42 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] thread count: 8 {{(pid=86639) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 02 19:48:42 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] thread info: [<_MainThread(MainThread, started 140525261275264)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 140525150678016)>, <Thread(Thread-3 (stat_writer), started daemon 140525150025920)>, <Thread(Rabbit-heartbeat, started daemon 140525150500864)>, <Thread(Thread-5 (_runner), started daemon 140525149847296)>, <Thread(Thread-7 (_runner), started daemon 140525149863424)>, <Thread(fd_logger, started daemon 140525146589376)>, <Thread(privsep_reader, started daemon 140525144562432)>] {{(pid=86639) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 02 19:48:42 devstack sudo[94304]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-f0d8d55a-8d45-43e2-9cfe-74c280ab466f
Jul 02 19:48:42 devstack sudo[94304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:48:42 devstack cinder-volume[86639]: DEBUG cinder.coordination [req-70a8a550-60b8-4bb6-994f-de594d2c3d44 req-bb8b5aa3-ab03-4cc3-b9fa-5cbc964655cb tempest-VolumesSnapshotsTestJSON-555900694 None] Acquiring lock "cinder-12a099c6-4eaf-4850-9a69-3f1bdba53d79-delete_snapshot" by "delete_snapshot" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:48:42 devstack cinder-volume[86639]: DEBUG cinder.coordination [req-70a8a550-60b8-4bb6-994f-de594d2c3d44 req-bb8b5aa3-ab03-4cc3-b9fa-5cbc964655cb tempest-VolumesSnapshotsTestJSON-555900694 None] Lock "cinder-12a099c6-4eaf-4850-9a69-3f1bdba53d79-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:48:42 devstack cinder-volume[86639]: DEBUG cinder.coordination [req-70a8a550-60b8-4bb6-994f-de594d2c3d44 req-bb8b5aa3-ab03-4cc3-b9fa-5cbc964655cb tempest-VolumesSnapshotsTestJSON-555900694 None] Acquiring lock "cinder-quobyte-59904172-12f9-4def-b713-1e337844251b" by "delete_snapshot" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:48:42 devstack cinder-volume[86639]: DEBUG cinder.coordination [req-70a8a550-60b8-4bb6-994f-de594d2c3d44 req-bb8b5aa3-ab03-4cc3-b9fa-5cbc964655cb tempest-VolumesSnapshotsTestJSON-555900694 None] Lock "cinder-quobyte-59904172-12f9-4def-b713-1e337844251b" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:48:42 devstack cinder-volume[86639]: DEBUG cinder.coordination [req-70a8a550-60b8-4bb6-994f-de594d2c3d44 req-bb8b5aa3-ab03-4cc3-b9fa-5cbc964655cb tempest-VolumesSnapshotsTestJSON-555900694 None] Acquiring lock "cinder-quobyte-12a099c6-4eaf-4850-9a69-3f1bdba53d79" by "_delete_snapshot" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:48:42 devstack cinder-volume[86639]: DEBUG cinder.coordination [req-70a8a550-60b8-4bb6-994f-de594d2c3d44 req-bb8b5aa3-ab03-4cc3-b9fa-5cbc964655cb tempest-VolumesSnapshotsTestJSON-555900694 None] Lock "cinder-quobyte-12a099c6-4eaf-4850-9a69-3f1bdba53d79" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:48:42 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [req-70a8a550-60b8-4bb6-994f-de594d2c3d44 req-bb8b5aa3-ab03-4cc3-b9fa-5cbc964655cb tempest-VolumesSnapshotsTestJSON-555900694 None] Deleting offline snapshot 12a099c6-4eaf-4850-9a69-3f1bdba53d79 of volume 59904172-12f9-4def-b713-1e337844251b {{(pid=86639) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 02 19:48:42 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [req-70a8a550-60b8-4bb6-994f-de594d2c3d44 req-bb8b5aa3-ab03-4cc3-b9fa-5cbc964655cb tempest-VolumesSnapshotsTestJSON-555900694 None] snapshot_file for this snap is: volume-59904172-12f9-4def-b713-1e337844251b.12a099c6-4eaf-4850-9a69-3f1bdba53d79 {{(pid=86639) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 02 19:48:42 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[679772b3-a3d5-42be-9636-1d8170770f7b]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 19:48:42 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [req-70a8a550-60b8-4bb6-994f-de594d2c3d44 req-bb8b5aa3-ab03-4cc3-b9fa-5cbc964655cb tempest-VolumesSnapshotsTestJSON-555900694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-59904172-12f9-4def-b713-1e337844251b.12a099c6-4eaf-4850-9a69-3f1bdba53d79 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:48:43 devstack sudo[94306]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-59904172-12f9-4def-b713-1e337844251b.12a099c6-4eaf-4850-9a69-3f1bdba53d79
Jul 02 19:48:43 devstack sudo[94306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:48:43 devstack sudo[94304]: pam_unix(sudo:session): session closed for user root
Jul 02 19:48:43 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [req-4105a424-d700-417b-a673-395d6165c71d req-5a6d6922-7444-402c-934a-c498f94b6887 tempest-AttachVolumeNegativeTest-732301193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-f0d8d55a-8d45-43e2-9cfe-74c280ab466f" returned: 0 in 1.099s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:48:43 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [req-4105a424-d700-417b-a673-395d6165c71d req-5a6d6922-7444-402c-934a-c498f94b6887 tempest-AttachVolumeNegativeTest-732301193 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.131s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:48:43 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [req-4105a424-d700-417b-a673-395d6165c71d req-5a6d6922-7444-402c-934a-c498f94b6887 tempest-AttachVolumeNegativeTest-732301193 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92', 'name': 'volume-f0d8d55a-8d45-43e2-9cfe-74c280ab466f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '120e4815-eb6b-47b9-aa25-ad9d4daf4cd6', 'enforce_multipath': True} {{(pid=86639) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 02 19:48:43 devstack cinder-volume[86639]: INFO cinder.volume.manager [req-4105a424-d700-417b-a673-395d6165c71d req-5a6d6922-7444-402c-934a-c498f94b6887 tempest-AttachVolumeNegativeTest-732301193 None] attachment_update completed successfully.
Jul 02 19:48:43 devstack cinder-volume[86639]: DEBUG cinder.volume.flows.manager.create_volume [None req-1dc8d95b-fcb2-4fcc-86fa-86afbdbe04d4 tempest-VolumeTypesAccessTest-2116517082 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 19:48:43 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-1dc8d95b-fcb2-4fcc-86fa-86afbdbe04d4 tempest-VolumeTypesAccessTest-2116517082 None] Flow 'volume_create_manager' (4a24daaf-04f8-49d1-81a2-41769cb809c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 19:48:43 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-1dc8d95b-fcb2-4fcc-86fa-86afbdbe04d4 tempest-VolumeTypesAccessTest-2116517082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82d19b06-355e-4dc8-a25a-dbf953253400) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:48:43 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-1dc8d95b-fcb2-4fcc-86fa-86afbdbe04d4 tempest-VolumeTypesAccessTest-2116517082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82d19b06-355e-4dc8-a25a-dbf953253400) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T17:48:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-742264017',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ecbba3d0-efd2-4c6f-9423-c6fe5589df15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9de8e5ad9d947d7ac690e5b5434d122',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T17:48:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T17:48:44Z,use_quota=True,user_id='a4dacb7c7610418e95403cfd695ef425',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cd59358d-68c0-4852-8399-a16346229723),volume_type_id=cd59358d-68c0-4852-8399-a16346229723)' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:48:43 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-1dc8d95b-fcb2-4fcc-86fa-86afbdbe04d4 tempest-VolumeTypesAccessTest-2116517082 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62c4f267-8101-4122-bca6-d8377b2089fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:48:43 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-1dc8d95b-fcb2-4fcc-86fa-86afbdbe04d4 tempest-VolumeTypesAccessTest-2116517082 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62c4f267-8101-4122-bca6-d8377b2089fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:48:43 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-1dc8d95b-fcb2-4fcc-86fa-86afbdbe04d4 tempest-VolumeTypesAccessTest-2116517082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (964beee5-c0d4-4ff5-b298-ece3267af769) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:48:43 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-1dc8d95b-fcb2-4fcc-86fa-86afbdbe04d4 tempest-VolumeTypesAccessTest-2116517082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (964beee5-c0d4-4ff5-b298-ece3267af769) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ecbba3d0-efd2-4c6f-9423-c6fe5589df15', 'volume_name': 'volume-ecbba3d0-efd2-4c6f-9423-c6fe5589df15', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:48:43 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-1dc8d95b-fcb2-4fcc-86fa-86afbdbe04d4 tempest-VolumeTypesAccessTest-2116517082 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c3462a9-fe89-4364-b260-395cafec7d75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:48:43 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-1dc8d95b-fcb2-4fcc-86fa-86afbdbe04d4 tempest-VolumeTypesAccessTest-2116517082 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c3462a9-fe89-4364-b260-395cafec7d75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:48:43 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-1dc8d95b-fcb2-4fcc-86fa-86afbdbe04d4 tempest-VolumeTypesAccessTest-2116517082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cee2f64a-f167-4e14-b4f6-b65d288de5e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:48:43 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-1dc8d95b-fcb2-4fcc-86fa-86afbdbe04d4 tempest-VolumeTypesAccessTest-2116517082 None] Volume ecbba3d0-efd2-4c6f-9423-c6fe5589df15: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ecbba3d0-efd2-4c6f-9423-c6fe5589df15', 'volume_size': 1}
Jul 02 19:48:43 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-1dc8d95b-fcb2-4fcc-86fa-86afbdbe04d4 tempest-VolumeTypesAccessTest-2116517082 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:48:43 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-1dc8d95b-fcb2-4fcc-86fa-86afbdbe04d4 tempest-VolumeTypesAccessTest-2116517082 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:48:43 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-1dc8d95b-fcb2-4fcc-86fa-86afbdbe04d4 tempest-VolumeTypesAccessTest-2116517082 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce906cb830>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T17:48:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-742264017',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ecbba3d0-efd2-4c6f-9423-c6fe5589df15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9de8e5ad9d947d7ac690e5b5434d122',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T17:48:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T17:48:44Z,use_quota=True,user_id='a4dacb7c7610418e95403cfd695ef425',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cd59358d-68c0-4852-8399-a16346229723),volume_type_id=cd59358d-68c0-4852-8399-a16346229723)}" {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 19:48:43 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-1dc8d95b-fcb2-4fcc-86fa-86afbdbe04d4 tempest-VolumeTypesAccessTest-2116517082 None] Creating volume ecbba3d0-efd2-4c6f-9423-c6fe5589df15 {{(pid=86639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 19:48:43 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-1dc8d95b-fcb2-4fcc-86fa-86afbdbe04d4 tempest-VolumeTypesAccessTest-2116517082 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:48:43 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-1dc8d95b-fcb2-4fcc-86fa-86afbdbe04d4 tempest-VolumeTypesAccessTest-2116517082 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:48:43 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-1dc8d95b-fcb2-4fcc-86fa-86afbdbe04d4 tempest-VolumeTypesAccessTest-2116517082 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 19:48:43 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-1dc8d95b-fcb2-4fcc-86fa-86afbdbe04d4 tempest-VolumeTypesAccessTest-2116517082 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 19:48:43 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-1dc8d95b-fcb2-4fcc-86fa-86afbdbe04d4 tempest-VolumeTypesAccessTest-2116517082 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:48:43 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-1dc8d95b-fcb2-4fcc-86fa-86afbdbe04d4 tempest-VolumeTypesAccessTest-2116517082 None] Selected osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92 as target Quobyte volume. {{(pid=86639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 19:48:43 devstack cinder-volume[86639]: INFO cinder.volume.drivers.remotefs [None req-1dc8d95b-fcb2-4fcc-86fa-86afbdbe04d4 tempest-VolumeTypesAccessTest-2116517082 None] casted to osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92
Jul 02 19:48:43 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-1dc8d95b-fcb2-4fcc-86fa-86afbdbe04d4 tempest-VolumeTypesAccessTest-2116517082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-ecbba3d0-efd2-4c6f-9423-c6fe5589df15 1073741824 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:48:43 devstack sudo[94313]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-ecbba3d0-efd2-4c6f-9423-c6fe5589df15 1073741824
Jul 02 19:48:43 devstack sudo[94313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:48:44 devstack sudo[94306]: pam_unix(sudo:session): session closed for user root
Jul 02 19:48:44 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [req-70a8a550-60b8-4bb6-994f-de594d2c3d44 req-bb8b5aa3-ab03-4cc3-b9fa-5cbc964655cb tempest-VolumesSnapshotsTestJSON-555900694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-59904172-12f9-4def-b713-1e337844251b.12a099c6-4eaf-4850-9a69-3f1bdba53d79" returned: 0 in 1.237s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:48:44 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [req-70a8a550-60b8-4bb6-994f-de594d2c3d44 req-bb8b5aa3-ab03-4cc3-b9fa-5cbc964655cb tempest-VolumesSnapshotsTestJSON-555900694 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-59904172-12f9-4def-b713-1e337844251b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86639) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 02 19:48:44 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fcc70d2-6370-4a9c-a513-89c405f49c01]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 19:48:44 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [req-70a8a550-60b8-4bb6-994f-de594d2c3d44 req-bb8b5aa3-ab03-4cc3-b9fa-5cbc964655cb tempest-VolumesSnapshotsTestJSON-555900694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-59904172-12f9-4def-b713-1e337844251b {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:48:44 devstack sudo[94345]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-59904172-12f9-4def-b713-1e337844251b
Jul 02 19:48:44 devstack sudo[94345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:48:44 devstack sudo[94313]: pam_unix(sudo:session): session closed for user root
Jul 02 19:48:44 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-1dc8d95b-fcb2-4fcc-86fa-86afbdbe04d4 tempest-VolumeTypesAccessTest-2116517082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-ecbba3d0-efd2-4c6f-9423-c6fe5589df15 1073741824" returned: 0 in 1.248s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:48:45 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-1dc8d95b-fcb2-4fcc-86fa-86afbdbe04d4 tempest-VolumeTypesAccessTest-2116517082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-ecbba3d0-efd2-4c6f-9423-c6fe5589df15 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:48:45 devstack sudo[94706]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-ecbba3d0-efd2-4c6f-9423-c6fe5589df15
Jul 02 19:48:45 devstack sudo[94706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:48:45 devstack sudo[94345]: pam_unix(sudo:session): session closed for user root
Jul 02 19:48:45 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [req-70a8a550-60b8-4bb6-994f-de594d2c3d44 req-bb8b5aa3-ab03-4cc3-b9fa-5cbc964655cb tempest-VolumesSnapshotsTestJSON-555900694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-59904172-12f9-4def-b713-1e337844251b" returned: 0 in 1.246s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:48:45 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [req-70a8a550-60b8-4bb6-994f-de594d2c3d44 req-bb8b5aa3-ab03-4cc3-b9fa-5cbc964655cb tempest-VolumesSnapshotsTestJSON-555900694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-59904172-12f9-4def-b713-1e337844251b.12a099c6-4eaf-4850-9a69-3f1bdba53d79 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:48:45 devstack sudo[94711]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-59904172-12f9-4def-b713-1e337844251b.12a099c6-4eaf-4850-9a69-3f1bdba53d79
Jul 02 19:48:45 devstack sudo[94711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:48:45 devstack sudo[94706]: pam_unix(sudo:session): session closed for user root
Jul 02 19:48:45 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-1dc8d95b-fcb2-4fcc-86fa-86afbdbe04d4 tempest-VolumeTypesAccessTest-2116517082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-ecbba3d0-efd2-4c6f-9423-c6fe5589df15" returned: 0 in 0.785s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:48:45 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-1dc8d95b-fcb2-4fcc-86fa-86afbdbe04d4 tempest-VolumeTypesAccessTest-2116517082 None] <== create_volume: return (2115ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'} {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 19:48:45 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-1dc8d95b-fcb2-4fcc-86fa-86afbdbe04d4 tempest-VolumeTypesAccessTest-2116517082 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.121s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:48:45 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-1dc8d95b-fcb2-4fcc-86fa-86afbdbe04d4 tempest-VolumeTypesAccessTest-2116517082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cee2f64a-f167-4e14-b4f6-b65d288de5e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ecbba3d0-efd2-4c6f-9423-c6fe5589df15', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:48:45 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-1dc8d95b-fcb2-4fcc-86fa-86afbdbe04d4 tempest-VolumeTypesAccessTest-2116517082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fb78150-7ba8-4f58-8b44-8dfc1a47b7ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:48:45 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-1dc8d95b-fcb2-4fcc-86fa-86afbdbe04d4 tempest-VolumeTypesAccessTest-2116517082 None] Volume volume-ecbba3d0-efd2-4c6f-9423-c6fe5589df15 (ecbba3d0-efd2-4c6f-9423-c6fe5589df15): created successfully
Jul 02 19:48:45 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-1dc8d95b-fcb2-4fcc-86fa-86afbdbe04d4 tempest-VolumeTypesAccessTest-2116517082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fb78150-7ba8-4f58-8b44-8dfc1a47b7ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:48:45 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-1dc8d95b-fcb2-4fcc-86fa-86afbdbe04d4 tempest-VolumeTypesAccessTest-2116517082 None] Flow 'volume_create_manager' (4a24daaf-04f8-49d1-81a2-41769cb809c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 19:48:45 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-1dc8d95b-fcb2-4fcc-86fa-86afbdbe04d4 tempest-VolumeTypesAccessTest-2116517082 None] Created volume successfully.
Jul 02 19:48:46 devstack sudo[94711]: pam_unix(sudo:session): session closed for user root
Jul 02 19:48:46 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [req-70a8a550-60b8-4bb6-994f-de594d2c3d44 req-bb8b5aa3-ab03-4cc3-b9fa-5cbc964655cb tempest-VolumesSnapshotsTestJSON-555900694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-59904172-12f9-4def-b713-1e337844251b.12a099c6-4eaf-4850-9a69-3f1bdba53d79" returned: 0 in 0.883s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:48:46 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [req-70a8a550-60b8-4bb6-994f-de594d2c3d44 req-bb8b5aa3-ab03-4cc3-b9fa-5cbc964655cb tempest-VolumesSnapshotsTestJSON-555900694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-59904172-12f9-4def-b713-1e337844251b.12a099c6-4eaf-4850-9a69-3f1bdba53d79 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:48:46 devstack sudo[94731]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-59904172-12f9-4def-b713-1e337844251b.12a099c6-4eaf-4850-9a69-3f1bdba53d79
Jul 02 19:48:46 devstack sudo[94731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:48:46 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-fd80e8c2-c909-4a91-8f4a-3a15129b13ca tempest-VolumeTypesAccessTest-2116517082 None] Acquiring lock "cinder-ecbba3d0-efd2-4c6f-9423-c6fe5589df15-delete_volume" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:48:46 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-fd80e8c2-c909-4a91-8f4a-3a15129b13ca tempest-VolumeTypesAccessTest-2116517082 None] Lock "cinder-ecbba3d0-efd2-4c6f-9423-c6fe5589df15-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:48:46 devstack sudo[94731]: pam_unix(sudo:session): session closed for user root
Jul 02 19:48:46 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [req-70a8a550-60b8-4bb6-994f-de594d2c3d44 req-bb8b5aa3-ab03-4cc3-b9fa-5cbc964655cb tempest-VolumesSnapshotsTestJSON-555900694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-59904172-12f9-4def-b713-1e337844251b.12a099c6-4eaf-4850-9a69-3f1bdba53d79" returned: 0 in 0.660s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:48:47 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-fd80e8c2-c909-4a91-8f4a-3a15129b13ca tempest-VolumeTypesAccessTest-2116517082 None] Acquiring lock "cinder-quobyte-ecbba3d0-efd2-4c6f-9423-c6fe5589df15" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:48:47 devstack cinder-volume[86639]: DEBUG cinder.coordination [req-70a8a550-60b8-4bb6-994f-de594d2c3d44 req-bb8b5aa3-ab03-4cc3-b9fa-5cbc964655cb tempest-VolumesSnapshotsTestJSON-555900694 None] Lock "cinder-quobyte-12a099c6-4eaf-4850-9a69-3f1bdba53d79" released by "_delete_snapshot" :: held 4.203s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:48:47 devstack cinder-volume[86639]: DEBUG cinder.coordination [req-70a8a550-60b8-4bb6-994f-de594d2c3d44 req-bb8b5aa3-ab03-4cc3-b9fa-5cbc964655cb tempest-VolumesSnapshotsTestJSON-555900694 None] Lock "cinder-quobyte-59904172-12f9-4def-b713-1e337844251b" released by "delete_snapshot" :: held 4.242s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:48:47 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-fd80e8c2-c909-4a91-8f4a-3a15129b13ca tempest-VolumeTypesAccessTest-2116517082 None] Lock "cinder-quobyte-ecbba3d0-efd2-4c6f-9423-c6fe5589df15" acquired by "delete_volume" :: waited 0.025s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:48:47 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d57f3d0-53cf-40ba-85b4-22d930a43aa5]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 19:48:47 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-fd80e8c2-c909-4a91-8f4a-3a15129b13ca tempest-VolumeTypesAccessTest-2116517082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-ecbba3d0-efd2-4c6f-9423-c6fe5589df15 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:48:47 devstack cinder-volume[86639]: DEBUG cinder.quota [req-70a8a550-60b8-4bb6-994f-de594d2c3d44 req-bb8b5aa3-ab03-4cc3-b9fa-5cbc964655cb tempest-VolumesSnapshotsTestJSON-555900694 None] Created reservations ['7da0c5d9-565f-4721-a05e-8b9d7676dd3d', 'ef5943ae-95c7-4ff2-af8e-c40e41a4c50e', '28255629-1059-4367-9057-4ad56e6a54e7', 'aef8f115-e998-48aa-82d7-52ea8166df6f'] {{(pid=86639) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 19:48:47 devstack cinder-volume[86639]: INFO cinder.volume.manager [req-70a8a550-60b8-4bb6-994f-de594d2c3d44 req-bb8b5aa3-ab03-4cc3-b9fa-5cbc964655cb tempest-VolumesSnapshotsTestJSON-555900694 None] Delete snapshot completed successfully.
Jul 02 19:48:47 devstack cinder-volume[86639]: DEBUG cinder.coordination [req-70a8a550-60b8-4bb6-994f-de594d2c3d44 req-bb8b5aa3-ab03-4cc3-b9fa-5cbc964655cb tempest-VolumesSnapshotsTestJSON-555900694 None] Lock "cinder-12a099c6-4eaf-4850-9a69-3f1bdba53d79-delete_snapshot" released by "delete_snapshot" :: held 4.468s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:48:47 devstack sudo[94745]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-ecbba3d0-efd2-4c6f-9423-c6fe5589df15
Jul 02 19:48:47 devstack sudo[94745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:48:47 devstack cinder-volume[86639]: DEBUG cinder.coordination [req-383686aa-cc3d-4351-9d54-f42459eaccf7 req-c0cf82e2-fd3b-4242-8ee2-0de3f281a6b7 tempest-VolumesSnapshotsTestJSON-555900694 None] Acquiring lock "cinder-59904172-12f9-4def-b713-1e337844251b-delete_volume" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:48:47 devstack cinder-volume[86639]: DEBUG cinder.coordination [req-383686aa-cc3d-4351-9d54-f42459eaccf7 req-c0cf82e2-fd3b-4242-8ee2-0de3f281a6b7 tempest-VolumesSnapshotsTestJSON-555900694 None] Lock "cinder-59904172-12f9-4def-b713-1e337844251b-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:48:47 devstack cinder-volume[86639]: DEBUG cinder.coordination [req-383686aa-cc3d-4351-9d54-f42459eaccf7 req-c0cf82e2-fd3b-4242-8ee2-0de3f281a6b7 tempest-VolumesSnapshotsTestJSON-555900694 None] Acquiring lock "cinder-quobyte-59904172-12f9-4def-b713-1e337844251b" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:48:47 devstack cinder-volume[86639]: DEBUG cinder.coordination [req-383686aa-cc3d-4351-9d54-f42459eaccf7 req-c0cf82e2-fd3b-4242-8ee2-0de3f281a6b7 tempest-VolumesSnapshotsTestJSON-555900694 None] Lock "cinder-quobyte-59904172-12f9-4def-b713-1e337844251b" acquired by "delete_volume" :: waited 0.033s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:48:47 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[f57d4281-30ff-4970-9f09-16125b62a70f]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 19:48:47 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [req-383686aa-cc3d-4351-9d54-f42459eaccf7 req-c0cf82e2-fd3b-4242-8ee2-0de3f281a6b7 tempest-VolumesSnapshotsTestJSON-555900694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-59904172-12f9-4def-b713-1e337844251b {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:48:47 devstack sudo[94754]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-59904172-12f9-4def-b713-1e337844251b
Jul 02 19:48:47 devstack sudo[94754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:48:48 devstack sudo[94745]: pam_unix(sudo:session): session closed for user root
Jul 02 19:48:48 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-fd80e8c2-c909-4a91-8f4a-3a15129b13ca tempest-VolumeTypesAccessTest-2116517082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-ecbba3d0-efd2-4c6f-9423-c6fe5589df15" returned: 0 in 1.089s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:48:48 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-fd80e8c2-c909-4a91-8f4a-3a15129b13ca tempest-VolumeTypesAccessTest-2116517082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-ecbba3d0-efd2-4c6f-9423-c6fe5589df15 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:48:48 devstack sudo[94760]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-ecbba3d0-efd2-4c6f-9423-c6fe5589df15
Jul 02 19:48:48 devstack sudo[94760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:48:48 devstack sudo[94754]: pam_unix(sudo:session): session closed for user root
Jul 02 19:48:48 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [req-383686aa-cc3d-4351-9d54-f42459eaccf7 req-c0cf82e2-fd3b-4242-8ee2-0de3f281a6b7 tempest-VolumesSnapshotsTestJSON-555900694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-59904172-12f9-4def-b713-1e337844251b" returned: 0 in 0.914s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:48:48 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [req-383686aa-cc3d-4351-9d54-f42459eaccf7 req-c0cf82e2-fd3b-4242-8ee2-0de3f281a6b7 tempest-VolumesSnapshotsTestJSON-555900694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-59904172-12f9-4def-b713-1e337844251b {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:48:48 devstack sudo[94766]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-59904172-12f9-4def-b713-1e337844251b
Jul 02 19:48:48 devstack sudo[94766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:48:49 devstack sudo[94760]: pam_unix(sudo:session): session closed for user root
Jul 02 19:48:49 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-fd80e8c2-c909-4a91-8f4a-3a15129b13ca tempest-VolumeTypesAccessTest-2116517082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-ecbba3d0-efd2-4c6f-9423-c6fe5589df15" returned: 0 in 0.848s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:48:49 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-fd80e8c2-c909-4a91-8f4a-3a15129b13ca tempest-VolumeTypesAccessTest-2116517082 None] Lock "cinder-quobyte-ecbba3d0-efd2-4c6f-9423-c6fe5589df15" released by "delete_volume" :: held 1.993s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:48:49 devstack cinder-volume[86639]: WARNING cinder.quota [None req-fd80e8c2-c909-4a91-8f4a-3a15129b13ca tempest-VolumeTypesAccessTest-2116517082 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-282327815 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-282327815, it is now deprecated. Please use the default quota class for default quota.
Jul 02 19:48:49 devstack cinder-volume[86639]: WARNING cinder.quota [None req-fd80e8c2-c909-4a91-8f4a-3a15129b13ca tempest-VolumeTypesAccessTest-2116517082 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-282327815 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-282327815, it is now deprecated. Please use the default quota class for default quota.
Jul 02 19:48:49 devstack cinder-volume[86639]: DEBUG cinder.quota [None req-fd80e8c2-c909-4a91-8f4a-3a15129b13ca tempest-VolumeTypesAccessTest-2116517082 None] Created reservations ['4f9a2348-84f8-4522-bd88-0e976d8cfca0', '030bfd6c-d120-4065-9de0-8939cd604018', '5fd20f63-6c4b-4d4e-a074-0cd0eda9976e', '75cfb6b8-0576-46fd-8b29-06515251f0ca'] {{(pid=86639) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 19:48:49 devstack sudo[94766]: pam_unix(sudo:session): session closed for user root
Jul 02 19:48:49 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [req-383686aa-cc3d-4351-9d54-f42459eaccf7 req-c0cf82e2-fd3b-4242-8ee2-0de3f281a6b7 tempest-VolumesSnapshotsTestJSON-555900694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-59904172-12f9-4def-b713-1e337844251b" returned: 0 in 0.841s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:48:49 devstack cinder-volume[86639]: DEBUG cinder.coordination [req-383686aa-cc3d-4351-9d54-f42459eaccf7 req-c0cf82e2-fd3b-4242-8ee2-0de3f281a6b7 tempest-VolumesSnapshotsTestJSON-555900694 None] Lock "cinder-quobyte-59904172-12f9-4def-b713-1e337844251b" released by "delete_volume" :: held 1.832s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:48:49 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-fd80e8c2-c909-4a91-8f4a-3a15129b13ca tempest-VolumeTypesAccessTest-2116517082 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:48:49 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-fd80e8c2-c909-4a91-8f4a-3a15129b13ca tempest-VolumeTypesAccessTest-2116517082 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:48:49 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-fd80e8c2-c909-4a91-8f4a-3a15129b13ca tempest-VolumeTypesAccessTest-2116517082 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 19:48:49 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-fd80e8c2-c909-4a91-8f4a-3a15129b13ca tempest-VolumeTypesAccessTest-2116517082 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 19:48:49 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-fd80e8c2-c909-4a91-8f4a-3a15129b13ca tempest-VolumeTypesAccessTest-2116517082 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:48:49 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-fd80e8c2-c909-4a91-8f4a-3a15129b13ca tempest-VolumeTypesAccessTest-2116517082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:48:49 devstack sudo[94770]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e
Jul 02 19:48:49 devstack sudo[94770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:48:49 devstack cinder-volume[86639]: DEBUG cinder.quota [req-383686aa-cc3d-4351-9d54-f42459eaccf7 req-c0cf82e2-fd3b-4242-8ee2-0de3f281a6b7 tempest-VolumesSnapshotsTestJSON-555900694 None] Created reservations ['aae39aed-2dfd-4195-9da0-b08b56f297fc', 'a351a558-e011-4431-a3ce-2be244f471f4', '10cc4fb3-6333-46e7-97ab-c833df2c5923', '8a1808c6-48ae-47f3-9edc-7b0b8ec32ee7'] {{(pid=86639) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 19:48:49 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [req-383686aa-cc3d-4351-9d54-f42459eaccf7 req-c0cf82e2-fd3b-4242-8ee2-0de3f281a6b7 tempest-VolumesSnapshotsTestJSON-555900694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:48:49 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [req-383686aa-cc3d-4351-9d54-f42459eaccf7 req-c0cf82e2-fd3b-4242-8ee2-0de3f281a6b7 tempest-VolumesSnapshotsTestJSON-555900694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:48:49 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [req-383686aa-cc3d-4351-9d54-f42459eaccf7 req-c0cf82e2-fd3b-4242-8ee2-0de3f281a6b7 tempest-VolumesSnapshotsTestJSON-555900694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 19:48:49 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [req-383686aa-cc3d-4351-9d54-f42459eaccf7 req-c0cf82e2-fd3b-4242-8ee2-0de3f281a6b7 tempest-VolumesSnapshotsTestJSON-555900694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 19:48:49 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [req-383686aa-cc3d-4351-9d54-f42459eaccf7 req-c0cf82e2-fd3b-4242-8ee2-0de3f281a6b7 tempest-VolumesSnapshotsTestJSON-555900694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:48:49 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [req-383686aa-cc3d-4351-9d54-f42459eaccf7 req-c0cf82e2-fd3b-4242-8ee2-0de3f281a6b7 tempest-VolumesSnapshotsTestJSON-555900694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:48:49 devstack sudo[94772]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e
Jul 02 19:48:49 devstack sudo[94772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:48:50 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-fd80e8c2-c909-4a91-8f4a-3a15129b13ca tempest-VolumeTypesAccessTest-2116517082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e" returned: 0 in 1.107s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:48:50 devstack cinder-volume[86639]: DEBUG cinder.manager [None req-fd80e8c2-c909-4a91-8f4a-3a15129b13ca tempest-VolumeTypesAccessTest-2116517082 None] Notifying Schedulers of capabilities ... {{(pid=86639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 19:48:50 devstack sudo[94770]: pam_unix(sudo:session): session closed for user root
Jul 02 19:48:50 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-fd80e8c2-c909-4a91-8f4a-3a15129b13ca tempest-VolumeTypesAccessTest-2116517082 None] Deleted volume successfully.
Jul 02 19:48:50 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-fd80e8c2-c909-4a91-8f4a-3a15129b13ca tempest-VolumeTypesAccessTest-2116517082 None] Lock "cinder-ecbba3d0-efd2-4c6f-9423-c6fe5589df15-delete_volume" released by "delete_volume" :: held 3.536s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:48:50 devstack sudo[94772]: pam_unix(sudo:session): session closed for user root
Jul 02 19:48:50 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [req-383686aa-cc3d-4351-9d54-f42459eaccf7 req-c0cf82e2-fd3b-4242-8ee2-0de3f281a6b7 tempest-VolumesSnapshotsTestJSON-555900694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e" returned: 0 in 1.140s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:48:50 devstack cinder-volume[86639]: DEBUG cinder.manager [req-383686aa-cc3d-4351-9d54-f42459eaccf7 req-c0cf82e2-fd3b-4242-8ee2-0de3f281a6b7 tempest-VolumesSnapshotsTestJSON-555900694 None] Notifying Schedulers of capabilities ... {{(pid=86639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 19:48:50 devstack cinder-volume[86639]: INFO cinder.volume.manager [req-383686aa-cc3d-4351-9d54-f42459eaccf7 req-c0cf82e2-fd3b-4242-8ee2-0de3f281a6b7 tempest-VolumesSnapshotsTestJSON-555900694 None] Deleted volume successfully.
Jul 02 19:48:50 devstack cinder-volume[86639]: DEBUG cinder.coordination [req-383686aa-cc3d-4351-9d54-f42459eaccf7 req-c0cf82e2-fd3b-4242-8ee2-0de3f281a6b7 tempest-VolumesSnapshotsTestJSON-555900694 None] Lock "cinder-59904172-12f9-4def-b713-1e337844251b-delete_volume" released by "delete_volume" :: held 3.383s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:48:57 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-9453eb70-1154-4e3f-9854-e46e65886d42 tempest-BackendsCapabilitiesAdminTestsJSON-1942595694 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6319580078125, 'free_capacity_gb': 1775.6319580078125, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86639) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Jul 02 19:48:57 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-66d5a40d-c6d2-4b11-ba99-0b4319e0bb19 tempest-BackendsCapabilitiesAdminTestsJSON-1942595694 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6319580078125, 'free_capacity_gb': 1775.6319580078125, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86639) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Jul 02 19:48:59 devstack cinder-volume[86639]: DEBUG dbcounter [-] [86639] Writing DB stats cinder:SELECT=60,cinder:UPDATE=80,cinder:INSERT=16,cinder:DELETE=4 {{(pid=86639) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 02 19:49:00 devstack cinder-volume[86639]: DEBUG dbcounter [-] [86639] Writing DB stats cinder:SELECT=70,cinder:UPDATE=78,cinder:INSERT=23,cinder:DELETE=9 {{(pid=86639) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 02 19:49:22 devstack cinder-volume[86639]: DEBUG cinder.volume.flows.manager.create_volume [None req-85e0bfb0-085e-46b7-989b-f530947966df tempest-VolumesImageMetadata-1032207390 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 19:49:22 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-85e0bfb0-085e-46b7-989b-f530947966df tempest-VolumesImageMetadata-1032207390 None] Flow 'volume_create_manager' (ca01f073-fbef-4c38-9761-e7d9c69462f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 19:49:22 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-85e0bfb0-085e-46b7-989b-f530947966df tempest-VolumesImageMetadata-1032207390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e14adf4d-ace2-4822-9070-64f52ead1ce5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:49:22 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-85e0bfb0-085e-46b7-989b-f530947966df tempest-VolumesImageMetadata-1032207390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e14adf4d-ace2-4822-9070-64f52ead1ce5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T17:49:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-775987824',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4e80d54-7f58-4344-94fc-3f7aa4cba075,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='254ef7117acc446883ad7740a5f4138c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T17:49:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T17:49:23Z,use_quota=True,user_id='c02f602a2a2247499e10ab2395ba8a02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:49:22 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-85e0bfb0-085e-46b7-989b-f530947966df tempest-VolumesImageMetadata-1032207390 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d1594d0-0a0d-4283-bf8b-c5db800cfad8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:49:22 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-85e0bfb0-085e-46b7-989b-f530947966df tempest-VolumesImageMetadata-1032207390 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d1594d0-0a0d-4283-bf8b-c5db800cfad8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:49:22 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-85e0bfb0-085e-46b7-989b-f530947966df tempest-VolumesImageMetadata-1032207390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b033923e-c350-4fb6-b75c-55db8715e34a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:49:22 devstack cinder-volume[86639]: DEBUG cinder.image.glance [None req-85e0bfb0-085e-46b7-989b-f530947966df tempest-VolumesImageMetadata-1032207390 None] Creating Keystone auth plugin from conf {{(pid=86639) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jul 02 19:49:23 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-85e0bfb0-085e-46b7-989b-f530947966df tempest-VolumesImageMetadata-1032207390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b033923e-c350-4fb6-b75c-55db8715e34a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd4e80d54-7f58-4344-94fc-3f7aa4cba075', 'volume_name': 'volume-d4e80d54-7f58-4344-94fc-3f7aa4cba075', 'volume_size': 1, 'image_id': 'a2dc855a-b708-430d-973d-a136c6e54873', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a2dc855a-b708-430d-973d-a136c6e54873', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b6fd8f5b5bb142078118935d5734f463', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a2dc855a-b708-430d-973d-a136c6e54873', 'created_at': datetime.datetime(2026, 7, 2, 17, 34, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 2, 17, 34, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a2dc855a-b708-430d-973d-a136c6e54873/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fce8f0f6c60>}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:49:23 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-85e0bfb0-085e-46b7-989b-f530947966df tempest-VolumesImageMetadata-1032207390 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67891207-b909-4c0c-aa10-e26c84f16597) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:49:23 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-85e0bfb0-085e-46b7-989b-f530947966df tempest-VolumesImageMetadata-1032207390 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67891207-b909-4c0c-aa10-e26c84f16597) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:49:23 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-85e0bfb0-085e-46b7-989b-f530947966df tempest-VolumesImageMetadata-1032207390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52c61212-97a4-410c-bd79-e1c6a53c8456) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:49:23 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-85e0bfb0-085e-46b7-989b-f530947966df tempest-VolumesImageMetadata-1032207390 None] Volume d4e80d54-7f58-4344-94fc-3f7aa4cba075: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d4e80d54-7f58-4344-94fc-3f7aa4cba075', 'volume_size': 1, 'image_id': 'a2dc855a-b708-430d-973d-a136c6e54873', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a2dc855a-b708-430d-973d-a136c6e54873', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b6fd8f5b5bb142078118935d5734f463', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a2dc855a-b708-430d-973d-a136c6e54873', 'created_at': datetime.datetime(2026, 7, 2, 17, 34, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 2, 17, 34, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a2dc855a-b708-430d-973d-a136c6e54873/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fce8f0f6c60>}
Jul 02 19:49:23 devstack cinder-volume[86639]: DEBUG cinder.volume.flows.manager.create_volume [None req-85e0bfb0-085e-46b7-989b-f530947966df tempest-VolumesImageMetadata-1032207390 None] Trying to clone d4e80d54-7f58-4344-94fc-3f7aa4cba075 from image a2dc855a-b708-430d-973d-a136c6e54873 at location (None, [{'url': 'file:///opt/stack/data/glance/images/a2dc855a-b708-430d-973d-a136c6e54873', 'metadata': {}}]). {{(pid=86639) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jul 02 19:49:24 devstack cinder-volume[86639]: DEBUG cinder.image.image_utils [None req-85e0bfb0-085e-46b7-989b-f530947966df tempest-VolumesImageMetadata-1032207390 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_a2dc855a-b708-430d-973d-a136c6e54873_i0px64kvdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86639) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jul 02 19:49:24 devstack cinder-volume[86639]: INFO cinder.image.image_utils [None req-85e0bfb0-085e-46b7-989b-f530947966df tempest-VolumesImageMetadata-1032207390 None] Image download 20.69 MB at 20.69 MB/s
Jul 02 19:49:24 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[944ae638-0c89-4e25-b6e9-ddabb984b77e]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 19:49:24 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-85e0bfb0-085e-46b7-989b-f530947966df tempest-VolumesImageMetadata-1032207390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a2dc855a-b708-430d-973d-a136c6e54873_i0px64kvdevstack@QuobyteHD {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:49:24 devstack sudo[95065]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a2dc855a-b708-430d-973d-a136c6e54873_i0px64kvdevstack@QuobyteHD
Jul 02 19:49:24 devstack sudo[95065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:49:25 devstack sudo[95065]: pam_unix(sudo:session): session closed for user root
Jul 02 19:49:25 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-85e0bfb0-085e-46b7-989b-f530947966df tempest-VolumesImageMetadata-1032207390 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a2dc855a-b708-430d-973d-a136c6e54873_i0px64kvdevstack@QuobyteHD" returned: 0 in 0.885s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:49:25 devstack cinder-volume[86639]: DEBUG cinder.image.image_utils [None req-85e0bfb0-085e-46b7-989b-f530947966df tempest-VolumesImageMetadata-1032207390 None] Temporary image a2dc855a-b708-430d-973d-a136c6e54873 is fetched for user c02f602a2a2247499e10ab2395ba8a02. {{(pid=86639) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jul 02 19:49:25 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[97e6fb46-d685-460b-bd9e-893bd1ee66cc]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 19:49:25 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-85e0bfb0-085e-46b7-989b-f530947966df tempest-VolumesImageMetadata-1032207390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a2dc855a-b708-430d-973d-a136c6e54873_i0px64kvdevstack@QuobyteHD {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:49:25 devstack sudo[95071]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a2dc855a-b708-430d-973d-a136c6e54873_i0px64kvdevstack@QuobyteHD
Jul 02 19:49:25 devstack sudo[95071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:49:25 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-71a05231-8b54-4650-bb3a-5c42304241c4 tempest-AttachVolumeShelveTestJSON-313905155 None] Acquiring lock "cinder-1665c539-434a-4eef-8586-647abb2db7d7-delete_volume" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:49:26 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-71a05231-8b54-4650-bb3a-5c42304241c4 tempest-AttachVolumeShelveTestJSON-313905155 None] Lock "cinder-1665c539-434a-4eef-8586-647abb2db7d7-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:49:26 devstack sudo[95071]: pam_unix(sudo:session): session closed for user root
Jul 02 19:49:26 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-85e0bfb0-085e-46b7-989b-f530947966df tempest-VolumesImageMetadata-1032207390 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a2dc855a-b708-430d-973d-a136c6e54873_i0px64kvdevstack@QuobyteHD" returned: 0 in 0.827s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:49:26 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-85e0bfb0-085e-46b7-989b-f530947966df tempest-VolumesImageMetadata-1032207390 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:49:26 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-85e0bfb0-085e-46b7-989b-f530947966df tempest-VolumesImageMetadata-1032207390 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:49:26 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-85e0bfb0-085e-46b7-989b-f530947966df tempest-VolumesImageMetadata-1032207390 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce906cb830>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T17:49:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-775987824',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4e80d54-7f58-4344-94fc-3f7aa4cba075,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='254ef7117acc446883ad7740a5f4138c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T17:49:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T17:49:23Z,use_quota=True,user_id='c02f602a2a2247499e10ab2395ba8a02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)}" {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 19:49:26 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-85e0bfb0-085e-46b7-989b-f530947966df tempest-VolumesImageMetadata-1032207390 None] Creating volume d4e80d54-7f58-4344-94fc-3f7aa4cba075 {{(pid=86639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 19:49:26 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-85e0bfb0-085e-46b7-989b-f530947966df tempest-VolumesImageMetadata-1032207390 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:49:26 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-85e0bfb0-085e-46b7-989b-f530947966df tempest-VolumesImageMetadata-1032207390 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:49:26 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-85e0bfb0-085e-46b7-989b-f530947966df tempest-VolumesImageMetadata-1032207390 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 19:49:26 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-85e0bfb0-085e-46b7-989b-f530947966df tempest-VolumesImageMetadata-1032207390 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 19:49:26 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-85e0bfb0-085e-46b7-989b-f530947966df tempest-VolumesImageMetadata-1032207390 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:49:26 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-85e0bfb0-085e-46b7-989b-f530947966df tempest-VolumesImageMetadata-1032207390 None] Selected osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92 as target Quobyte volume. {{(pid=86639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 19:49:26 devstack cinder-volume[86639]: INFO cinder.volume.drivers.remotefs [None req-85e0bfb0-085e-46b7-989b-f530947966df tempest-VolumesImageMetadata-1032207390 None] casted to osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92
Jul 02 19:49:26 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-85e0bfb0-085e-46b7-989b-f530947966df tempest-VolumesImageMetadata-1032207390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-d4e80d54-7f58-4344-94fc-3f7aa4cba075 1073741824 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:49:26 devstack sudo[95076]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-d4e80d54-7f58-4344-94fc-3f7aa4cba075 1073741824
Jul 02 19:49:26 devstack sudo[95076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:49:26 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-71a05231-8b54-4650-bb3a-5c42304241c4 tempest-AttachVolumeShelveTestJSON-313905155 None] Acquiring lock "cinder-quobyte-1665c539-434a-4eef-8586-647abb2db7d7" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:49:26 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-71a05231-8b54-4650-bb3a-5c42304241c4 tempest-AttachVolumeShelveTestJSON-313905155 None] Lock "cinder-quobyte-1665c539-434a-4eef-8586-647abb2db7d7" acquired by "delete_volume" :: waited 0.022s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:49:26 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc3c6f0a-d443-46e5-91d4-7b2fb509cd24]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 19:49:26 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-71a05231-8b54-4650-bb3a-5c42304241c4 tempest-AttachVolumeShelveTestJSON-313905155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-1665c539-434a-4eef-8586-647abb2db7d7 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:49:26 devstack sudo[95078]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-1665c539-434a-4eef-8586-647abb2db7d7
Jul 02 19:49:26 devstack sudo[95078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:49:26 devstack sudo[95076]: pam_unix(sudo:session): session closed for user root
Jul 02 19:49:26 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-85e0bfb0-085e-46b7-989b-f530947966df tempest-VolumesImageMetadata-1032207390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-d4e80d54-7f58-4344-94fc-3f7aa4cba075 1073741824" returned: 0 in 0.920s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:49:26 devstack sudo[95078]: pam_unix(sudo:session): session closed for user root
Jul 02 19:49:26 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-71a05231-8b54-4650-bb3a-5c42304241c4 tempest-AttachVolumeShelveTestJSON-313905155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-1665c539-434a-4eef-8586-647abb2db7d7" returned: 0 in 0.825s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:49:26 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-71a05231-8b54-4650-bb3a-5c42304241c4 tempest-AttachVolumeShelveTestJSON-313905155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-1665c539-434a-4eef-8586-647abb2db7d7 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:49:27 devstack sudo[95086]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-1665c539-434a-4eef-8586-647abb2db7d7
Jul 02 19:49:27 devstack sudo[95086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:49:27 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-85e0bfb0-085e-46b7-989b-f530947966df tempest-VolumesImageMetadata-1032207390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-d4e80d54-7f58-4344-94fc-3f7aa4cba075 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:49:27 devstack sudo[95088]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-d4e80d54-7f58-4344-94fc-3f7aa4cba075
Jul 02 19:49:27 devstack sudo[95088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:49:27 devstack sudo[95086]: pam_unix(sudo:session): session closed for user root
Jul 02 19:49:27 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-71a05231-8b54-4650-bb3a-5c42304241c4 tempest-AttachVolumeShelveTestJSON-313905155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-1665c539-434a-4eef-8586-647abb2db7d7" returned: 0 in 0.686s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:49:27 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-71a05231-8b54-4650-bb3a-5c42304241c4 tempest-AttachVolumeShelveTestJSON-313905155 None] Lock "cinder-quobyte-1665c539-434a-4eef-8586-647abb2db7d7" released by "delete_volume" :: held 1.558s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:49:27 devstack cinder-volume[86639]: DEBUG cinder.quota [None req-71a05231-8b54-4650-bb3a-5c42304241c4 tempest-AttachVolumeShelveTestJSON-313905155 None] Created reservations ['db0452e6-031f-48b9-83dc-6bb90f0c8b83', '5509539f-628e-4b16-a362-d967f9643db1', '5a92c404-8a72-4b0c-97f8-f7743a6c34b1', 'a1354351-5db4-42e4-b07a-218505e5408e'] {{(pid=86639) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 19:49:27 devstack sudo[95088]: pam_unix(sudo:session): session closed for user root
Jul 02 19:49:27 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-85e0bfb0-085e-46b7-989b-f530947966df tempest-VolumesImageMetadata-1032207390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-d4e80d54-7f58-4344-94fc-3f7aa4cba075" returned: 0 in 0.766s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:49:27 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-85e0bfb0-085e-46b7-989b-f530947966df tempest-VolumesImageMetadata-1032207390 None] <== create_volume: return (1756ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'} {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 19:49:27 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-85e0bfb0-085e-46b7-989b-f530947966df tempest-VolumesImageMetadata-1032207390 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.761s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:49:27 devstack cinder-volume[86639]: DEBUG cinder.volume.volume_utils [None req-85e0bfb0-085e-46b7-989b-f530947966df tempest-VolumesImageMetadata-1032207390 None] Attempting download of a2dc855a-b708-430d-973d-a136c6e54873 ((None, [{'url': 'file:///opt/stack/data/glance/images/a2dc855a-b708-430d-973d-a136c6e54873', 'metadata': {}}])) to volume d4e80d54-7f58-4344-94fc-3f7aa4cba075. {{(pid=86639) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jul 02 19:49:27 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-71a05231-8b54-4650-bb3a-5c42304241c4 tempest-AttachVolumeShelveTestJSON-313905155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:49:27 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-71a05231-8b54-4650-bb3a-5c42304241c4 tempest-AttachVolumeShelveTestJSON-313905155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:49:27 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-71a05231-8b54-4650-bb3a-5c42304241c4 tempest-AttachVolumeShelveTestJSON-313905155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 19:49:27 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-71a05231-8b54-4650-bb3a-5c42304241c4 tempest-AttachVolumeShelveTestJSON-313905155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 19:49:27 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-71a05231-8b54-4650-bb3a-5c42304241c4 tempest-AttachVolumeShelveTestJSON-313905155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:49:27 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-71a05231-8b54-4650-bb3a-5c42304241c4 tempest-AttachVolumeShelveTestJSON-313905155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:49:27 devstack sudo[95092]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e
Jul 02 19:49:27 devstack sudo[95092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:49:27 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[afd037c0-2f66-45da-b07e-4cbf0e7bc48a]: (4, 'raw') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 19:49:27 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-85e0bfb0-085e-46b7-989b-f530947966df tempest-VolumesImageMetadata-1032207390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a2dc855a-b708-430d-973d-a136c6e54873_iuq_e69q {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:49:28 devstack sudo[95094]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a2dc855a-b708-430d-973d-a136c6e54873_iuq_e69q
Jul 02 19:49:28 devstack sudo[95094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:49:28 devstack sudo[95092]: pam_unix(sudo:session): session closed for user root
Jul 02 19:49:28 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-71a05231-8b54-4650-bb3a-5c42304241c4 tempest-AttachVolumeShelveTestJSON-313905155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e" returned: 0 in 0.825s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:49:28 devstack cinder-volume[86639]: DEBUG cinder.manager [None req-71a05231-8b54-4650-bb3a-5c42304241c4 tempest-AttachVolumeShelveTestJSON-313905155 None] Notifying Schedulers of capabilities ... {{(pid=86639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 19:49:28 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-71a05231-8b54-4650-bb3a-5c42304241c4 tempest-AttachVolumeShelveTestJSON-313905155 None] Deleted volume successfully.
Jul 02 19:49:28 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-71a05231-8b54-4650-bb3a-5c42304241c4 tempest-AttachVolumeShelveTestJSON-313905155 None] Lock "cinder-1665c539-434a-4eef-8586-647abb2db7d7-delete_volume" released by "delete_volume" :: held 2.744s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:49:28 devstack sudo[95094]: pam_unix(sudo:session): session closed for user root
Jul 02 19:49:28 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-85e0bfb0-085e-46b7-989b-f530947966df tempest-VolumesImageMetadata-1032207390 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a2dc855a-b708-430d-973d-a136c6e54873_iuq_e69q" returned: 0 in 0.956s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:49:28 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-85e0bfb0-085e-46b7-989b-f530947966df tempest-VolumesImageMetadata-1032207390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a2dc855a-b708-430d-973d-a136c6e54873_iuq_e69q {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:49:28 devstack sudo[95099]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a2dc855a-b708-430d-973d-a136c6e54873_iuq_e69q
Jul 02 19:49:28 devstack sudo[95099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:49:29 devstack sudo[95099]: pam_unix(sudo:session): session closed for user root
Jul 02 19:49:29 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-85e0bfb0-085e-46b7-989b-f530947966df tempest-VolumesImageMetadata-1032207390 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a2dc855a-b708-430d-973d-a136c6e54873_iuq_e69q" returned: 1 in 1.032s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:49:29 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-85e0bfb0-085e-46b7-989b-f530947966df tempest-VolumesImageMetadata-1032207390 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a2dc855a-b708-430d-973d-a136c6e54873_iuq_e69q' failed. Not Retrying. {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 02 19:49:29 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[c772f6d7-63be-4a27-b035-f11f9f724b46]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 19:49:29 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-85e0bfb0-085e-46b7-989b-f530947966df tempest-VolumesImageMetadata-1032207390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a2dc855a-b708-430d-973d-a136c6e54873_i0px64kvdevstack@QuobyteHD {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:49:30 devstack sudo[95103]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a2dc855a-b708-430d-973d-a136c6e54873_i0px64kvdevstack@QuobyteHD
Jul 02 19:49:30 devstack sudo[95103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:49:31 devstack sudo[95103]: pam_unix(sudo:session): session closed for user root
Jul 02 19:49:31 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-85e0bfb0-085e-46b7-989b-f530947966df tempest-VolumesImageMetadata-1032207390 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a2dc855a-b708-430d-973d-a136c6e54873_i0px64kvdevstack@QuobyteHD" returned: 0 in 1.189s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:49:31 devstack cinder-volume[86639]: DEBUG cinder.image.image_utils [None req-85e0bfb0-085e-46b7-989b-f530947966df tempest-VolumesImageMetadata-1032207390 None] a2dc855a-b708-430d-973d-a136c6e54873 was qcow2, converting to raw {{(pid=86639) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jul 02 19:49:31 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-85e0bfb0-085e-46b7-989b-f530947966df tempest-VolumesImageMetadata-1032207390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a2dc855a-b708-430d-973d-a136c6e54873_i0px64kvdevstack@QuobyteHD /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-d4e80d54-7f58-4344-94fc-3f7aa4cba075 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:49:31 devstack sudo[95110]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a2dc855a-b708-430d-973d-a136c6e54873_i0px64kvdevstack@QuobyteHD /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-d4e80d54-7f58-4344-94fc-3f7aa4cba075
Jul 02 19:49:31 devstack sudo[95110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:49:33 devstack sudo[95110]: pam_unix(sudo:session): session closed for user root
Jul 02 19:49:33 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-85e0bfb0-085e-46b7-989b-f530947966df tempest-VolumesImageMetadata-1032207390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a2dc855a-b708-430d-973d-a136c6e54873_i0px64kvdevstack@QuobyteHD /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-d4e80d54-7f58-4344-94fc-3f7aa4cba075" returned: 0 in 2.777s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:49:33 devstack cinder-volume[86639]: DEBUG cinder.image.image_utils [None req-85e0bfb0-085e-46b7-989b-f530947966df tempest-VolumesImageMetadata-1032207390 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_a2dc855a-b708-430d-973d-a136c6e54873_i0px64kvdevstack@QuobyteHD, size 112.00 MB, duration 2.78 sec, destination /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-d4e80d54-7f58-4344-94fc-3f7aa4cba075 {{(pid=86639) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 02 19:49:33 devstack cinder-volume[86639]: INFO cinder.image.image_utils [None req-85e0bfb0-085e-46b7-989b-f530947966df tempest-VolumesImageMetadata-1032207390 None] Converted 112.00 MB image at 40.30 MB/s
Jul 02 19:49:33 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-85e0bfb0-085e-46b7-989b-f530947966df tempest-VolumesImageMetadata-1032207390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-d4e80d54-7f58-4344-94fc-3f7aa4cba075 1G {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:49:33 devstack sudo[95156]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-d4e80d54-7f58-4344-94fc-3f7aa4cba075 1G
Jul 02 19:49:33 devstack sudo[95156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:49:34 devstack sudo[95156]: pam_unix(sudo:session): session closed for user root
Jul 02 19:49:34 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-85e0bfb0-085e-46b7-989b-f530947966df tempest-VolumesImageMetadata-1032207390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-d4e80d54-7f58-4344-94fc-3f7aa4cba075 1G" returned: 0 in 0.815s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:49:34 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c63b14e-1d50-4b29-a430-83c79b24dddf]: (4, 'raw') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 19:49:34 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-85e0bfb0-085e-46b7-989b-f530947966df tempest-VolumesImageMetadata-1032207390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-d4e80d54-7f58-4344-94fc-3f7aa4cba075 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:49:34 devstack sudo[95161]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-d4e80d54-7f58-4344-94fc-3f7aa4cba075
Jul 02 19:49:34 devstack sudo[95161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:49:35 devstack cinder-volume[86639]: DEBUG cinder.volume.flows.manager.create_volume [None req-87318194-8579-4477-a1a6-9c46ab3b64d2 tempest-VolumesServicesTestJSON-1307335350 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 19:49:35 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-87318194-8579-4477-a1a6-9c46ab3b64d2 tempest-VolumesServicesTestJSON-1307335350 None] Flow 'volume_create_manager' (51474a0f-3700-4bdc-864f-aed4ab81aa10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 19:49:35 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-87318194-8579-4477-a1a6-9c46ab3b64d2 tempest-VolumesServicesTestJSON-1307335350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6ffacf7-81b6-4b06-b3ba-475bcd3194cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:49:35 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-87318194-8579-4477-a1a6-9c46ab3b64d2 tempest-VolumesServicesTestJSON-1307335350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6ffacf7-81b6-4b06-b3ba-475bcd3194cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T17:49:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1991560814',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f6590d2-8915-4371-a93a-569fe4fd82ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7b8e499c0754e558afb2cbb1df6e801',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T17:49:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T17:49:35Z,use_quota=True,user_id='9a2b7607f19a4a1c97d623980933a6c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:49:35 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-87318194-8579-4477-a1a6-9c46ab3b64d2 tempest-VolumesServicesTestJSON-1307335350 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92538624-5aa7-4b14-b7de-b513c885f92e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:49:35 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-87318194-8579-4477-a1a6-9c46ab3b64d2 tempest-VolumesServicesTestJSON-1307335350 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92538624-5aa7-4b14-b7de-b513c885f92e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:49:35 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-87318194-8579-4477-a1a6-9c46ab3b64d2 tempest-VolumesServicesTestJSON-1307335350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8979448-fdb8-43ee-9b30-cbd0560efc15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:49:35 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-87318194-8579-4477-a1a6-9c46ab3b64d2 tempest-VolumesServicesTestJSON-1307335350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8979448-fdb8-43ee-9b30-cbd0560efc15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f6590d2-8915-4371-a93a-569fe4fd82ca', 'volume_name': 'volume-6f6590d2-8915-4371-a93a-569fe4fd82ca', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:49:35 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-87318194-8579-4477-a1a6-9c46ab3b64d2 tempest-VolumesServicesTestJSON-1307335350 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (763df5c3-0e97-429e-8fff-438b7274d520) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:49:35 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-87318194-8579-4477-a1a6-9c46ab3b64d2 tempest-VolumesServicesTestJSON-1307335350 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (763df5c3-0e97-429e-8fff-438b7274d520) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:49:35 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-87318194-8579-4477-a1a6-9c46ab3b64d2 tempest-VolumesServicesTestJSON-1307335350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4a6330f-0dbe-4a04-a81f-e1418ea858a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:49:35 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-87318194-8579-4477-a1a6-9c46ab3b64d2 tempest-VolumesServicesTestJSON-1307335350 None] Volume 6f6590d2-8915-4371-a93a-569fe4fd82ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f6590d2-8915-4371-a93a-569fe4fd82ca', 'volume_size': 1}
Jul 02 19:49:35 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-87318194-8579-4477-a1a6-9c46ab3b64d2 tempest-VolumesServicesTestJSON-1307335350 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:49:35 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-87318194-8579-4477-a1a6-9c46ab3b64d2 tempest-VolumesServicesTestJSON-1307335350 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:49:35 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-87318194-8579-4477-a1a6-9c46ab3b64d2 tempest-VolumesServicesTestJSON-1307335350 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce906cb830>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T17:49:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1991560814',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f6590d2-8915-4371-a93a-569fe4fd82ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7b8e499c0754e558afb2cbb1df6e801',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T17:49:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T17:49:35Z,use_quota=True,user_id='9a2b7607f19a4a1c97d623980933a6c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)}" {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 19:49:35 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-87318194-8579-4477-a1a6-9c46ab3b64d2 tempest-VolumesServicesTestJSON-1307335350 None] Creating volume 6f6590d2-8915-4371-a93a-569fe4fd82ca {{(pid=86639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 19:49:35 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-87318194-8579-4477-a1a6-9c46ab3b64d2 tempest-VolumesServicesTestJSON-1307335350 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:49:35 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-87318194-8579-4477-a1a6-9c46ab3b64d2 tempest-VolumesServicesTestJSON-1307335350 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:49:35 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-87318194-8579-4477-a1a6-9c46ab3b64d2 tempest-VolumesServicesTestJSON-1307335350 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 19:49:35 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-87318194-8579-4477-a1a6-9c46ab3b64d2 tempest-VolumesServicesTestJSON-1307335350 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 19:49:35 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-87318194-8579-4477-a1a6-9c46ab3b64d2 tempest-VolumesServicesTestJSON-1307335350 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:49:35 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-87318194-8579-4477-a1a6-9c46ab3b64d2 tempest-VolumesServicesTestJSON-1307335350 None] Selected osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92 as target Quobyte volume. {{(pid=86639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 19:49:35 devstack cinder-volume[86639]: INFO cinder.volume.drivers.remotefs [None req-87318194-8579-4477-a1a6-9c46ab3b64d2 tempest-VolumesServicesTestJSON-1307335350 None] casted to osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92
Jul 02 19:49:35 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-87318194-8579-4477-a1a6-9c46ab3b64d2 tempest-VolumesServicesTestJSON-1307335350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-6f6590d2-8915-4371-a93a-569fe4fd82ca 1073741824 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:49:35 devstack sudo[95163]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-6f6590d2-8915-4371-a93a-569fe4fd82ca 1073741824
Jul 02 19:49:35 devstack sudo[95163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:49:35 devstack sudo[95161]: pam_unix(sudo:session): session closed for user root
Jul 02 19:49:35 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-85e0bfb0-085e-46b7-989b-f530947966df tempest-VolumesImageMetadata-1032207390 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-d4e80d54-7f58-4344-94fc-3f7aa4cba075" returned: 0 in 0.836s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:49:35 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-85e0bfb0-085e-46b7-989b-f530947966df tempest-VolumesImageMetadata-1032207390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-d4e80d54-7f58-4344-94fc-3f7aa4cba075 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:49:35 devstack sudo[95167]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-d4e80d54-7f58-4344-94fc-3f7aa4cba075
Jul 02 19:49:35 devstack sudo[95167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:49:36 devstack sudo[95163]: pam_unix(sudo:session): session closed for user root
Jul 02 19:49:36 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-87318194-8579-4477-a1a6-9c46ab3b64d2 tempest-VolumesServicesTestJSON-1307335350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-6f6590d2-8915-4371-a93a-569fe4fd82ca 1073741824" returned: 0 in 0.996s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:49:36 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-87318194-8579-4477-a1a6-9c46ab3b64d2 tempest-VolumesServicesTestJSON-1307335350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-6f6590d2-8915-4371-a93a-569fe4fd82ca {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:49:36 devstack sudo[95179]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-6f6590d2-8915-4371-a93a-569fe4fd82ca
Jul 02 19:49:36 devstack sudo[95179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:49:36 devstack sudo[95167]: pam_unix(sudo:session): session closed for user root
Jul 02 19:49:36 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-85e0bfb0-085e-46b7-989b-f530947966df tempest-VolumesImageMetadata-1032207390 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-d4e80d54-7f58-4344-94fc-3f7aa4cba075" returned: 1 in 0.970s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:49:36 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-85e0bfb0-085e-46b7-989b-f530947966df tempest-VolumesImageMetadata-1032207390 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-d4e80d54-7f58-4344-94fc-3f7aa4cba075' failed. Not Retrying. {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 02 19:49:36 devstack cinder-volume[86639]: DEBUG cinder.volume.volume_utils [None req-85e0bfb0-085e-46b7-989b-f530947966df tempest-VolumesImageMetadata-1032207390 None] Downloaded image a2dc855a-b708-430d-973d-a136c6e54873 ((None, [{'url': 'file:///opt/stack/data/glance/images/a2dc855a-b708-430d-973d-a136c6e54873', 'metadata': {}}])) to volume d4e80d54-7f58-4344-94fc-3f7aa4cba075 successfully. {{(pid=86639) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jul 02 19:49:36 devstack cinder-volume[86639]: DEBUG cinder.image.image_utils [None req-85e0bfb0-085e-46b7-989b-f530947966df tempest-VolumesImageMetadata-1032207390 None] Temporary image a2dc855a-b708-430d-973d-a136c6e54873 for user c02f602a2a2247499e10ab2395ba8a02 is deleted. {{(pid=86639) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jul 02 19:49:36 devstack cinder-volume[86639]: DEBUG cinder.volume.volume_utils [None req-85e0bfb0-085e-46b7-989b-f530947966df tempest-VolumesImageMetadata-1032207390 None] Marking volume d4e80d54-7f58-4344-94fc-3f7aa4cba075 as bootable. {{(pid=86639) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jul 02 19:49:36 devstack cinder-volume[86639]: DEBUG cinder.volume.flows.manager.create_volume [None req-85e0bfb0-085e-46b7-989b-f530947966df tempest-VolumesImageMetadata-1032207390 None] Copying metadata from image a2dc855a-b708-430d-973d-a136c6e54873 to d4e80d54-7f58-4344-94fc-3f7aa4cba075. {{(pid=86639) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jul 02 19:49:36 devstack cinder-volume[86639]: DEBUG cinder.volume.flows.manager.create_volume [None req-85e0bfb0-085e-46b7-989b-f530947966df tempest-VolumesImageMetadata-1032207390 None] Creating volume glance metadata for volume d4e80d54-7f58-4344-94fc-3f7aa4cba075 backed by image a2dc855a-b708-430d-973d-a136c6e54873 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'a2dc855a-b708-430d-973d-a136c6e54873', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86639) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jul 02 19:49:36 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-85e0bfb0-085e-46b7-989b-f530947966df tempest-VolumesImageMetadata-1032207390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52c61212-97a4-410c-bd79-e1c6a53c8456) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4e80d54-7f58-4344-94fc-3f7aa4cba075', 'volume_size': 1, 'image_id': 'a2dc855a-b708-430d-973d-a136c6e54873', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a2dc855a-b708-430d-973d-a136c6e54873', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b6fd8f5b5bb142078118935d5734f463', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a2dc855a-b708-430d-973d-a136c6e54873', 'created_at': datetime.datetime(2026, 7, 2, 17, 34, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 2, 17, 34, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a2dc855a-b708-430d-973d-a136c6e54873/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fce8f0f6c60>}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:49:36 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-85e0bfb0-085e-46b7-989b-f530947966df tempest-VolumesImageMetadata-1032207390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9add353-ace2-45c4-b948-7e127ea83861) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:49:36 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-85e0bfb0-085e-46b7-989b-f530947966df tempest-VolumesImageMetadata-1032207390 None] Volume volume-d4e80d54-7f58-4344-94fc-3f7aa4cba075 (d4e80d54-7f58-4344-94fc-3f7aa4cba075): created successfully
Jul 02 19:49:36 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-85e0bfb0-085e-46b7-989b-f530947966df tempest-VolumesImageMetadata-1032207390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9add353-ace2-45c4-b948-7e127ea83861) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:49:36 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-85e0bfb0-085e-46b7-989b-f530947966df tempest-VolumesImageMetadata-1032207390 None] Flow 'volume_create_manager' (ca01f073-fbef-4c38-9761-e7d9c69462f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 19:49:36 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-85e0bfb0-085e-46b7-989b-f530947966df tempest-VolumesImageMetadata-1032207390 None] Created volume successfully.
Jul 02 19:49:37 devstack sudo[95179]: pam_unix(sudo:session): session closed for user root
Jul 02 19:49:37 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-87318194-8579-4477-a1a6-9c46ab3b64d2 tempest-VolumesServicesTestJSON-1307335350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-6f6590d2-8915-4371-a93a-569fe4fd82ca" returned: 0 in 0.706s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:49:37 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-87318194-8579-4477-a1a6-9c46ab3b64d2 tempest-VolumesServicesTestJSON-1307335350 None] <== create_volume: return (1752ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'} {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 19:49:37 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-87318194-8579-4477-a1a6-9c46ab3b64d2 tempest-VolumesServicesTestJSON-1307335350 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.755s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:49:37 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-87318194-8579-4477-a1a6-9c46ab3b64d2 tempest-VolumesServicesTestJSON-1307335350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4a6330f-0dbe-4a04-a81f-e1418ea858a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f6590d2-8915-4371-a93a-569fe4fd82ca', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:49:37 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-87318194-8579-4477-a1a6-9c46ab3b64d2 tempest-VolumesServicesTestJSON-1307335350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a0d64b7-934c-4aa7-9590-e5ca28f496b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:49:37 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-87318194-8579-4477-a1a6-9c46ab3b64d2 tempest-VolumesServicesTestJSON-1307335350 None] Volume volume-6f6590d2-8915-4371-a93a-569fe4fd82ca (6f6590d2-8915-4371-a93a-569fe4fd82ca): created successfully
Jul 02 19:49:37 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-87318194-8579-4477-a1a6-9c46ab3b64d2 tempest-VolumesServicesTestJSON-1307335350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a0d64b7-934c-4aa7-9590-e5ca28f496b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:49:37 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-87318194-8579-4477-a1a6-9c46ab3b64d2 tempest-VolumesServicesTestJSON-1307335350 None] Flow 'volume_create_manager' (51474a0f-3700-4bdc-864f-aed4ab81aa10) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 19:49:37 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-87318194-8579-4477-a1a6-9c46ab3b64d2 tempest-VolumesServicesTestJSON-1307335350 None] Created volume successfully.
Jul 02 19:49:37 devstack cinder-volume[86639]: DEBUG cinder.volume.flows.manager.create_volume [req-42f35c21-1924-4d6a-ba7f-e850682d1dab req-5e7f7096-b4f9-4e02-863f-f05d0d06e0ae tempest-VolumesGetTestJSON-1609074872 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 19:49:37 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [req-42f35c21-1924-4d6a-ba7f-e850682d1dab req-5e7f7096-b4f9-4e02-863f-f05d0d06e0ae tempest-VolumesGetTestJSON-1609074872 None] Flow 'volume_create_manager' (e80133d3-77f9-4006-bbc8-415a92f09089) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 19:49:37 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [req-42f35c21-1924-4d6a-ba7f-e850682d1dab req-5e7f7096-b4f9-4e02-863f-f05d0d06e0ae tempest-VolumesGetTestJSON-1609074872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52565312-af35-4c3b-9124-e042685742cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:49:37 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-fbda41d5-136e-499a-b3f4-a3a0dc8e6d31 tempest-VolumesServicesTestJSON-1307335350 None] Acquiring lock "cinder-6f6590d2-8915-4371-a93a-569fe4fd82ca-delete_volume" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:49:38 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [req-42f35c21-1924-4d6a-ba7f-e850682d1dab req-5e7f7096-b4f9-4e02-863f-f05d0d06e0ae tempest-VolumesGetTestJSON-1609074872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52565312-af35-4c3b-9124-e042685742cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T17:49:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1964882320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b17b744a-ef0c-4291-b902-192d0cca57e1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c87be6c788eb460d8981e49aadb07496',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T17:49:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T17:49:38Z,use_quota=True,user_id='3831c076590044f3a17f7e7eb793f1a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:49:38 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [req-42f35c21-1924-4d6a-ba7f-e850682d1dab req-5e7f7096-b4f9-4e02-863f-f05d0d06e0ae tempest-VolumesGetTestJSON-1609074872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5add19e5-452a-4689-9f8f-a5da33fa2ac7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:49:38 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [req-42f35c21-1924-4d6a-ba7f-e850682d1dab req-5e7f7096-b4f9-4e02-863f-f05d0d06e0ae tempest-VolumesGetTestJSON-1609074872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5add19e5-452a-4689-9f8f-a5da33fa2ac7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:49:38 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [req-42f35c21-1924-4d6a-ba7f-e850682d1dab req-5e7f7096-b4f9-4e02-863f-f05d0d06e0ae tempest-VolumesGetTestJSON-1609074872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d020a2d5-26b7-484e-9be0-bc7ad090251b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:49:38 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [req-42f35c21-1924-4d6a-ba7f-e850682d1dab req-5e7f7096-b4f9-4e02-863f-f05d0d06e0ae tempest-VolumesGetTestJSON-1609074872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d020a2d5-26b7-484e-9be0-bc7ad090251b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b17b744a-ef0c-4291-b902-192d0cca57e1', 'volume_name': 'volume-b17b744a-ef0c-4291-b902-192d0cca57e1', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:49:38 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [req-42f35c21-1924-4d6a-ba7f-e850682d1dab req-5e7f7096-b4f9-4e02-863f-f05d0d06e0ae tempest-VolumesGetTestJSON-1609074872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a42f0d70-ccd0-4668-ac3e-cd359fd57cf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:49:38 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [req-42f35c21-1924-4d6a-ba7f-e850682d1dab req-5e7f7096-b4f9-4e02-863f-f05d0d06e0ae tempest-VolumesGetTestJSON-1609074872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a42f0d70-ccd0-4668-ac3e-cd359fd57cf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:49:38 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [req-42f35c21-1924-4d6a-ba7f-e850682d1dab req-5e7f7096-b4f9-4e02-863f-f05d0d06e0ae tempest-VolumesGetTestJSON-1609074872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec59a495-f860-4d48-a591-484c22bfcf73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:49:38 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [req-42f35c21-1924-4d6a-ba7f-e850682d1dab req-5e7f7096-b4f9-4e02-863f-f05d0d06e0ae tempest-VolumesGetTestJSON-1609074872 None] Volume b17b744a-ef0c-4291-b902-192d0cca57e1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b17b744a-ef0c-4291-b902-192d0cca57e1', 'volume_size': 1}
Jul 02 19:49:38 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [req-42f35c21-1924-4d6a-ba7f-e850682d1dab req-5e7f7096-b4f9-4e02-863f-f05d0d06e0ae tempest-VolumesGetTestJSON-1609074872 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:49:38 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [req-42f35c21-1924-4d6a-ba7f-e850682d1dab req-5e7f7096-b4f9-4e02-863f-f05d0d06e0ae tempest-VolumesGetTestJSON-1609074872 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:49:38 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [req-42f35c21-1924-4d6a-ba7f-e850682d1dab req-5e7f7096-b4f9-4e02-863f-f05d0d06e0ae tempest-VolumesGetTestJSON-1609074872 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce906cb830>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T17:49:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1964882320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b17b744a-ef0c-4291-b902-192d0cca57e1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c87be6c788eb460d8981e49aadb07496',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T17:49:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T17:49:38Z,use_quota=True,user_id='3831c076590044f3a17f7e7eb793f1a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)}" {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 19:49:38 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [req-42f35c21-1924-4d6a-ba7f-e850682d1dab req-5e7f7096-b4f9-4e02-863f-f05d0d06e0ae tempest-VolumesGetTestJSON-1609074872 None] Creating volume b17b744a-ef0c-4291-b902-192d0cca57e1 {{(pid=86639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 19:49:38 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [req-42f35c21-1924-4d6a-ba7f-e850682d1dab req-5e7f7096-b4f9-4e02-863f-f05d0d06e0ae tempest-VolumesGetTestJSON-1609074872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:49:38 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [req-42f35c21-1924-4d6a-ba7f-e850682d1dab req-5e7f7096-b4f9-4e02-863f-f05d0d06e0ae tempest-VolumesGetTestJSON-1609074872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:49:38 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [req-42f35c21-1924-4d6a-ba7f-e850682d1dab req-5e7f7096-b4f9-4e02-863f-f05d0d06e0ae tempest-VolumesGetTestJSON-1609074872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 19:49:38 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [req-42f35c21-1924-4d6a-ba7f-e850682d1dab req-5e7f7096-b4f9-4e02-863f-f05d0d06e0ae tempest-VolumesGetTestJSON-1609074872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 19:49:38 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [req-42f35c21-1924-4d6a-ba7f-e850682d1dab req-5e7f7096-b4f9-4e02-863f-f05d0d06e0ae tempest-VolumesGetTestJSON-1609074872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:49:38 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [req-42f35c21-1924-4d6a-ba7f-e850682d1dab req-5e7f7096-b4f9-4e02-863f-f05d0d06e0ae tempest-VolumesGetTestJSON-1609074872 None] Selected osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92 as target Quobyte volume. {{(pid=86639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 19:49:38 devstack cinder-volume[86639]: INFO cinder.volume.drivers.remotefs [req-42f35c21-1924-4d6a-ba7f-e850682d1dab req-5e7f7096-b4f9-4e02-863f-f05d0d06e0ae tempest-VolumesGetTestJSON-1609074872 None] casted to osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92
Jul 02 19:49:38 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [req-42f35c21-1924-4d6a-ba7f-e850682d1dab req-5e7f7096-b4f9-4e02-863f-f05d0d06e0ae tempest-VolumesGetTestJSON-1609074872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-b17b744a-ef0c-4291-b902-192d0cca57e1 1073741824 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:49:38 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-fbda41d5-136e-499a-b3f4-a3a0dc8e6d31 tempest-VolumesServicesTestJSON-1307335350 None] Lock "cinder-6f6590d2-8915-4371-a93a-569fe4fd82ca-delete_volume" acquired by "delete_volume" :: waited 0.126s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:49:38 devstack sudo[95219]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-b17b744a-ef0c-4291-b902-192d0cca57e1 1073741824
Jul 02 19:49:38 devstack sudo[95219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:49:38 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-fbda41d5-136e-499a-b3f4-a3a0dc8e6d31 tempest-VolumesServicesTestJSON-1307335350 None] Acquiring lock "cinder-quobyte-6f6590d2-8915-4371-a93a-569fe4fd82ca" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:49:38 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-2890c0e8-39d0-4d4a-82f2-6e29dfb2c03d tempest-VolumesImageMetadata-1032207390 None] Acquiring lock "cinder-d4e80d54-7f58-4344-94fc-3f7aa4cba075-delete_volume" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:49:38 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-fbda41d5-136e-499a-b3f4-a3a0dc8e6d31 tempest-VolumesServicesTestJSON-1307335350 None] Lock "cinder-quobyte-6f6590d2-8915-4371-a93a-569fe4fd82ca" acquired by "delete_volume" :: waited 0.036s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:49:38 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-2890c0e8-39d0-4d4a-82f2-6e29dfb2c03d tempest-VolumesImageMetadata-1032207390 None] Lock "cinder-d4e80d54-7f58-4344-94fc-3f7aa4cba075-delete_volume" acquired by "delete_volume" :: waited 0.089s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:49:38 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bec649a-3b3b-4f4d-a3d7-c9b0e54f4409]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 19:49:38 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-fbda41d5-136e-499a-b3f4-a3a0dc8e6d31 tempest-VolumesServicesTestJSON-1307335350 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-6f6590d2-8915-4371-a93a-569fe4fd82ca {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:49:38 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-2890c0e8-39d0-4d4a-82f2-6e29dfb2c03d tempest-VolumesImageMetadata-1032207390 None] Acquiring lock "cinder-quobyte-d4e80d54-7f58-4344-94fc-3f7aa4cba075" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:49:38 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-2890c0e8-39d0-4d4a-82f2-6e29dfb2c03d tempest-VolumesImageMetadata-1032207390 None] Lock "cinder-quobyte-d4e80d54-7f58-4344-94fc-3f7aa4cba075" acquired by "delete_volume" :: waited 0.018s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:49:38 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[de0a0f83-9789-47ac-bf07-e6e84dba36be]: (4, 'raw') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 19:49:38 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-2890c0e8-39d0-4d4a-82f2-6e29dfb2c03d tempest-VolumesImageMetadata-1032207390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-d4e80d54-7f58-4344-94fc-3f7aa4cba075 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:49:38 devstack sudo[95226]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-6f6590d2-8915-4371-a93a-569fe4fd82ca
Jul 02 19:49:38 devstack sudo[95226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:49:38 devstack sudo[95232]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-d4e80d54-7f58-4344-94fc-3f7aa4cba075
Jul 02 19:49:38 devstack sudo[95232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:49:39 devstack sudo[95226]: pam_unix(sudo:session): session closed for user root
Jul 02 19:49:39 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-fbda41d5-136e-499a-b3f4-a3a0dc8e6d31 tempest-VolumesServicesTestJSON-1307335350 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-6f6590d2-8915-4371-a93a-569fe4fd82ca" returned: 0 in 1.128s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:49:39 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-fbda41d5-136e-499a-b3f4-a3a0dc8e6d31 tempest-VolumesServicesTestJSON-1307335350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-6f6590d2-8915-4371-a93a-569fe4fd82ca {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:49:39 devstack sudo[95250]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-6f6590d2-8915-4371-a93a-569fe4fd82ca
Jul 02 19:49:39 devstack sudo[95250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:49:39 devstack sudo[95232]: pam_unix(sudo:session): session closed for user root
Jul 02 19:49:39 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-2890c0e8-39d0-4d4a-82f2-6e29dfb2c03d tempest-VolumesImageMetadata-1032207390 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-d4e80d54-7f58-4344-94fc-3f7aa4cba075" returned: 0 in 1.058s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:49:39 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-2890c0e8-39d0-4d4a-82f2-6e29dfb2c03d tempest-VolumesImageMetadata-1032207390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-d4e80d54-7f58-4344-94fc-3f7aa4cba075 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:49:39 devstack sudo[95219]: pam_unix(sudo:session): session closed for user root
Jul 02 19:49:39 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [req-42f35c21-1924-4d6a-ba7f-e850682d1dab req-5e7f7096-b4f9-4e02-863f-f05d0d06e0ae tempest-VolumesGetTestJSON-1609074872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-b17b744a-ef0c-4291-b902-192d0cca57e1 1073741824" returned: 0 in 1.497s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:49:39 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [req-42f35c21-1924-4d6a-ba7f-e850682d1dab req-5e7f7096-b4f9-4e02-863f-f05d0d06e0ae tempest-VolumesGetTestJSON-1609074872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-b17b744a-ef0c-4291-b902-192d0cca57e1 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:49:39 devstack sudo[95253]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-b17b744a-ef0c-4291-b902-192d0cca57e1
Jul 02 19:49:39 devstack sudo[95253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:49:39 devstack sudo[95252]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-d4e80d54-7f58-4344-94fc-3f7aa4cba075
Jul 02 19:49:39 devstack sudo[95252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:49:40 devstack sudo[95252]: pam_unix(sudo:session): session closed for user root
Jul 02 19:49:40 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-2890c0e8-39d0-4d4a-82f2-6e29dfb2c03d tempest-VolumesImageMetadata-1032207390 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-d4e80d54-7f58-4344-94fc-3f7aa4cba075" returned: 1 in 1.087s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:49:40 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-2890c0e8-39d0-4d4a-82f2-6e29dfb2c03d tempest-VolumesImageMetadata-1032207390 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-d4e80d54-7f58-4344-94fc-3f7aa4cba075' failed. Not Retrying. {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 02 19:49:40 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-2890c0e8-39d0-4d4a-82f2-6e29dfb2c03d tempest-VolumesImageMetadata-1032207390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-d4e80d54-7f58-4344-94fc-3f7aa4cba075 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:49:40 devstack sudo[95250]: pam_unix(sudo:session): session closed for user root
Jul 02 19:49:40 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-fbda41d5-136e-499a-b3f4-a3a0dc8e6d31 tempest-VolumesServicesTestJSON-1307335350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-6f6590d2-8915-4371-a93a-569fe4fd82ca" returned: 0 in 1.190s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:49:40 devstack sudo[95265]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-d4e80d54-7f58-4344-94fc-3f7aa4cba075
Jul 02 19:49:40 devstack sudo[95265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:49:40 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-fbda41d5-136e-499a-b3f4-a3a0dc8e6d31 tempest-VolumesServicesTestJSON-1307335350 None] Lock "cinder-quobyte-6f6590d2-8915-4371-a93a-569fe4fd82ca" released by "delete_volume" :: held 2.432s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:49:40 devstack sudo[95253]: pam_unix(sudo:session): session closed for user root
Jul 02 19:49:40 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [req-42f35c21-1924-4d6a-ba7f-e850682d1dab req-5e7f7096-b4f9-4e02-863f-f05d0d06e0ae tempest-VolumesGetTestJSON-1609074872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-b17b744a-ef0c-4291-b902-192d0cca57e1" returned: 0 in 1.057s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:49:40 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [req-42f35c21-1924-4d6a-ba7f-e850682d1dab req-5e7f7096-b4f9-4e02-863f-f05d0d06e0ae tempest-VolumesGetTestJSON-1609074872 None] <== create_volume: return (2629ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'} {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 19:49:40 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [req-42f35c21-1924-4d6a-ba7f-e850682d1dab req-5e7f7096-b4f9-4e02-863f-f05d0d06e0ae tempest-VolumesGetTestJSON-1609074872 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.632s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:49:40 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [req-42f35c21-1924-4d6a-ba7f-e850682d1dab req-5e7f7096-b4f9-4e02-863f-f05d0d06e0ae tempest-VolumesGetTestJSON-1609074872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec59a495-f860-4d48-a591-484c22bfcf73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b17b744a-ef0c-4291-b902-192d0cca57e1', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:49:40 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [req-42f35c21-1924-4d6a-ba7f-e850682d1dab req-5e7f7096-b4f9-4e02-863f-f05d0d06e0ae tempest-VolumesGetTestJSON-1609074872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c80fe15d-7f85-410a-9e76-aa2b44fc3f2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:49:40 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [req-42f35c21-1924-4d6a-ba7f-e850682d1dab req-5e7f7096-b4f9-4e02-863f-f05d0d06e0ae tempest-VolumesGetTestJSON-1609074872 None] Volume volume-b17b744a-ef0c-4291-b902-192d0cca57e1 (b17b744a-ef0c-4291-b902-192d0cca57e1): created successfully
Jul 02 19:49:40 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [req-42f35c21-1924-4d6a-ba7f-e850682d1dab req-5e7f7096-b4f9-4e02-863f-f05d0d06e0ae tempest-VolumesGetTestJSON-1609074872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c80fe15d-7f85-410a-9e76-aa2b44fc3f2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:49:40 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [req-42f35c21-1924-4d6a-ba7f-e850682d1dab req-5e7f7096-b4f9-4e02-863f-f05d0d06e0ae tempest-VolumesGetTestJSON-1609074872 None] Flow 'volume_create_manager' (e80133d3-77f9-4006-bbc8-415a92f09089) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 19:49:40 devstack cinder-volume[86639]: INFO cinder.volume.manager [req-42f35c21-1924-4d6a-ba7f-e850682d1dab req-5e7f7096-b4f9-4e02-863f-f05d0d06e0ae tempest-VolumesGetTestJSON-1609074872 None] Created volume successfully.
Jul 02 19:49:40 devstack cinder-volume[86639]: DEBUG cinder.quota [None req-fbda41d5-136e-499a-b3f4-a3a0dc8e6d31 tempest-VolumesServicesTestJSON-1307335350 None] Created reservations ['b67a22ed-65ed-4215-b832-ef559aed73a8', 'b0f23320-8a32-4514-b07b-ac963dc5e793', 'fab59caa-811d-4e58-aa7b-7e82e5e93651', '2e5bbf0d-2a64-4cd2-9ed8-c0d171330d03'] {{(pid=86639) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 19:49:40 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-fbda41d5-136e-499a-b3f4-a3a0dc8e6d31 tempest-VolumesServicesTestJSON-1307335350 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:49:40 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-fbda41d5-136e-499a-b3f4-a3a0dc8e6d31 tempest-VolumesServicesTestJSON-1307335350 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:49:40 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-fbda41d5-136e-499a-b3f4-a3a0dc8e6d31 tempest-VolumesServicesTestJSON-1307335350 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 19:49:40 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-fbda41d5-136e-499a-b3f4-a3a0dc8e6d31 tempest-VolumesServicesTestJSON-1307335350 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 19:49:40 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-fbda41d5-136e-499a-b3f4-a3a0dc8e6d31 tempest-VolumesServicesTestJSON-1307335350 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:49:40 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-fbda41d5-136e-499a-b3f4-a3a0dc8e6d31 tempest-VolumesServicesTestJSON-1307335350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:49:40 devstack sudo[95267]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e
Jul 02 19:49:40 devstack sudo[95267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:49:41 devstack cinder-volume[86639]: DEBUG cinder.coordination [req-8639c07a-5244-49f2-bf31-c3c7a365b142 req-da573147-30ad-4a23-afda-cb6c340bf77f tempest-VolumesGetTestJSON-1609074872 None] Acquiring lock "cinder-b17b744a-ef0c-4291-b902-192d0cca57e1-delete_volume" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:49:41 devstack sudo[95265]: pam_unix(sudo:session): session closed for user root
Jul 02 19:49:41 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-2890c0e8-39d0-4d4a-82f2-6e29dfb2c03d tempest-VolumesImageMetadata-1032207390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-d4e80d54-7f58-4344-94fc-3f7aa4cba075" returned: 0 in 0.787s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:49:41 devstack cinder-volume[86639]: DEBUG cinder.coordination [req-8639c07a-5244-49f2-bf31-c3c7a365b142 req-da573147-30ad-4a23-afda-cb6c340bf77f tempest-VolumesGetTestJSON-1609074872 None] Lock "cinder-b17b744a-ef0c-4291-b902-192d0cca57e1-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:49:41 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-2890c0e8-39d0-4d4a-82f2-6e29dfb2c03d tempest-VolumesImageMetadata-1032207390 None] Lock "cinder-quobyte-d4e80d54-7f58-4344-94fc-3f7aa4cba075" released by "delete_volume" :: held 3.060s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:49:41 devstack cinder-volume[86639]: DEBUG oslo_service.periodic_task [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86639) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 02 19:49:41 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:49:41 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:49:41 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 19:49:41 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 19:49:41 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:49:41 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:49:41 devstack sudo[95271]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e
Jul 02 19:49:41 devstack sudo[95271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:49:41 devstack cinder-volume[86639]: DEBUG cinder.coordination [req-8639c07a-5244-49f2-bf31-c3c7a365b142 req-da573147-30ad-4a23-afda-cb6c340bf77f tempest-VolumesGetTestJSON-1609074872 None] Acquiring lock "cinder-quobyte-b17b744a-ef0c-4291-b902-192d0cca57e1" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:49:41 devstack sudo[95267]: pam_unix(sudo:session): session closed for user root
Jul 02 19:49:41 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-fbda41d5-136e-499a-b3f4-a3a0dc8e6d31 tempest-VolumesServicesTestJSON-1307335350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e" returned: 0 in 0.767s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:49:41 devstack cinder-volume[86639]: DEBUG cinder.manager [None req-fbda41d5-136e-499a-b3f4-a3a0dc8e6d31 tempest-VolumesServicesTestJSON-1307335350 None] Notifying Schedulers of capabilities ... {{(pid=86639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 19:49:41 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-fbda41d5-136e-499a-b3f4-a3a0dc8e6d31 tempest-VolumesServicesTestJSON-1307335350 None] Deleted volume successfully.
Jul 02 19:49:41 devstack cinder-volume[86639]: DEBUG cinder.coordination [req-8639c07a-5244-49f2-bf31-c3c7a365b142 req-da573147-30ad-4a23-afda-cb6c340bf77f tempest-VolumesGetTestJSON-1609074872 None] Lock "cinder-quobyte-b17b744a-ef0c-4291-b902-192d0cca57e1" acquired by "delete_volume" :: waited 0.042s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:49:41 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-fbda41d5-136e-499a-b3f4-a3a0dc8e6d31 tempest-VolumesServicesTestJSON-1307335350 None] Lock "cinder-6f6590d2-8915-4371-a93a-569fe4fd82ca-delete_volume" released by "delete_volume" :: held 3.567s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:49:41 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[f73762ac-9f47-4af4-8fb2-2bf362fed708]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 19:49:41 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [req-8639c07a-5244-49f2-bf31-c3c7a365b142 req-da573147-30ad-4a23-afda-cb6c340bf77f tempest-VolumesGetTestJSON-1609074872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-b17b744a-ef0c-4291-b902-192d0cca57e1 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:49:41 devstack cinder-volume[86639]: DEBUG cinder.quota [None req-2890c0e8-39d0-4d4a-82f2-6e29dfb2c03d tempest-VolumesImageMetadata-1032207390 None] Created reservations ['68c06839-5d6e-4d71-8b37-42cd143312d6', '092d7d44-5899-41a1-a40a-595ba2f51776', '9727c6f8-ef4b-40dc-b025-2cd353868f8f', 'e3deff51-8515-4e89-ac31-898a8fd07831'] {{(pid=86639) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 19:49:41 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-2890c0e8-39d0-4d4a-82f2-6e29dfb2c03d tempest-VolumesImageMetadata-1032207390 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:49:41 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-2890c0e8-39d0-4d4a-82f2-6e29dfb2c03d tempest-VolumesImageMetadata-1032207390 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:49:41 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-2890c0e8-39d0-4d4a-82f2-6e29dfb2c03d tempest-VolumesImageMetadata-1032207390 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 19:49:41 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-2890c0e8-39d0-4d4a-82f2-6e29dfb2c03d tempest-VolumesImageMetadata-1032207390 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 19:49:41 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-2890c0e8-39d0-4d4a-82f2-6e29dfb2c03d tempest-VolumesImageMetadata-1032207390 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:49:41 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-2890c0e8-39d0-4d4a-82f2-6e29dfb2c03d tempest-VolumesImageMetadata-1032207390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:49:41 devstack sudo[95273]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-b17b744a-ef0c-4291-b902-192d0cca57e1
Jul 02 19:49:41 devstack sudo[95273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:49:41 devstack sudo[95275]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e
Jul 02 19:49:41 devstack sudo[95275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:49:42 devstack sudo[95271]: pam_unix(sudo:session): session closed for user root
Jul 02 19:49:42 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e" returned: 0 in 0.928s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:49:42 devstack cinder-volume[86639]: DEBUG cinder.manager [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] Notifying Schedulers of capabilities ... {{(pid=86639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 19:49:42 devstack cinder-volume[86639]: DEBUG oslo_service.periodic_task [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] Running periodic task VolumeManager._thread_info {{(pid=86639) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 02 19:49:42 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] thread count: 28 {{(pid=86639) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 02 19:49:42 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] thread info: [<_MainThread(MainThread, started 140525261275264)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 140525150678016)>, <Thread(Thread-3 (stat_writer), started daemon 140525150025920)>, <Thread(Rabbit-heartbeat, started daemon 140525150500864)>, <Thread(Thread-5 (_runner), started daemon 140525149847296)>, <Thread(Thread-7 (_runner), started daemon 140525149863424)>, <Thread(fd_logger, started daemon 140525146589376)>, <Thread(privsep_reader, started daemon 140525144562432)>, <Thread(tpool_thread_0, started daemon 140525137151680)>, <Thread(tpool_thread_1, started daemon 140525128758976)>, <Thread(tpool_thread_2, started daemon 140525120349888)>, <Thread(tpool_thread_3, started daemon 140525111940800)>, <Thread(tpool_thread_4, started daemon 140525103531712)>, <Thread(tpool_thread_5, started daemon 140525095122624)>, <Thread(tpool_thread_6, started daemon 140525086713536)>, <Thread(tpool_thread_7, started daemon 140525078304448)>, <Thread(tpool_thread_8, started daemon 140525069895360)>, <Thread(tpool_thread_9, started daemon 140525061486272)>, <Thread(tpool_thread_10, started daemon 140525053077184)>, <Thread(tpool_thread_11, started daemon 140525044668096)>, <Thread(tpool_thread_12, started daemon 140525036259008)>, <Thread(tpool_thread_13, started daemon 140525027849920)>, <Thread(tpool_thread_14, started daemon 140525019440832)>, <Thread(tpool_thread_15, started daemon 140525011031744)>, <Thread(tpool_thread_16, started daemon 140525002622656)>, <Thread(tpool_thread_17, started daemon 140524994213568)>, <Thread(tpool_thread_18, started daemon 140524985804480)>, <Thread(tpool_thread_19, started daemon 140524977395392)>] {{(pid=86639) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 02 19:49:42 devstack sudo[95273]: pam_unix(sudo:session): session closed for user root
Jul 02 19:49:42 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [req-8639c07a-5244-49f2-bf31-c3c7a365b142 req-da573147-30ad-4a23-afda-cb6c340bf77f tempest-VolumesGetTestJSON-1609074872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-b17b744a-ef0c-4291-b902-192d0cca57e1" returned: 0 in 0.995s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:49:42 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [req-8639c07a-5244-49f2-bf31-c3c7a365b142 req-da573147-30ad-4a23-afda-cb6c340bf77f tempest-VolumesGetTestJSON-1609074872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-b17b744a-ef0c-4291-b902-192d0cca57e1 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:49:42 devstack sudo[95281]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-b17b744a-ef0c-4291-b902-192d0cca57e1
Jul 02 19:49:42 devstack sudo[95281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:49:42 devstack sudo[95275]: pam_unix(sudo:session): session closed for user root
Jul 02 19:49:42 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-2890c0e8-39d0-4d4a-82f2-6e29dfb2c03d tempest-VolumesImageMetadata-1032207390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e" returned: 0 in 1.017s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:49:42 devstack cinder-volume[86639]: DEBUG cinder.manager [None req-2890c0e8-39d0-4d4a-82f2-6e29dfb2c03d tempest-VolumesImageMetadata-1032207390 None] Notifying Schedulers of capabilities ... {{(pid=86639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 19:49:42 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-2890c0e8-39d0-4d4a-82f2-6e29dfb2c03d tempest-VolumesImageMetadata-1032207390 None] Deleted volume successfully.
Jul 02 19:49:42 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-2890c0e8-39d0-4d4a-82f2-6e29dfb2c03d tempest-VolumesImageMetadata-1032207390 None] Lock "cinder-d4e80d54-7f58-4344-94fc-3f7aa4cba075-delete_volume" released by "delete_volume" :: held 4.560s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:49:43 devstack sudo[95281]: pam_unix(sudo:session): session closed for user root
Jul 02 19:49:43 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [req-8639c07a-5244-49f2-bf31-c3c7a365b142 req-da573147-30ad-4a23-afda-cb6c340bf77f tempest-VolumesGetTestJSON-1609074872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-b17b744a-ef0c-4291-b902-192d0cca57e1" returned: 0 in 0.901s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:49:43 devstack cinder-volume[86639]: DEBUG cinder.coordination [req-8639c07a-5244-49f2-bf31-c3c7a365b142 req-da573147-30ad-4a23-afda-cb6c340bf77f tempest-VolumesGetTestJSON-1609074872 None] Lock "cinder-quobyte-b17b744a-ef0c-4291-b902-192d0cca57e1" released by "delete_volume" :: held 1.972s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:49:43 devstack cinder-volume[86639]: DEBUG cinder.quota [req-8639c07a-5244-49f2-bf31-c3c7a365b142 req-da573147-30ad-4a23-afda-cb6c340bf77f tempest-VolumesGetTestJSON-1609074872 None] Created reservations ['ff82747c-3b82-48e7-8edf-c05cf56d2323', '52c77d7a-b502-4cfe-80cd-94adbfc28fed', 'a72e4dc9-b4a4-410e-993a-a4fcfd5dd096', '0f339882-c9fc-465d-b707-4a0e54c29fd1'] {{(pid=86639) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 19:49:43 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [req-8639c07a-5244-49f2-bf31-c3c7a365b142 req-da573147-30ad-4a23-afda-cb6c340bf77f tempest-VolumesGetTestJSON-1609074872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:49:43 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [req-8639c07a-5244-49f2-bf31-c3c7a365b142 req-da573147-30ad-4a23-afda-cb6c340bf77f tempest-VolumesGetTestJSON-1609074872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:49:43 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [req-8639c07a-5244-49f2-bf31-c3c7a365b142 req-da573147-30ad-4a23-afda-cb6c340bf77f tempest-VolumesGetTestJSON-1609074872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 19:49:43 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [req-8639c07a-5244-49f2-bf31-c3c7a365b142 req-da573147-30ad-4a23-afda-cb6c340bf77f tempest-VolumesGetTestJSON-1609074872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 19:49:43 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [req-8639c07a-5244-49f2-bf31-c3c7a365b142 req-da573147-30ad-4a23-afda-cb6c340bf77f tempest-VolumesGetTestJSON-1609074872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:49:43 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [req-8639c07a-5244-49f2-bf31-c3c7a365b142 req-da573147-30ad-4a23-afda-cb6c340bf77f tempest-VolumesGetTestJSON-1609074872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:49:43 devstack sudo[95286]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e
Jul 02 19:49:43 devstack sudo[95286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:49:44 devstack sudo[95286]: pam_unix(sudo:session): session closed for user root
Jul 02 19:49:44 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [req-8639c07a-5244-49f2-bf31-c3c7a365b142 req-da573147-30ad-4a23-afda-cb6c340bf77f tempest-VolumesGetTestJSON-1609074872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e" returned: 0 in 0.793s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:49:44 devstack cinder-volume[86639]: DEBUG cinder.manager [req-8639c07a-5244-49f2-bf31-c3c7a365b142 req-da573147-30ad-4a23-afda-cb6c340bf77f tempest-VolumesGetTestJSON-1609074872 None] Notifying Schedulers of capabilities ... {{(pid=86639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 19:49:44 devstack cinder-volume[86639]: INFO cinder.volume.manager [req-8639c07a-5244-49f2-bf31-c3c7a365b142 req-da573147-30ad-4a23-afda-cb6c340bf77f tempest-VolumesGetTestJSON-1609074872 None] Deleted volume successfully.
Jul 02 19:49:44 devstack cinder-volume[86639]: DEBUG cinder.coordination [req-8639c07a-5244-49f2-bf31-c3c7a365b142 req-da573147-30ad-4a23-afda-cb6c340bf77f tempest-VolumesGetTestJSON-1609074872 None] Lock "cinder-b17b744a-ef0c-4291-b902-192d0cca57e1-delete_volume" released by "delete_volume" :: held 3.212s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:49:47 devstack cinder-volume[86639]: INFO cinder.volume.manager [req-b5f10c31-58d7-484c-b1dd-635f0a41a850 req-54c75d4f-e67e-4b7a-bf90-d614e7a9d86c tempest-AttachVolumeNegativeTest-732301193 None] Terminate volume connection completed successfully.
Jul 02 19:49:47 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [req-b5f10c31-58d7-484c-b1dd-635f0a41a850 req-54c75d4f-e67e-4b7a-bf90-d614e7a9d86c tempest-AttachVolumeNegativeTest-732301193 None] Deleting attachment 120e4815-eb6b-47b9-aa25-ad9d4daf4cd6. {{(pid=86639) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 02 19:49:49 devstack cinder-volume[86639]: DEBUG cinder.volume.flows.manager.create_volume [None req-2017d192-900a-4ca1-85e1-bb2dc5c9ad17 tempest-AbsoluteLimitsTests-233074438 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 19:49:49 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-2017d192-900a-4ca1-85e1-bb2dc5c9ad17 tempest-AbsoluteLimitsTests-233074438 None] Flow 'volume_create_manager' (c94dc018-272e-4081-842c-f94f9fd7f65f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 19:49:49 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-2017d192-900a-4ca1-85e1-bb2dc5c9ad17 tempest-AbsoluteLimitsTests-233074438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc1116d8-6523-49d7-b230-e0e36129cd2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:49:49 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-2017d192-900a-4ca1-85e1-bb2dc5c9ad17 tempest-AbsoluteLimitsTests-233074438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc1116d8-6523-49d7-b230-e0e36129cd2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T17:49:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1979756123',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c644b3bb-5304-41e2-ae0d-fa9751ea3ec7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2559d10610e543b19fbab4eb014dec5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T17:49:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T17:49:49Z,use_quota=True,user_id='8f4bb7ea90a54add9667f6996dfedcd9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:49:49 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-2017d192-900a-4ca1-85e1-bb2dc5c9ad17 tempest-AbsoluteLimitsTests-233074438 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13e9192c-f542-4abf-a22b-36c1beb9c129) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:49:49 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-2017d192-900a-4ca1-85e1-bb2dc5c9ad17 tempest-AbsoluteLimitsTests-233074438 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13e9192c-f542-4abf-a22b-36c1beb9c129) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:49:49 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-2017d192-900a-4ca1-85e1-bb2dc5c9ad17 tempest-AbsoluteLimitsTests-233074438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e8dcc1b-d261-4988-9d89-d515b7715e64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:49:49 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-2017d192-900a-4ca1-85e1-bb2dc5c9ad17 tempest-AbsoluteLimitsTests-233074438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e8dcc1b-d261-4988-9d89-d515b7715e64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c644b3bb-5304-41e2-ae0d-fa9751ea3ec7', 'volume_name': 'volume-c644b3bb-5304-41e2-ae0d-fa9751ea3ec7', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:49:49 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-2017d192-900a-4ca1-85e1-bb2dc5c9ad17 tempest-AbsoluteLimitsTests-233074438 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (772e9e26-f3bc-49cc-8cd1-665735e4b0bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:49:49 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-2017d192-900a-4ca1-85e1-bb2dc5c9ad17 tempest-AbsoluteLimitsTests-233074438 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (772e9e26-f3bc-49cc-8cd1-665735e4b0bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:49:49 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-2017d192-900a-4ca1-85e1-bb2dc5c9ad17 tempest-AbsoluteLimitsTests-233074438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (524f9070-9ea7-426d-aacd-69c5733f0318) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:49:49 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-2017d192-900a-4ca1-85e1-bb2dc5c9ad17 tempest-AbsoluteLimitsTests-233074438 None] Volume c644b3bb-5304-41e2-ae0d-fa9751ea3ec7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c644b3bb-5304-41e2-ae0d-fa9751ea3ec7', 'volume_size': 1}
Jul 02 19:49:49 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-2017d192-900a-4ca1-85e1-bb2dc5c9ad17 tempest-AbsoluteLimitsTests-233074438 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:49:49 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-2017d192-900a-4ca1-85e1-bb2dc5c9ad17 tempest-AbsoluteLimitsTests-233074438 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:49:49 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-2017d192-900a-4ca1-85e1-bb2dc5c9ad17 tempest-AbsoluteLimitsTests-233074438 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce906cb830>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T17:49:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1979756123',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c644b3bb-5304-41e2-ae0d-fa9751ea3ec7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2559d10610e543b19fbab4eb014dec5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T17:49:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T17:49:49Z,use_quota=True,user_id='8f4bb7ea90a54add9667f6996dfedcd9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)}" {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 19:49:49 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-2017d192-900a-4ca1-85e1-bb2dc5c9ad17 tempest-AbsoluteLimitsTests-233074438 None] Creating volume c644b3bb-5304-41e2-ae0d-fa9751ea3ec7 {{(pid=86639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 19:49:49 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-2017d192-900a-4ca1-85e1-bb2dc5c9ad17 tempest-AbsoluteLimitsTests-233074438 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:49:49 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-2017d192-900a-4ca1-85e1-bb2dc5c9ad17 tempest-AbsoluteLimitsTests-233074438 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:49:49 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-2017d192-900a-4ca1-85e1-bb2dc5c9ad17 tempest-AbsoluteLimitsTests-233074438 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 19:49:49 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-2017d192-900a-4ca1-85e1-bb2dc5c9ad17 tempest-AbsoluteLimitsTests-233074438 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 19:49:49 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-2017d192-900a-4ca1-85e1-bb2dc5c9ad17 tempest-AbsoluteLimitsTests-233074438 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:49:49 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-2017d192-900a-4ca1-85e1-bb2dc5c9ad17 tempest-AbsoluteLimitsTests-233074438 None] Selected osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92 as target Quobyte volume. {{(pid=86639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 19:49:49 devstack cinder-volume[86639]: INFO cinder.volume.drivers.remotefs [None req-2017d192-900a-4ca1-85e1-bb2dc5c9ad17 tempest-AbsoluteLimitsTests-233074438 None] casted to osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92
Jul 02 19:49:49 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-2017d192-900a-4ca1-85e1-bb2dc5c9ad17 tempest-AbsoluteLimitsTests-233074438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-c644b3bb-5304-41e2-ae0d-fa9751ea3ec7 1073741824 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:49:49 devstack sudo[95295]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-c644b3bb-5304-41e2-ae0d-fa9751ea3ec7 1073741824
Jul 02 19:49:49 devstack sudo[95295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:49:50 devstack sudo[95295]: pam_unix(sudo:session): session closed for user root
Jul 02 19:49:50 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-2017d192-900a-4ca1-85e1-bb2dc5c9ad17 tempest-AbsoluteLimitsTests-233074438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-c644b3bb-5304-41e2-ae0d-fa9751ea3ec7 1073741824" returned: 0 in 1.115s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:49:50 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-2017d192-900a-4ca1-85e1-bb2dc5c9ad17 tempest-AbsoluteLimitsTests-233074438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-c644b3bb-5304-41e2-ae0d-fa9751ea3ec7 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:49:50 devstack sudo[95302]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-c644b3bb-5304-41e2-ae0d-fa9751ea3ec7
Jul 02 19:49:50 devstack sudo[95302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:49:51 devstack sudo[95302]: pam_unix(sudo:session): session closed for user root
Jul 02 19:49:51 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-2017d192-900a-4ca1-85e1-bb2dc5c9ad17 tempest-AbsoluteLimitsTests-233074438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-c644b3bb-5304-41e2-ae0d-fa9751ea3ec7" returned: 0 in 0.951s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:49:51 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-2017d192-900a-4ca1-85e1-bb2dc5c9ad17 tempest-AbsoluteLimitsTests-233074438 None] <== create_volume: return (2128ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'} {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 19:49:51 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-2017d192-900a-4ca1-85e1-bb2dc5c9ad17 tempest-AbsoluteLimitsTests-233074438 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.131s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:49:51 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-2017d192-900a-4ca1-85e1-bb2dc5c9ad17 tempest-AbsoluteLimitsTests-233074438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (524f9070-9ea7-426d-aacd-69c5733f0318) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c644b3bb-5304-41e2-ae0d-fa9751ea3ec7', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:49:51 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-2017d192-900a-4ca1-85e1-bb2dc5c9ad17 tempest-AbsoluteLimitsTests-233074438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0c4d585-d1ee-420e-932f-3fade9b93b1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:49:51 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-2017d192-900a-4ca1-85e1-bb2dc5c9ad17 tempest-AbsoluteLimitsTests-233074438 None] Volume volume-c644b3bb-5304-41e2-ae0d-fa9751ea3ec7 (c644b3bb-5304-41e2-ae0d-fa9751ea3ec7): created successfully
Jul 02 19:49:51 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-2017d192-900a-4ca1-85e1-bb2dc5c9ad17 tempest-AbsoluteLimitsTests-233074438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0c4d585-d1ee-420e-932f-3fade9b93b1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:49:51 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-2017d192-900a-4ca1-85e1-bb2dc5c9ad17 tempest-AbsoluteLimitsTests-233074438 None] Flow 'volume_create_manager' (c94dc018-272e-4081-842c-f94f9fd7f65f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 19:49:51 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-2017d192-900a-4ca1-85e1-bb2dc5c9ad17 tempest-AbsoluteLimitsTests-233074438 None] Created volume successfully.
Jul 02 19:49:52 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-dfb13b91-1fd6-4b93-81c5-76f33d906162 tempest-AbsoluteLimitsTests-233074438 None] Acquiring lock "cinder-c644b3bb-5304-41e2-ae0d-fa9751ea3ec7-delete_volume" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:49:52 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-dfb13b91-1fd6-4b93-81c5-76f33d906162 tempest-AbsoluteLimitsTests-233074438 None] Lock "cinder-c644b3bb-5304-41e2-ae0d-fa9751ea3ec7-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:49:52 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-dfb13b91-1fd6-4b93-81c5-76f33d906162 tempest-AbsoluteLimitsTests-233074438 None] Acquiring lock "cinder-quobyte-c644b3bb-5304-41e2-ae0d-fa9751ea3ec7" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:49:52 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-dfb13b91-1fd6-4b93-81c5-76f33d906162 tempest-AbsoluteLimitsTests-233074438 None] Lock "cinder-quobyte-c644b3bb-5304-41e2-ae0d-fa9751ea3ec7" acquired by "delete_volume" :: waited 0.022s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:49:52 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6f94e4a-981a-4f9c-b971-d4dfc848ac7e]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 19:49:52 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-dfb13b91-1fd6-4b93-81c5-76f33d906162 tempest-AbsoluteLimitsTests-233074438 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-c644b3bb-5304-41e2-ae0d-fa9751ea3ec7 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:49:52 devstack sudo[95348]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-c644b3bb-5304-41e2-ae0d-fa9751ea3ec7
Jul 02 19:49:52 devstack sudo[95348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:49:53 devstack sudo[95348]: pam_unix(sudo:session): session closed for user root
Jul 02 19:49:53 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-dfb13b91-1fd6-4b93-81c5-76f33d906162 tempest-AbsoluteLimitsTests-233074438 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-c644b3bb-5304-41e2-ae0d-fa9751ea3ec7" returned: 0 in 1.016s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:49:53 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-dfb13b91-1fd6-4b93-81c5-76f33d906162 tempest-AbsoluteLimitsTests-233074438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-c644b3bb-5304-41e2-ae0d-fa9751ea3ec7 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:49:53 devstack sudo[95354]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-c644b3bb-5304-41e2-ae0d-fa9751ea3ec7
Jul 02 19:49:53 devstack sudo[95354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:49:54 devstack sudo[95354]: pam_unix(sudo:session): session closed for user root
Jul 02 19:49:54 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-dfb13b91-1fd6-4b93-81c5-76f33d906162 tempest-AbsoluteLimitsTests-233074438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-c644b3bb-5304-41e2-ae0d-fa9751ea3ec7" returned: 0 in 1.015s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:49:54 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-dfb13b91-1fd6-4b93-81c5-76f33d906162 tempest-AbsoluteLimitsTests-233074438 None] Lock "cinder-quobyte-c644b3bb-5304-41e2-ae0d-fa9751ea3ec7" released by "delete_volume" :: held 2.085s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:49:54 devstack cinder-volume[86639]: DEBUG cinder.quota [None req-dfb13b91-1fd6-4b93-81c5-76f33d906162 tempest-AbsoluteLimitsTests-233074438 None] Created reservations ['eb1bc2a7-4238-4315-ba42-43b56cdf95eb', 'e3d8d795-5a36-4a27-9344-491901bfa31c', '8ed54403-73ab-4f9a-97a5-6afccccce6a7', '6edd7041-7998-495c-80f0-22dd7db50025'] {{(pid=86639) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 19:49:54 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-dfb13b91-1fd6-4b93-81c5-76f33d906162 tempest-AbsoluteLimitsTests-233074438 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:49:54 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-dfb13b91-1fd6-4b93-81c5-76f33d906162 tempest-AbsoluteLimitsTests-233074438 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:49:54 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-dfb13b91-1fd6-4b93-81c5-76f33d906162 tempest-AbsoluteLimitsTests-233074438 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 19:49:54 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-dfb13b91-1fd6-4b93-81c5-76f33d906162 tempest-AbsoluteLimitsTests-233074438 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 19:49:54 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-dfb13b91-1fd6-4b93-81c5-76f33d906162 tempest-AbsoluteLimitsTests-233074438 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:49:54 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-dfb13b91-1fd6-4b93-81c5-76f33d906162 tempest-AbsoluteLimitsTests-233074438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:49:54 devstack sudo[95359]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e
Jul 02 19:49:54 devstack sudo[95359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:49:55 devstack cinder-volume[86639]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7835fee-5b74-4b8d-9444-27c08f116b8c tempest-VolumesMetadataTest-1239575515 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 19:49:55 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-b7835fee-5b74-4b8d-9444-27c08f116b8c tempest-VolumesMetadataTest-1239575515 None] Flow 'volume_create_manager' (78fffef7-204d-4ff6-ab69-c165adff5b95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 19:49:55 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-b7835fee-5b74-4b8d-9444-27c08f116b8c tempest-VolumesMetadataTest-1239575515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d178eee-0b39-4791-8242-fe9dfbbfad36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:49:55 devstack sudo[95359]: pam_unix(sudo:session): session closed for user root
Jul 02 19:49:55 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-dfb13b91-1fd6-4b93-81c5-76f33d906162 tempest-AbsoluteLimitsTests-233074438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e" returned: 0 in 0.733s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:49:55 devstack cinder-volume[86639]: DEBUG cinder.manager [None req-dfb13b91-1fd6-4b93-81c5-76f33d906162 tempest-AbsoluteLimitsTests-233074438 None] Notifying Schedulers of capabilities ... {{(pid=86639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 19:49:55 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-b7835fee-5b74-4b8d-9444-27c08f116b8c tempest-VolumesMetadataTest-1239575515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d178eee-0b39-4791-8242-fe9dfbbfad36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T17:49:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1539718896',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=301a6200-d57e-4f4a-b5d2-5996c375be9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fb15652847b46f88627494db8dbad42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T17:49:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T17:49:55Z,use_quota=True,user_id='490ce877980f451ca1bc1c89e39d8aa5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:49:55 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-b7835fee-5b74-4b8d-9444-27c08f116b8c tempest-VolumesMetadataTest-1239575515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d72dbd77-3b1a-4fa5-a7f0-8087cc374b90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:49:55 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-b7835fee-5b74-4b8d-9444-27c08f116b8c tempest-VolumesMetadataTest-1239575515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d72dbd77-3b1a-4fa5-a7f0-8087cc374b90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:49:55 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-b7835fee-5b74-4b8d-9444-27c08f116b8c tempest-VolumesMetadataTest-1239575515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebb4c241-02b3-4ee0-be66-eac7d504bc9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:49:55 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-b7835fee-5b74-4b8d-9444-27c08f116b8c tempest-VolumesMetadataTest-1239575515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebb4c241-02b3-4ee0-be66-eac7d504bc9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '301a6200-d57e-4f4a-b5d2-5996c375be9b', 'volume_name': 'volume-301a6200-d57e-4f4a-b5d2-5996c375be9b', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:49:55 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-b7835fee-5b74-4b8d-9444-27c08f116b8c tempest-VolumesMetadataTest-1239575515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (597d5328-4aef-4498-9e25-54ec73e72cc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:49:55 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-b7835fee-5b74-4b8d-9444-27c08f116b8c tempest-VolumesMetadataTest-1239575515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (597d5328-4aef-4498-9e25-54ec73e72cc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:49:55 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-b7835fee-5b74-4b8d-9444-27c08f116b8c tempest-VolumesMetadataTest-1239575515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c29e335-d3ef-4fe7-adc2-37a1a07e9d24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:49:55 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-b7835fee-5b74-4b8d-9444-27c08f116b8c tempest-VolumesMetadataTest-1239575515 None] Volume 301a6200-d57e-4f4a-b5d2-5996c375be9b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-301a6200-d57e-4f4a-b5d2-5996c375be9b', 'volume_size': 1}
Jul 02 19:49:55 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-b7835fee-5b74-4b8d-9444-27c08f116b8c tempest-VolumesMetadataTest-1239575515 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:49:55 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-b7835fee-5b74-4b8d-9444-27c08f116b8c tempest-VolumesMetadataTest-1239575515 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:49:55 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-b7835fee-5b74-4b8d-9444-27c08f116b8c tempest-VolumesMetadataTest-1239575515 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce906cb830>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T17:49:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1539718896',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=301a6200-d57e-4f4a-b5d2-5996c375be9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fb15652847b46f88627494db8dbad42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T17:49:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T17:49:55Z,use_quota=True,user_id='490ce877980f451ca1bc1c89e39d8aa5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)}" {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 19:49:55 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-b7835fee-5b74-4b8d-9444-27c08f116b8c tempest-VolumesMetadataTest-1239575515 None] Creating volume 301a6200-d57e-4f4a-b5d2-5996c375be9b {{(pid=86639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 19:49:55 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-b7835fee-5b74-4b8d-9444-27c08f116b8c tempest-VolumesMetadataTest-1239575515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:49:55 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-b7835fee-5b74-4b8d-9444-27c08f116b8c tempest-VolumesMetadataTest-1239575515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:49:55 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-b7835fee-5b74-4b8d-9444-27c08f116b8c tempest-VolumesMetadataTest-1239575515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 19:49:55 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-b7835fee-5b74-4b8d-9444-27c08f116b8c tempest-VolumesMetadataTest-1239575515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 19:49:55 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-b7835fee-5b74-4b8d-9444-27c08f116b8c tempest-VolumesMetadataTest-1239575515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:49:55 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-b7835fee-5b74-4b8d-9444-27c08f116b8c tempest-VolumesMetadataTest-1239575515 None] Selected osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92 as target Quobyte volume. {{(pid=86639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 19:49:55 devstack cinder-volume[86639]: INFO cinder.volume.drivers.remotefs [None req-b7835fee-5b74-4b8d-9444-27c08f116b8c tempest-VolumesMetadataTest-1239575515 None] casted to osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92
Jul 02 19:49:55 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-b7835fee-5b74-4b8d-9444-27c08f116b8c tempest-VolumesMetadataTest-1239575515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-301a6200-d57e-4f4a-b5d2-5996c375be9b 1073741824 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:49:55 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-dfb13b91-1fd6-4b93-81c5-76f33d906162 tempest-AbsoluteLimitsTests-233074438 None] Deleted volume successfully.
Jul 02 19:49:55 devstack sudo[95364]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-301a6200-d57e-4f4a-b5d2-5996c375be9b 1073741824
Jul 02 19:49:55 devstack sudo[95364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:49:55 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-dfb13b91-1fd6-4b93-81c5-76f33d906162 tempest-AbsoluteLimitsTests-233074438 None] Lock "cinder-c644b3bb-5304-41e2-ae0d-fa9751ea3ec7-delete_volume" released by "delete_volume" :: held 3.198s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:49:56 devstack sudo[95364]: pam_unix(sudo:session): session closed for user root
Jul 02 19:49:56 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-b7835fee-5b74-4b8d-9444-27c08f116b8c tempest-VolumesMetadataTest-1239575515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-301a6200-d57e-4f4a-b5d2-5996c375be9b 1073741824" returned: 0 in 0.983s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:49:56 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-b7835fee-5b74-4b8d-9444-27c08f116b8c tempest-VolumesMetadataTest-1239575515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-301a6200-d57e-4f4a-b5d2-5996c375be9b {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:49:56 devstack sudo[95370]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-301a6200-d57e-4f4a-b5d2-5996c375be9b
Jul 02 19:49:56 devstack sudo[95370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:49:57 devstack sudo[95370]: pam_unix(sudo:session): session closed for user root
Jul 02 19:49:57 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-b7835fee-5b74-4b8d-9444-27c08f116b8c tempest-VolumesMetadataTest-1239575515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-301a6200-d57e-4f4a-b5d2-5996c375be9b" returned: 0 in 0.774s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:49:57 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-b7835fee-5b74-4b8d-9444-27c08f116b8c tempest-VolumesMetadataTest-1239575515 None] <== create_volume: return (1800ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'} {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 19:49:57 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-b7835fee-5b74-4b8d-9444-27c08f116b8c tempest-VolumesMetadataTest-1239575515 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.802s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:49:57 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-b7835fee-5b74-4b8d-9444-27c08f116b8c tempest-VolumesMetadataTest-1239575515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c29e335-d3ef-4fe7-adc2-37a1a07e9d24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-301a6200-d57e-4f4a-b5d2-5996c375be9b', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:49:57 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-b7835fee-5b74-4b8d-9444-27c08f116b8c tempest-VolumesMetadataTest-1239575515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19530a24-0dc4-48c9-a384-e2f70a44ee2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:49:57 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-b7835fee-5b74-4b8d-9444-27c08f116b8c tempest-VolumesMetadataTest-1239575515 None] Volume volume-301a6200-d57e-4f4a-b5d2-5996c375be9b (301a6200-d57e-4f4a-b5d2-5996c375be9b): created successfully
Jul 02 19:49:57 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-b7835fee-5b74-4b8d-9444-27c08f116b8c tempest-VolumesMetadataTest-1239575515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19530a24-0dc4-48c9-a384-e2f70a44ee2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:49:57 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-b7835fee-5b74-4b8d-9444-27c08f116b8c tempest-VolumesMetadataTest-1239575515 None] Flow 'volume_create_manager' (78fffef7-204d-4ff6-ab69-c165adff5b95) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 19:49:57 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-b7835fee-5b74-4b8d-9444-27c08f116b8c tempest-VolumesMetadataTest-1239575515 None] Created volume successfully.
Jul 02 19:49:58 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-ec8b955d-f449-4b53-9f1b-3ddab37bbead tempest-VolumesMetadataTest-1239575515 None] Acquiring lock "cinder-301a6200-d57e-4f4a-b5d2-5996c375be9b-delete_volume" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:49:58 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-ec8b955d-f449-4b53-9f1b-3ddab37bbead tempest-VolumesMetadataTest-1239575515 None] Lock "cinder-301a6200-d57e-4f4a-b5d2-5996c375be9b-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:49:58 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-ec8b955d-f449-4b53-9f1b-3ddab37bbead tempest-VolumesMetadataTest-1239575515 None] Acquiring lock "cinder-quobyte-301a6200-d57e-4f4a-b5d2-5996c375be9b" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:49:58 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-ec8b955d-f449-4b53-9f1b-3ddab37bbead tempest-VolumesMetadataTest-1239575515 None] Lock "cinder-quobyte-301a6200-d57e-4f4a-b5d2-5996c375be9b" acquired by "delete_volume" :: waited 0.024s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:49:58 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b35e297-8bca-4a37-ab97-7bc2448bdb80]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 19:49:58 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-ec8b955d-f449-4b53-9f1b-3ddab37bbead tempest-VolumesMetadataTest-1239575515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-301a6200-d57e-4f4a-b5d2-5996c375be9b {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:49:58 devstack sudo[95373]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-301a6200-d57e-4f4a-b5d2-5996c375be9b
Jul 02 19:49:58 devstack sudo[95373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:49:59 devstack sudo[95373]: pam_unix(sudo:session): session closed for user root
Jul 02 19:49:59 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-ec8b955d-f449-4b53-9f1b-3ddab37bbead tempest-VolumesMetadataTest-1239575515 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-301a6200-d57e-4f4a-b5d2-5996c375be9b" returned: 0 in 1.115s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:49:59 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-ec8b955d-f449-4b53-9f1b-3ddab37bbead tempest-VolumesMetadataTest-1239575515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-301a6200-d57e-4f4a-b5d2-5996c375be9b {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:49:59 devstack sudo[95378]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-301a6200-d57e-4f4a-b5d2-5996c375be9b
Jul 02 19:49:59 devstack sudo[95378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:50:00 devstack sudo[95378]: pam_unix(sudo:session): session closed for user root
Jul 02 19:50:00 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-ec8b955d-f449-4b53-9f1b-3ddab37bbead tempest-VolumesMetadataTest-1239575515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-301a6200-d57e-4f4a-b5d2-5996c375be9b" returned: 0 in 0.925s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:50:00 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-ec8b955d-f449-4b53-9f1b-3ddab37bbead tempest-VolumesMetadataTest-1239575515 None] Lock "cinder-quobyte-301a6200-d57e-4f4a-b5d2-5996c375be9b" released by "delete_volume" :: held 2.118s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:50:01 devstack cinder-volume[86639]: DEBUG cinder.quota [None req-ec8b955d-f449-4b53-9f1b-3ddab37bbead tempest-VolumesMetadataTest-1239575515 None] Created reservations ['97702408-c19c-43e1-b29b-7cf8954f9df3', '9b180364-6ac9-4f2e-bfa0-7f3df7d5e1cb', 'c3b2d57d-45ae-43b4-81ff-380a46a02fbe', '3f594837-962f-4571-a955-4f60e3e4e052'] {{(pid=86639) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 19:50:01 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-ec8b955d-f449-4b53-9f1b-3ddab37bbead tempest-VolumesMetadataTest-1239575515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:50:01 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-ec8b955d-f449-4b53-9f1b-3ddab37bbead tempest-VolumesMetadataTest-1239575515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:50:01 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-ec8b955d-f449-4b53-9f1b-3ddab37bbead tempest-VolumesMetadataTest-1239575515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 19:50:01 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-ec8b955d-f449-4b53-9f1b-3ddab37bbead tempest-VolumesMetadataTest-1239575515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 19:50:01 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-ec8b955d-f449-4b53-9f1b-3ddab37bbead tempest-VolumesMetadataTest-1239575515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:50:01 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-ec8b955d-f449-4b53-9f1b-3ddab37bbead tempest-VolumesMetadataTest-1239575515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:50:01 devstack sudo[95381]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e
Jul 02 19:50:01 devstack sudo[95381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:50:01 devstack cinder-volume[86639]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1f63f4f-9844-414c-8f75-74f1a915efa7 tempest-VolumesCloneTest-929848012 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 19:50:01 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-a1f63f4f-9844-414c-8f75-74f1a915efa7 tempest-VolumesCloneTest-929848012 None] Flow 'volume_create_manager' (51d115bc-6bfa-47a4-93e0-5905da68fc79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 19:50:01 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-a1f63f4f-9844-414c-8f75-74f1a915efa7 tempest-VolumesCloneTest-929848012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f459d453-3bbe-47b2-b005-6fba21a6ac95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:50:02 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-a1f63f4f-9844-414c-8f75-74f1a915efa7 tempest-VolumesCloneTest-929848012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f459d453-3bbe-47b2-b005-6fba21a6ac95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T17:50:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-895550632',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12788ecb-b4b9-43c6-a2e8-f650078962a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1a923d940ed4b6bb149c9e8472173fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T17:50:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T17:50:02Z,use_quota=True,user_id='0213183d759b4347a2b2a52390b4cdaf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:50:02 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-a1f63f4f-9844-414c-8f75-74f1a915efa7 tempest-VolumesCloneTest-929848012 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a3e39eb-3025-4935-80d1-c463d8899cbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:50:02 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-a1f63f4f-9844-414c-8f75-74f1a915efa7 tempest-VolumesCloneTest-929848012 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a3e39eb-3025-4935-80d1-c463d8899cbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:50:02 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-a1f63f4f-9844-414c-8f75-74f1a915efa7 tempest-VolumesCloneTest-929848012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38136794-ecc2-4035-8eb4-876545b1dfe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:50:02 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-a1f63f4f-9844-414c-8f75-74f1a915efa7 tempest-VolumesCloneTest-929848012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38136794-ecc2-4035-8eb4-876545b1dfe3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '12788ecb-b4b9-43c6-a2e8-f650078962a6', 'volume_name': 'volume-12788ecb-b4b9-43c6-a2e8-f650078962a6', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:50:02 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-a1f63f4f-9844-414c-8f75-74f1a915efa7 tempest-VolumesCloneTest-929848012 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5752c2a5-5e9f-4f97-be37-286d901308fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:50:02 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-a1f63f4f-9844-414c-8f75-74f1a915efa7 tempest-VolumesCloneTest-929848012 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5752c2a5-5e9f-4f97-be37-286d901308fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:50:02 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-a1f63f4f-9844-414c-8f75-74f1a915efa7 tempest-VolumesCloneTest-929848012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6303b71-a233-4a39-8bb6-c721bee5c1ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:50:02 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-a1f63f4f-9844-414c-8f75-74f1a915efa7 tempest-VolumesCloneTest-929848012 None] Volume 12788ecb-b4b9-43c6-a2e8-f650078962a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-12788ecb-b4b9-43c6-a2e8-f650078962a6', 'volume_size': 1}
Jul 02 19:50:02 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-a1f63f4f-9844-414c-8f75-74f1a915efa7 tempest-VolumesCloneTest-929848012 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:50:02 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-a1f63f4f-9844-414c-8f75-74f1a915efa7 tempest-VolumesCloneTest-929848012 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:50:02 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-a1f63f4f-9844-414c-8f75-74f1a915efa7 tempest-VolumesCloneTest-929848012 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce906cb830>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T17:50:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-895550632',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12788ecb-b4b9-43c6-a2e8-f650078962a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1a923d940ed4b6bb149c9e8472173fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T17:50:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T17:50:02Z,use_quota=True,user_id='0213183d759b4347a2b2a52390b4cdaf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)}" {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 19:50:02 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-a1f63f4f-9844-414c-8f75-74f1a915efa7 tempest-VolumesCloneTest-929848012 None] Creating volume 12788ecb-b4b9-43c6-a2e8-f650078962a6 {{(pid=86639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 19:50:02 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-a1f63f4f-9844-414c-8f75-74f1a915efa7 tempest-VolumesCloneTest-929848012 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:50:02 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-a1f63f4f-9844-414c-8f75-74f1a915efa7 tempest-VolumesCloneTest-929848012 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:50:02 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-a1f63f4f-9844-414c-8f75-74f1a915efa7 tempest-VolumesCloneTest-929848012 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 19:50:02 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-a1f63f4f-9844-414c-8f75-74f1a915efa7 tempest-VolumesCloneTest-929848012 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 19:50:02 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-a1f63f4f-9844-414c-8f75-74f1a915efa7 tempest-VolumesCloneTest-929848012 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:50:02 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-a1f63f4f-9844-414c-8f75-74f1a915efa7 tempest-VolumesCloneTest-929848012 None] Selected osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92 as target Quobyte volume. {{(pid=86639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 19:50:02 devstack cinder-volume[86639]: INFO cinder.volume.drivers.remotefs [None req-a1f63f4f-9844-414c-8f75-74f1a915efa7 tempest-VolumesCloneTest-929848012 None] casted to osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92
Jul 02 19:50:02 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-a1f63f4f-9844-414c-8f75-74f1a915efa7 tempest-VolumesCloneTest-929848012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-12788ecb-b4b9-43c6-a2e8-f650078962a6 1073741824 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:50:02 devstack sudo[95385]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-12788ecb-b4b9-43c6-a2e8-f650078962a6 1073741824
Jul 02 19:50:02 devstack sudo[95385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:50:02 devstack sudo[95381]: pam_unix(sudo:session): session closed for user root
Jul 02 19:50:02 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-ec8b955d-f449-4b53-9f1b-3ddab37bbead tempest-VolumesMetadataTest-1239575515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e" returned: 0 in 1.129s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:50:02 devstack cinder-volume[86639]: DEBUG cinder.manager [None req-ec8b955d-f449-4b53-9f1b-3ddab37bbead tempest-VolumesMetadataTest-1239575515 None] Notifying Schedulers of capabilities ... {{(pid=86639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 19:50:02 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-ec8b955d-f449-4b53-9f1b-3ddab37bbead tempest-VolumesMetadataTest-1239575515 None] Deleted volume successfully.
Jul 02 19:50:02 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-ec8b955d-f449-4b53-9f1b-3ddab37bbead tempest-VolumesMetadataTest-1239575515 None] Lock "cinder-301a6200-d57e-4f4a-b5d2-5996c375be9b-delete_volume" released by "delete_volume" :: held 3.608s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:50:03 devstack sudo[95385]: pam_unix(sudo:session): session closed for user root
Jul 02 19:50:03 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-a1f63f4f-9844-414c-8f75-74f1a915efa7 tempest-VolumesCloneTest-929848012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-12788ecb-b4b9-43c6-a2e8-f650078962a6 1073741824" returned: 0 in 1.283s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:50:03 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-a1f63f4f-9844-414c-8f75-74f1a915efa7 tempest-VolumesCloneTest-929848012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-12788ecb-b4b9-43c6-a2e8-f650078962a6 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:50:03 devstack sudo[95392]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-12788ecb-b4b9-43c6-a2e8-f650078962a6
Jul 02 19:50:03 devstack sudo[95392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:50:04 devstack sudo[95392]: pam_unix(sudo:session): session closed for user root
Jul 02 19:50:04 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-a1f63f4f-9844-414c-8f75-74f1a915efa7 tempest-VolumesCloneTest-929848012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-12788ecb-b4b9-43c6-a2e8-f650078962a6" returned: 0 in 1.007s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:50:04 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-a1f63f4f-9844-414c-8f75-74f1a915efa7 tempest-VolumesCloneTest-929848012 None] <== create_volume: return (2368ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'} {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 19:50:04 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-a1f63f4f-9844-414c-8f75-74f1a915efa7 tempest-VolumesCloneTest-929848012 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.370s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:50:04 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-a1f63f4f-9844-414c-8f75-74f1a915efa7 tempest-VolumesCloneTest-929848012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6303b71-a233-4a39-8bb6-c721bee5c1ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-12788ecb-b4b9-43c6-a2e8-f650078962a6', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:50:04 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-a1f63f4f-9844-414c-8f75-74f1a915efa7 tempest-VolumesCloneTest-929848012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0f0cdff-227f-4973-b1c1-6b3d63ca0ae8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:50:04 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-a1f63f4f-9844-414c-8f75-74f1a915efa7 tempest-VolumesCloneTest-929848012 None] Volume volume-12788ecb-b4b9-43c6-a2e8-f650078962a6 (12788ecb-b4b9-43c6-a2e8-f650078962a6): created successfully
Jul 02 19:50:04 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-a1f63f4f-9844-414c-8f75-74f1a915efa7 tempest-VolumesCloneTest-929848012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0f0cdff-227f-4973-b1c1-6b3d63ca0ae8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:50:04 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-a1f63f4f-9844-414c-8f75-74f1a915efa7 tempest-VolumesCloneTest-929848012 None] Flow 'volume_create_manager' (51d115bc-6bfa-47a4-93e0-5905da68fc79) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 19:50:04 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-a1f63f4f-9844-414c-8f75-74f1a915efa7 tempest-VolumesCloneTest-929848012 None] Created volume successfully.
Jul 02 19:50:11 devstack cinder-volume[86639]: DEBUG cinder.volume.flows.manager.create_volume [None req-403d33b2-d3e3-4996-984a-f121dd6b3085 tempest-VolumesCloneTest-929848012 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 19:50:11 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-403d33b2-d3e3-4996-984a-f121dd6b3085 tempest-VolumesCloneTest-929848012 None] Flow 'volume_create_manager' (c7d4736c-0ed5-41f4-9bb6-85fac810b0d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 19:50:11 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-403d33b2-d3e3-4996-984a-f121dd6b3085 tempest-VolumesCloneTest-929848012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (910b0673-e598-47fb-aca5-42f5da4b00e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:50:11 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-403d33b2-d3e3-4996-984a-f121dd6b3085 tempest-VolumesCloneTest-929848012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (910b0673-e598-47fb-aca5-42f5da4b00e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T17:50:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1807347046',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2637e053-7eed-494f-9e8f-1c8d0ffac442,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1a923d940ed4b6bb149c9e8472173fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T17:50:11Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=12788ecb-b4b9-43c6-a2e8-f650078962a6,status='creating',terminated_at=None,updated_at=2026-07-02T17:50:11Z,use_quota=True,user_id='0213183d759b4347a2b2a52390b4cdaf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:50:11 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-403d33b2-d3e3-4996-984a-f121dd6b3085 tempest-VolumesCloneTest-929848012 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7d07f27-2872-4457-8e73-1958adf2149d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:50:11 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-403d33b2-d3e3-4996-984a-f121dd6b3085 tempest-VolumesCloneTest-929848012 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7d07f27-2872-4457-8e73-1958adf2149d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:50:11 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-403d33b2-d3e3-4996-984a-f121dd6b3085 tempest-VolumesCloneTest-929848012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f1f949e-74a6-4831-adf4-05acf433bb12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:50:11 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-403d33b2-d3e3-4996-984a-f121dd6b3085 tempest-VolumesCloneTest-929848012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f1f949e-74a6-4831-adf4-05acf433bb12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '2637e053-7eed-494f-9e8f-1c8d0ffac442', 'volume_name': 'volume-2637e053-7eed-494f-9e8f-1c8d0ffac442', 'volume_size': 2, 'source_volid': '12788ecb-b4b9-43c6-a2e8-f650078962a6', 'source_volstatus': 'available'}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:50:11 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-403d33b2-d3e3-4996-984a-f121dd6b3085 tempest-VolumesCloneTest-929848012 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (024eaa1d-c012-4f43-8322-6c38bdcddd07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:50:11 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-403d33b2-d3e3-4996-984a-f121dd6b3085 tempest-VolumesCloneTest-929848012 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (024eaa1d-c012-4f43-8322-6c38bdcddd07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:50:11 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-403d33b2-d3e3-4996-984a-f121dd6b3085 tempest-VolumesCloneTest-929848012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee52350e-a648-423a-9271-1633382c7a2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:50:11 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-403d33b2-d3e3-4996-984a-f121dd6b3085 tempest-VolumesCloneTest-929848012 None] Volume 2637e053-7eed-494f-9e8f-1c8d0ffac442: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-2637e053-7eed-494f-9e8f-1c8d0ffac442', 'volume_size': 2, 'source_volid': '12788ecb-b4b9-43c6-a2e8-f650078962a6', 'source_volstatus': 'available'}
Jul 02 19:50:11 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-403d33b2-d3e3-4996-984a-f121dd6b3085 tempest-VolumesCloneTest-929848012 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:50:11 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-403d33b2-d3e3-4996-984a-f121dd6b3085 tempest-VolumesCloneTest-929848012 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:50:11 devstack cinder-volume[86639]: INFO cinder.volume.drivers.remotefs [None req-403d33b2-d3e3-4996-984a-f121dd6b3085 tempest-VolumesCloneTest-929848012 None] Cloning volume 12788ecb-b4b9-43c6-a2e8-f650078962a6 to volume 2637e053-7eed-494f-9e8f-1c8d0ffac442
Jul 02 19:50:11 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-a540c186-a2b8-4d60-8d33-7a5d0e889e85 tempest-GroupsV320Test-858253662 None] Group tempest-GroupsV320Test-Group-1364226218: creating
Jul 02 19:50:11 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-403d33b2-d3e3-4996-984a-f121dd6b3085 tempest-VolumesCloneTest-929848012 None] Creating offline snapshot 16124d2b-ac20-496e-ac6e-b4f88b63de39 of volume 12788ecb-b4b9-43c6-a2e8-f650078962a6 {{(pid=86639) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 02 19:50:11 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[90904990-642e-4561-819e-2c094a478f25]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 19:50:11 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-403d33b2-d3e3-4996-984a-f121dd6b3085 tempest-VolumesCloneTest-929848012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-12788ecb-b4b9-43c6-a2e8-f650078962a6 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:50:11 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-a540c186-a2b8-4d60-8d33-7a5d0e889e85 tempest-GroupsV320Test-858253662 None] Group tempest-GroupsV320Test-Group-1364226218: created successfully
Jul 02 19:50:11 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-a540c186-a2b8-4d60-8d33-7a5d0e889e85 tempest-GroupsV320Test-858253662 None] Create group completed successfully.
Jul 02 19:50:11 devstack sudo[95401]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-12788ecb-b4b9-43c6-a2e8-f650078962a6
Jul 02 19:50:11 devstack sudo[95401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:50:12 devstack cinder-volume[86639]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3f7383d-d19b-439c-a5f6-5eca6123293b tempest-VolumesCloneNegativeTest-1843016306 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 19:50:12 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-e3f7383d-d19b-439c-a5f6-5eca6123293b tempest-VolumesCloneNegativeTest-1843016306 None] Flow 'volume_create_manager' (85645083-65cb-45eb-9185-9ff592a013cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 19:50:12 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-e3f7383d-d19b-439c-a5f6-5eca6123293b tempest-VolumesCloneNegativeTest-1843016306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df2a9435-10ba-4390-ac6f-58cfeb9851be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:50:12 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-e3f7383d-d19b-439c-a5f6-5eca6123293b tempest-VolumesCloneNegativeTest-1843016306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df2a9435-10ba-4390-ac6f-58cfeb9851be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T17:50:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1980895243',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b16aae51-20f7-4914-a553-c7c1c63bf24f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9603d684d01a45e585e88a6b29966791',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T17:50:12Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T17:50:12Z,use_quota=True,user_id='ee72588b229c440b9a39cffa81b087ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:50:12 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-e3f7383d-d19b-439c-a5f6-5eca6123293b tempest-VolumesCloneNegativeTest-1843016306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (162ec8d5-600c-4bda-9e6e-a88c186560c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:50:12 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-e3f7383d-d19b-439c-a5f6-5eca6123293b tempest-VolumesCloneNegativeTest-1843016306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (162ec8d5-600c-4bda-9e6e-a88c186560c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:50:12 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-e3f7383d-d19b-439c-a5f6-5eca6123293b tempest-VolumesCloneNegativeTest-1843016306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d572b30d-e15d-4996-b12b-e3b228c31445) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:50:12 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-e3f7383d-d19b-439c-a5f6-5eca6123293b tempest-VolumesCloneNegativeTest-1843016306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d572b30d-e15d-4996-b12b-e3b228c31445) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b16aae51-20f7-4914-a553-c7c1c63bf24f', 'volume_name': 'volume-b16aae51-20f7-4914-a553-c7c1c63bf24f', 'volume_size': 2}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:50:12 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-e3f7383d-d19b-439c-a5f6-5eca6123293b tempest-VolumesCloneNegativeTest-1843016306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abc14f07-dae4-48ef-ae33-6df6b4467ae4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:50:12 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-e3f7383d-d19b-439c-a5f6-5eca6123293b tempest-VolumesCloneNegativeTest-1843016306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abc14f07-dae4-48ef-ae33-6df6b4467ae4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:50:12 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-e3f7383d-d19b-439c-a5f6-5eca6123293b tempest-VolumesCloneNegativeTest-1843016306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dad24254-bfbf-4562-a2e8-bec6e070da7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:50:12 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-e3f7383d-d19b-439c-a5f6-5eca6123293b tempest-VolumesCloneNegativeTest-1843016306 None] Volume b16aae51-20f7-4914-a553-c7c1c63bf24f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b16aae51-20f7-4914-a553-c7c1c63bf24f', 'volume_size': 2}
Jul 02 19:50:12 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-e3f7383d-d19b-439c-a5f6-5eca6123293b tempest-VolumesCloneNegativeTest-1843016306 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:50:12 devstack sudo[95401]: pam_unix(sudo:session): session closed for user root
Jul 02 19:50:12 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-403d33b2-d3e3-4996-984a-f121dd6b3085 tempest-VolumesCloneTest-929848012 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-12788ecb-b4b9-43c6-a2e8-f650078962a6" returned: 0 in 0.801s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:50:12 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-403d33b2-d3e3-4996-984a-f121dd6b3085 tempest-VolumesCloneTest-929848012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-12788ecb-b4b9-43c6-a2e8-f650078962a6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-12788ecb-b4b9-43c6-a2e8-f650078962a6.16124d2b-ac20-496e-ac6e-b4f88b63de39 1G {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:50:12 devstack sudo[95406]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-12788ecb-b4b9-43c6-a2e8-f650078962a6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-12788ecb-b4b9-43c6-a2e8-f650078962a6.16124d2b-ac20-496e-ac6e-b4f88b63de39 1G
Jul 02 19:50:12 devstack sudo[95406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:50:13 devstack cinder-volume[86639]: DEBUG cinder.quota [None req-fe9e1fc5-270d-488d-9569-ec24307051e7 tempest-GroupsV320Test-858253662 None] Created reservations ['c13d7316-04fa-4b69-9961-36524c912f86'] {{(pid=86639) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 19:50:13 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-fe9e1fc5-270d-488d-9569-ec24307051e7 tempest-GroupsV320Test-858253662 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:50:13 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-fe9e1fc5-270d-488d-9569-ec24307051e7 tempest-GroupsV320Test-858253662 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:50:13 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-fe9e1fc5-270d-488d-9569-ec24307051e7 tempest-GroupsV320Test-858253662 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 19:50:13 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-fe9e1fc5-270d-488d-9569-ec24307051e7 tempest-GroupsV320Test-858253662 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 19:50:13 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-fe9e1fc5-270d-488d-9569-ec24307051e7 tempest-GroupsV320Test-858253662 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:50:13 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-fe9e1fc5-270d-488d-9569-ec24307051e7 tempest-GroupsV320Test-858253662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:50:13 devstack sudo[95412]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e
Jul 02 19:50:13 devstack sudo[95412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:50:13 devstack sudo[95406]: pam_unix(sudo:session): session closed for user root
Jul 02 19:50:13 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-403d33b2-d3e3-4996-984a-f121dd6b3085 tempest-VolumesCloneTest-929848012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-12788ecb-b4b9-43c6-a2e8-f650078962a6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-12788ecb-b4b9-43c6-a2e8-f650078962a6.16124d2b-ac20-496e-ac6e-b4f88b63de39 1G" returned: 0 in 0.901s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:50:13 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-403d33b2-d3e3-4996-984a-f121dd6b3085 tempest-VolumesCloneTest-929848012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-12788ecb-b4b9-43c6-a2e8-f650078962a6 -F qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-12788ecb-b4b9-43c6-a2e8-f650078962a6.16124d2b-ac20-496e-ac6e-b4f88b63de39 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:50:13 devstack sudo[95415]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-12788ecb-b4b9-43c6-a2e8-f650078962a6 -F qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-12788ecb-b4b9-43c6-a2e8-f650078962a6.16124d2b-ac20-496e-ac6e-b4f88b63de39
Jul 02 19:50:13 devstack sudo[95415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:50:13 devstack sudo[95412]: pam_unix(sudo:session): session closed for user root
Jul 02 19:50:13 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-fe9e1fc5-270d-488d-9569-ec24307051e7 tempest-GroupsV320Test-858253662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e" returned: 0 in 0.660s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:50:13 devstack cinder-volume[86639]: DEBUG cinder.manager [None req-fe9e1fc5-270d-488d-9569-ec24307051e7 tempest-GroupsV320Test-858253662 None] Notifying Schedulers of capabilities ... {{(pid=86639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 19:50:13 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-fe9e1fc5-270d-488d-9569-ec24307051e7 tempest-GroupsV320Test-858253662 None] Delete group completed successfully.
Jul 02 19:50:13 devstack sudo[95415]: pam_unix(sudo:session): session closed for user root
Jul 02 19:50:13 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-403d33b2-d3e3-4996-984a-f121dd6b3085 tempest-VolumesCloneTest-929848012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-12788ecb-b4b9-43c6-a2e8-f650078962a6 -F qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-12788ecb-b4b9-43c6-a2e8-f650078962a6.16124d2b-ac20-496e-ac6e-b4f88b63de39" returned: 0 in 0.722s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:50:13 devstack cinder-volume[86639]: WARNING cinder.volume.drivers.remotefs [None req-403d33b2-d3e3-4996-984a-f121dd6b3085 tempest-VolumesCloneTest-929848012 None] /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-12788ecb-b4b9-43c6-a2e8-f650078962a6.16124d2b-ac20-496e-ac6e-b4f88b63de39 is being set with open permissions: ugo+rw
Jul 02 19:50:13 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-403d33b2-d3e3-4996-984a-f121dd6b3085 tempest-VolumesCloneTest-929848012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-12788ecb-b4b9-43c6-a2e8-f650078962a6.16124d2b-ac20-496e-ac6e-b4f88b63de39 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:50:14 devstack sudo[95422]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-12788ecb-b4b9-43c6-a2e8-f650078962a6.16124d2b-ac20-496e-ac6e-b4f88b63de39
Jul 02 19:50:14 devstack sudo[95422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:50:14 devstack sudo[95422]: pam_unix(sudo:session): session closed for user root
Jul 02 19:50:14 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-403d33b2-d3e3-4996-984a-f121dd6b3085 tempest-VolumesCloneTest-929848012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-12788ecb-b4b9-43c6-a2e8-f650078962a6.16124d2b-ac20-496e-ac6e-b4f88b63de39" returned: 0 in 0.779s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:50:14 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-403d33b2-d3e3-4996-984a-f121dd6b3085 tempest-VolumesCloneTest-929848012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-12788ecb-b4b9-43c6-a2e8-f650078962a6.info {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:50:14 devstack sudo[95425]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-12788ecb-b4b9-43c6-a2e8-f650078962a6.info
Jul 02 19:50:14 devstack sudo[95425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:50:15 devstack sudo[95425]: pam_unix(sudo:session): session closed for user root
Jul 02 19:50:15 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-403d33b2-d3e3-4996-984a-f121dd6b3085 tempest-VolumesCloneTest-929848012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-12788ecb-b4b9-43c6-a2e8-f650078962a6.info" returned: 0 in 0.968s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:50:15 devstack cinder-volume[86639]: WARNING cinder.volume.drivers.remotefs [None req-403d33b2-d3e3-4996-984a-f121dd6b3085 tempest-VolumesCloneTest-929848012 None] /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-12788ecb-b4b9-43c6-a2e8-f650078962a6.info is being set with open permissions: ugo+rw
Jul 02 19:50:15 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-403d33b2-d3e3-4996-984a-f121dd6b3085 tempest-VolumesCloneTest-929848012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-12788ecb-b4b9-43c6-a2e8-f650078962a6.info {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:50:15 devstack sudo[95428]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-12788ecb-b4b9-43c6-a2e8-f650078962a6.info
Jul 02 19:50:15 devstack sudo[95428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:50:16 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-403d33b2-d3e3-4996-984a-f121dd6b3085 tempest-VolumesCloneTest-929848012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-12788ecb-b4b9-43c6-a2e8-f650078962a6.info" returned: 0 in 0.751s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:50:16 devstack sudo[95428]: pam_unix(sudo:session): session closed for user root
Jul 02 19:50:16 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-403d33b2-d3e3-4996-984a-f121dd6b3085 tempest-VolumesCloneTest-929848012 None] Acquiring lock "cinder-quobyte-2637e053-7eed-494f-9e8f-1c8d0ffac442" by "_copy_volume_from_snapshot" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:50:16 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-403d33b2-d3e3-4996-984a-f121dd6b3085 tempest-VolumesCloneTest-929848012 None] Lock "cinder-quobyte-2637e053-7eed-494f-9e8f-1c8d0ffac442" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:50:16 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-403d33b2-d3e3-4996-984a-f121dd6b3085 tempest-VolumesCloneTest-929848012 None] snapshot: 16124d2b-ac20-496e-ac6e-b4f88b63de39, volume: 2637e053-7eed-494f-9e8f-1c8d0ffac442,  {{(pid=86639) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jul 02 19:50:16 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-403d33b2-d3e3-4996-984a-f121dd6b3085 tempest-VolumesCloneTest-929848012 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:50:16 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-403d33b2-d3e3-4996-984a-f121dd6b3085 tempest-VolumesCloneTest-929848012 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:50:16 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-403d33b2-d3e3-4996-984a-f121dd6b3085 tempest-VolumesCloneTest-929848012 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 19:50:16 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-403d33b2-d3e3-4996-984a-f121dd6b3085 tempest-VolumesCloneTest-929848012 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 19:50:16 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-403d33b2-d3e3-4996-984a-f121dd6b3085 tempest-VolumesCloneTest-929848012 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:50:16 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5d15ae8-8820-44c3-a70f-012199a4c488]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 19:50:16 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-403d33b2-d3e3-4996-984a-f121dd6b3085 tempest-VolumesCloneTest-929848012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-12788ecb-b4b9-43c6-a2e8-f650078962a6.16124d2b-ac20-496e-ac6e-b4f88b63de39 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:50:16 devstack sudo[95441]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-12788ecb-b4b9-43c6-a2e8-f650078962a6.16124d2b-ac20-496e-ac6e-b4f88b63de39
Jul 02 19:50:16 devstack sudo[95441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:50:17 devstack sudo[95441]: pam_unix(sudo:session): session closed for user root
Jul 02 19:50:17 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-403d33b2-d3e3-4996-984a-f121dd6b3085 tempest-VolumesCloneTest-929848012 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-12788ecb-b4b9-43c6-a2e8-f650078962a6.16124d2b-ac20-496e-ac6e-b4f88b63de39" returned: 0 in 0.927s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:50:17 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-403d33b2-d3e3-4996-984a-f121dd6b3085 tempest-VolumesCloneTest-929848012 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-12788ecb-b4b9-43c6-a2e8-f650078962a6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86639) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 02 19:50:17 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-403d33b2-d3e3-4996-984a-f121dd6b3085 tempest-VolumesCloneTest-929848012 None] will copy from snapshot at /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-12788ecb-b4b9-43c6-a2e8-f650078962a6 {{(pid=86639) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jul 02 19:50:17 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-403d33b2-d3e3-4996-984a-f121dd6b3085 tempest-VolumesCloneTest-929848012 None] Creating direct copy from snapshot {{(pid=86639) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jul 02 19:50:17 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[223f28a8-06cb-4bb8-b662-dd758c7fe54b]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 19:50:17 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-403d33b2-d3e3-4996-984a-f121dd6b3085 tempest-VolumesCloneTest-929848012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-12788ecb-b4b9-43c6-a2e8-f650078962a6 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:50:17 devstack sudo[95453]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-12788ecb-b4b9-43c6-a2e8-f650078962a6
Jul 02 19:50:17 devstack sudo[95453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:50:18 devstack sudo[95453]: pam_unix(sudo:session): session closed for user root
Jul 02 19:50:18 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-403d33b2-d3e3-4996-984a-f121dd6b3085 tempest-VolumesCloneTest-929848012 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-12788ecb-b4b9-43c6-a2e8-f650078962a6" returned: 0 in 0.856s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:50:18 devstack cinder-volume[86639]: DEBUG cinder.utils [None req-403d33b2-d3e3-4996-984a-f121dd6b3085 tempest-VolumesCloneTest-929848012 None] Path /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-2637e053-7eed-494f-9e8f-1c8d0ffac442 not found in is_blk_device check {{(pid=86639) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 02 19:50:18 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-403d33b2-d3e3-4996-984a-f121dd6b3085 tempest-VolumesCloneTest-929848012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-12788ecb-b4b9-43c6-a2e8-f650078962a6 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-2637e053-7eed-494f-9e8f-1c8d0ffac442 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:50:18 devstack sudo[95458]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-12788ecb-b4b9-43c6-a2e8-f650078962a6 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-2637e053-7eed-494f-9e8f-1c8d0ffac442
Jul 02 19:50:18 devstack sudo[95458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:50:24 devstack cinder-volume[86639]: DEBUG dbcounter [-] [86639] Writing DB stats cinder:SELECT=59,cinder:UPDATE=78,cinder:INSERT=21,cinder:DELETE=6 {{(pid=86639) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 02 19:50:24 devstack cinder-volume[86639]: DEBUG dbcounter [-] [86639] Writing DB stats cinder:SELECT=65,cinder:UPDATE=67,cinder:INSERT=25,cinder:DELETE=6 {{(pid=86639) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 02 19:50:25 devstack sudo[95458]: pam_unix(sudo:session): session closed for user root
Jul 02 19:50:25 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-403d33b2-d3e3-4996-984a-f121dd6b3085 tempest-VolumesCloneTest-929848012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-12788ecb-b4b9-43c6-a2e8-f650078962a6 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-2637e053-7eed-494f-9e8f-1c8d0ffac442" returned: 0 in 7.435s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:50:25 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[b587d6ac-6746-406d-b6b9-5c6d1c621d21]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 19:50:25 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-403d33b2-d3e3-4996-984a-f121dd6b3085 tempest-VolumesCloneTest-929848012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-12788ecb-b4b9-43c6-a2e8-f650078962a6 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:50:26 devstack sudo[95580]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-12788ecb-b4b9-43c6-a2e8-f650078962a6
Jul 02 19:50:26 devstack sudo[95580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:50:27 devstack sudo[95580]: pam_unix(sudo:session): session closed for user root
Jul 02 19:50:27 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-403d33b2-d3e3-4996-984a-f121dd6b3085 tempest-VolumesCloneTest-929848012 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-12788ecb-b4b9-43c6-a2e8-f650078962a6" returned: 0 in 1.405s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:50:27 devstack cinder-volume[86639]: DEBUG cinder.image.image_utils [None req-403d33b2-d3e3-4996-984a-f121dd6b3085 tempest-VolumesCloneTest-929848012 None] Image conversion details: src /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-12788ecb-b4b9-43c6-a2e8-f650078962a6, size 1024.00 MB, duration 7.44 sec, destination /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-2637e053-7eed-494f-9e8f-1c8d0ffac442 {{(pid=86639) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 02 19:50:27 devstack cinder-volume[86639]: INFO cinder.image.image_utils [None req-403d33b2-d3e3-4996-984a-f121dd6b3085 tempest-VolumesCloneTest-929848012 None] Converted 1024.00 MB image at 137.70 MB/s
Jul 02 19:50:27 devstack cinder-volume[86639]: WARNING cinder.volume.drivers.remotefs [None req-403d33b2-d3e3-4996-984a-f121dd6b3085 tempest-VolumesCloneTest-929848012 None] /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-2637e053-7eed-494f-9e8f-1c8d0ffac442 is being set with open permissions: ugo+rw
Jul 02 19:50:27 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-403d33b2-d3e3-4996-984a-f121dd6b3085 tempest-VolumesCloneTest-929848012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-2637e053-7eed-494f-9e8f-1c8d0ffac442 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:50:27 devstack sudo[95585]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-2637e053-7eed-494f-9e8f-1c8d0ffac442
Jul 02 19:50:27 devstack sudo[95585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:50:28 devstack sudo[95585]: pam_unix(sudo:session): session closed for user root
Jul 02 19:50:28 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-403d33b2-d3e3-4996-984a-f121dd6b3085 tempest-VolumesCloneTest-929848012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-2637e053-7eed-494f-9e8f-1c8d0ffac442" returned: 0 in 1.131s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:50:28 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-403d33b2-d3e3-4996-984a-f121dd6b3085 tempest-VolumesCloneTest-929848012 None] Lock "cinder-quobyte-2637e053-7eed-494f-9e8f-1c8d0ffac442" released by "_copy_volume_from_snapshot" :: held 11.907s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:50:28 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-403d33b2-d3e3-4996-984a-f121dd6b3085 tempest-VolumesCloneTest-929848012 None] Acquiring lock "cinder-quobyte-16124d2b-ac20-496e-ac6e-b4f88b63de39" by "_delete_snapshot" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:50:28 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-403d33b2-d3e3-4996-984a-f121dd6b3085 tempest-VolumesCloneTest-929848012 None] Lock "cinder-quobyte-16124d2b-ac20-496e-ac6e-b4f88b63de39" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:50:28 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-403d33b2-d3e3-4996-984a-f121dd6b3085 tempest-VolumesCloneTest-929848012 None] Deleting offline snapshot 16124d2b-ac20-496e-ac6e-b4f88b63de39 of volume 12788ecb-b4b9-43c6-a2e8-f650078962a6 {{(pid=86639) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 02 19:50:28 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-403d33b2-d3e3-4996-984a-f121dd6b3085 tempest-VolumesCloneTest-929848012 None] snapshot_file for this snap is: volume-12788ecb-b4b9-43c6-a2e8-f650078962a6.16124d2b-ac20-496e-ac6e-b4f88b63de39 {{(pid=86639) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 02 19:50:28 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a5d34b0-f79d-459a-88f0-9fc5df4cd88f]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 19:50:28 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-403d33b2-d3e3-4996-984a-f121dd6b3085 tempest-VolumesCloneTest-929848012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-12788ecb-b4b9-43c6-a2e8-f650078962a6.16124d2b-ac20-496e-ac6e-b4f88b63de39 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:50:28 devstack sudo[95590]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-12788ecb-b4b9-43c6-a2e8-f650078962a6.16124d2b-ac20-496e-ac6e-b4f88b63de39
Jul 02 19:50:28 devstack sudo[95590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:50:29 devstack sudo[95590]: pam_unix(sudo:session): session closed for user root
Jul 02 19:50:29 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-403d33b2-d3e3-4996-984a-f121dd6b3085 tempest-VolumesCloneTest-929848012 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-12788ecb-b4b9-43c6-a2e8-f650078962a6.16124d2b-ac20-496e-ac6e-b4f88b63de39" returned: 0 in 1.124s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:50:29 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-403d33b2-d3e3-4996-984a-f121dd6b3085 tempest-VolumesCloneTest-929848012 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-12788ecb-b4b9-43c6-a2e8-f650078962a6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86639) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 02 19:50:29 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[1978f7e3-b59f-4bcc-81fa-064975099543]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 19:50:29 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-403d33b2-d3e3-4996-984a-f121dd6b3085 tempest-VolumesCloneTest-929848012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-12788ecb-b4b9-43c6-a2e8-f650078962a6 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:50:29 devstack sudo[95595]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-12788ecb-b4b9-43c6-a2e8-f650078962a6
Jul 02 19:50:29 devstack sudo[95595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:50:30 devstack sudo[95595]: pam_unix(sudo:session): session closed for user root
Jul 02 19:50:30 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-403d33b2-d3e3-4996-984a-f121dd6b3085 tempest-VolumesCloneTest-929848012 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-12788ecb-b4b9-43c6-a2e8-f650078962a6" returned: 0 in 1.098s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:50:30 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-403d33b2-d3e3-4996-984a-f121dd6b3085 tempest-VolumesCloneTest-929848012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-12788ecb-b4b9-43c6-a2e8-f650078962a6.16124d2b-ac20-496e-ac6e-b4f88b63de39 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:50:30 devstack sudo[95600]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-12788ecb-b4b9-43c6-a2e8-f650078962a6.16124d2b-ac20-496e-ac6e-b4f88b63de39
Jul 02 19:50:30 devstack sudo[95600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:50:31 devstack sudo[95600]: pam_unix(sudo:session): session closed for user root
Jul 02 19:50:31 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-403d33b2-d3e3-4996-984a-f121dd6b3085 tempest-VolumesCloneTest-929848012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-12788ecb-b4b9-43c6-a2e8-f650078962a6.16124d2b-ac20-496e-ac6e-b4f88b63de39" returned: 0 in 1.085s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:50:31 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-403d33b2-d3e3-4996-984a-f121dd6b3085 tempest-VolumesCloneTest-929848012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-12788ecb-b4b9-43c6-a2e8-f650078962a6.16124d2b-ac20-496e-ac6e-b4f88b63de39 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:50:32 devstack sudo[95606]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-12788ecb-b4b9-43c6-a2e8-f650078962a6.16124d2b-ac20-496e-ac6e-b4f88b63de39
Jul 02 19:50:32 devstack sudo[95606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:50:32 devstack sudo[95606]: pam_unix(sudo:session): session closed for user root
Jul 02 19:50:32 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-403d33b2-d3e3-4996-984a-f121dd6b3085 tempest-VolumesCloneTest-929848012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-12788ecb-b4b9-43c6-a2e8-f650078962a6.16124d2b-ac20-496e-ac6e-b4f88b63de39" returned: 0 in 1.015s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:50:33 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-403d33b2-d3e3-4996-984a-f121dd6b3085 tempest-VolumesCloneTest-929848012 None] Lock "cinder-quobyte-16124d2b-ac20-496e-ac6e-b4f88b63de39" released by "_delete_snapshot" :: held 4.488s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:50:33 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-403d33b2-d3e3-4996-984a-f121dd6b3085 tempest-VolumesCloneTest-929848012 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 21.647s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:50:33 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-e3f7383d-d19b-439c-a5f6-5eca6123293b tempest-VolumesCloneNegativeTest-1843016306 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 20.984s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:50:33 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-e3f7383d-d19b-439c-a5f6-5eca6123293b tempest-VolumesCloneNegativeTest-1843016306 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce906cb830>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T17:50:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1980895243',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b16aae51-20f7-4914-a553-c7c1c63bf24f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9603d684d01a45e585e88a6b29966791',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T17:50:12Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T17:50:12Z,use_quota=True,user_id='ee72588b229c440b9a39cffa81b087ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)}" {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 19:50:33 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-e3f7383d-d19b-439c-a5f6-5eca6123293b tempest-VolumesCloneNegativeTest-1843016306 None] Creating volume b16aae51-20f7-4914-a553-c7c1c63bf24f {{(pid=86639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 19:50:33 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-e3f7383d-d19b-439c-a5f6-5eca6123293b tempest-VolumesCloneNegativeTest-1843016306 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:50:33 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-e3f7383d-d19b-439c-a5f6-5eca6123293b tempest-VolumesCloneNegativeTest-1843016306 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:50:33 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-e3f7383d-d19b-439c-a5f6-5eca6123293b tempest-VolumesCloneNegativeTest-1843016306 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 19:50:33 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-e3f7383d-d19b-439c-a5f6-5eca6123293b tempest-VolumesCloneNegativeTest-1843016306 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 19:50:33 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-e3f7383d-d19b-439c-a5f6-5eca6123293b tempest-VolumesCloneNegativeTest-1843016306 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:50:33 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-e3f7383d-d19b-439c-a5f6-5eca6123293b tempest-VolumesCloneNegativeTest-1843016306 None] Selected osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92 as target Quobyte volume. {{(pid=86639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 19:50:33 devstack cinder-volume[86639]: INFO cinder.volume.drivers.remotefs [None req-e3f7383d-d19b-439c-a5f6-5eca6123293b tempest-VolumesCloneNegativeTest-1843016306 None] casted to osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92
Jul 02 19:50:33 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-e3f7383d-d19b-439c-a5f6-5eca6123293b tempest-VolumesCloneNegativeTest-1843016306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-b16aae51-20f7-4914-a553-c7c1c63bf24f 2147483648 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:50:33 devstack sudo[95623]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-b16aae51-20f7-4914-a553-c7c1c63bf24f 2147483648
Jul 02 19:50:33 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-403d33b2-d3e3-4996-984a-f121dd6b3085 tempest-VolumesCloneTest-929848012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee52350e-a648-423a-9271-1633382c7a2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2637e053-7eed-494f-9e8f-1c8d0ffac442', 'volume_size': 2, 'source_volid': '12788ecb-b4b9-43c6-a2e8-f650078962a6', 'source_volstatus': 'available'}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:50:33 devstack sudo[95623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:50:33 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-403d33b2-d3e3-4996-984a-f121dd6b3085 tempest-VolumesCloneTest-929848012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1d6571f-f82a-479e-a2c2-b50dbc19ea3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:50:33 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-403d33b2-d3e3-4996-984a-f121dd6b3085 tempest-VolumesCloneTest-929848012 None] Volume volume-2637e053-7eed-494f-9e8f-1c8d0ffac442 (2637e053-7eed-494f-9e8f-1c8d0ffac442): created successfully
Jul 02 19:50:33 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-403d33b2-d3e3-4996-984a-f121dd6b3085 tempest-VolumesCloneTest-929848012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1d6571f-f82a-479e-a2c2-b50dbc19ea3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:50:33 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-403d33b2-d3e3-4996-984a-f121dd6b3085 tempest-VolumesCloneTest-929848012 None] Flow 'volume_create_manager' (c7d4736c-0ed5-41f4-9bb6-85fac810b0d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 19:50:33 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-403d33b2-d3e3-4996-984a-f121dd6b3085 tempest-VolumesCloneTest-929848012 None] Created volume successfully.
Jul 02 19:50:33 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-3c3a06a3-f173-427c-b357-31ec9392875e tempest-VolumesCloneTest-929848012 None] Acquiring lock "cinder-2637e053-7eed-494f-9e8f-1c8d0ffac442-delete_volume" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:50:33 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-3c3a06a3-f173-427c-b357-31ec9392875e tempest-VolumesCloneTest-929848012 None] Lock "cinder-2637e053-7eed-494f-9e8f-1c8d0ffac442-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:50:33 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-3c3a06a3-f173-427c-b357-31ec9392875e tempest-VolumesCloneTest-929848012 None] Acquiring lock "cinder-quobyte-2637e053-7eed-494f-9e8f-1c8d0ffac442" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:50:33 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-3c3a06a3-f173-427c-b357-31ec9392875e tempest-VolumesCloneTest-929848012 None] Lock "cinder-quobyte-2637e053-7eed-494f-9e8f-1c8d0ffac442" acquired by "delete_volume" :: waited 0.036s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:50:33 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a8edfe8-0a44-43a0-8708-8d04479515df]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 19:50:33 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-3c3a06a3-f173-427c-b357-31ec9392875e tempest-VolumesCloneTest-929848012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-2637e053-7eed-494f-9e8f-1c8d0ffac442 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:50:34 devstack sudo[95629]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-2637e053-7eed-494f-9e8f-1c8d0ffac442
Jul 02 19:50:34 devstack sudo[95629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:50:34 devstack sudo[95623]: pam_unix(sudo:session): session closed for user root
Jul 02 19:50:34 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-e3f7383d-d19b-439c-a5f6-5eca6123293b tempest-VolumesCloneNegativeTest-1843016306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-b16aae51-20f7-4914-a553-c7c1c63bf24f 2147483648" returned: 0 in 1.414s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:50:34 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-e3f7383d-d19b-439c-a5f6-5eca6123293b tempest-VolumesCloneNegativeTest-1843016306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-b16aae51-20f7-4914-a553-c7c1c63bf24f {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:50:34 devstack sudo[95631]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-b16aae51-20f7-4914-a553-c7c1c63bf24f
Jul 02 19:50:34 devstack sudo[95631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:50:35 devstack sudo[95629]: pam_unix(sudo:session): session closed for user root
Jul 02 19:50:35 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-3c3a06a3-f173-427c-b357-31ec9392875e tempest-VolumesCloneTest-929848012 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-2637e053-7eed-494f-9e8f-1c8d0ffac442" returned: 0 in 1.838s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:50:35 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-3c3a06a3-f173-427c-b357-31ec9392875e tempest-VolumesCloneTest-929848012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-2637e053-7eed-494f-9e8f-1c8d0ffac442 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:50:35 devstack sudo[95636]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-2637e053-7eed-494f-9e8f-1c8d0ffac442
Jul 02 19:50:35 devstack sudo[95636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:50:36 devstack sudo[95631]: pam_unix(sudo:session): session closed for user root
Jul 02 19:50:36 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-e3f7383d-d19b-439c-a5f6-5eca6123293b tempest-VolumesCloneNegativeTest-1843016306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-b16aae51-20f7-4914-a553-c7c1c63bf24f" returned: 0 in 1.415s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:50:36 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-e3f7383d-d19b-439c-a5f6-5eca6123293b tempest-VolumesCloneNegativeTest-1843016306 None] <== create_volume: return (2918ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'} {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 19:50:36 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-e3f7383d-d19b-439c-a5f6-5eca6123293b tempest-VolumesCloneNegativeTest-1843016306 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.922s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:50:36 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-e3f7383d-d19b-439c-a5f6-5eca6123293b tempest-VolumesCloneNegativeTest-1843016306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dad24254-bfbf-4562-a2e8-bec6e070da7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b16aae51-20f7-4914-a553-c7c1c63bf24f', 'volume_size': 2}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:50:36 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-e3f7383d-d19b-439c-a5f6-5eca6123293b tempest-VolumesCloneNegativeTest-1843016306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da959c12-f63e-4cd4-85c1-7af4afe44b18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:50:36 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-e3f7383d-d19b-439c-a5f6-5eca6123293b tempest-VolumesCloneNegativeTest-1843016306 None] Volume volume-b16aae51-20f7-4914-a553-c7c1c63bf24f (b16aae51-20f7-4914-a553-c7c1c63bf24f): created successfully
Jul 02 19:50:36 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-e3f7383d-d19b-439c-a5f6-5eca6123293b tempest-VolumesCloneNegativeTest-1843016306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da959c12-f63e-4cd4-85c1-7af4afe44b18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:50:36 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-e3f7383d-d19b-439c-a5f6-5eca6123293b tempest-VolumesCloneNegativeTest-1843016306 None] Flow 'volume_create_manager' (85645083-65cb-45eb-9185-9ff592a013cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 19:50:36 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-e3f7383d-d19b-439c-a5f6-5eca6123293b tempest-VolumesCloneNegativeTest-1843016306 None] Created volume successfully.
Jul 02 19:50:36 devstack sudo[95636]: pam_unix(sudo:session): session closed for user root
Jul 02 19:50:36 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-3c3a06a3-f173-427c-b357-31ec9392875e tempest-VolumesCloneTest-929848012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-2637e053-7eed-494f-9e8f-1c8d0ffac442" returned: 0 in 0.849s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:50:36 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-3c3a06a3-f173-427c-b357-31ec9392875e tempest-VolumesCloneTest-929848012 None] Lock "cinder-quobyte-2637e053-7eed-494f-9e8f-1c8d0ffac442" released by "delete_volume" :: held 2.742s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:50:36 devstack cinder-volume[86639]: DEBUG cinder.quota [None req-3c3a06a3-f173-427c-b357-31ec9392875e tempest-VolumesCloneTest-929848012 None] Created reservations ['57e95b95-fefd-4525-8b4b-b6970636af50', '87c40a50-535e-4bdf-ade3-d2d05ee467fc', 'cd491214-86ef-4e41-aff1-3893298b29b8', '990b09e5-6698-479d-a07d-39627b211573'] {{(pid=86639) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 19:50:36 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-3c3a06a3-f173-427c-b357-31ec9392875e tempest-VolumesCloneTest-929848012 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:50:36 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-3c3a06a3-f173-427c-b357-31ec9392875e tempest-VolumesCloneTest-929848012 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:50:36 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-3c3a06a3-f173-427c-b357-31ec9392875e tempest-VolumesCloneTest-929848012 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 19:50:36 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-3c3a06a3-f173-427c-b357-31ec9392875e tempest-VolumesCloneTest-929848012 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 19:50:36 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-3c3a06a3-f173-427c-b357-31ec9392875e tempest-VolumesCloneTest-929848012 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:50:36 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-3c3a06a3-f173-427c-b357-31ec9392875e tempest-VolumesCloneTest-929848012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:50:36 devstack sudo[95640]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e
Jul 02 19:50:36 devstack sudo[95640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:50:36 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-050804f2-99d2-48fd-948a-214b56c303ad tempest-VolumesCloneNegativeTest-1843016306 None] Acquiring lock "cinder-b16aae51-20f7-4914-a553-c7c1c63bf24f-delete_volume" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:50:37 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-050804f2-99d2-48fd-948a-214b56c303ad tempest-VolumesCloneNegativeTest-1843016306 None] Lock "cinder-b16aae51-20f7-4914-a553-c7c1c63bf24f-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:50:37 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-050804f2-99d2-48fd-948a-214b56c303ad tempest-VolumesCloneNegativeTest-1843016306 None] Acquiring lock "cinder-quobyte-b16aae51-20f7-4914-a553-c7c1c63bf24f" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:50:37 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-050804f2-99d2-48fd-948a-214b56c303ad tempest-VolumesCloneNegativeTest-1843016306 None] Lock "cinder-quobyte-b16aae51-20f7-4914-a553-c7c1c63bf24f" acquired by "delete_volume" :: waited 0.049s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:50:37 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d5b7847-88bf-4530-897b-fe84fa556aca]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 19:50:37 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-050804f2-99d2-48fd-948a-214b56c303ad tempest-VolumesCloneNegativeTest-1843016306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-b16aae51-20f7-4914-a553-c7c1c63bf24f {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:50:37 devstack sudo[95642]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-b16aae51-20f7-4914-a553-c7c1c63bf24f
Jul 02 19:50:37 devstack sudo[95642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:50:37 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-03c1e95a-deb2-4648-9d7c-800365e57099 tempest-VolumesCloneTest-929848012 None] Acquiring lock "cinder-12788ecb-b4b9-43c6-a2e8-f650078962a6-delete_volume" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:50:37 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-03c1e95a-deb2-4648-9d7c-800365e57099 tempest-VolumesCloneTest-929848012 None] Lock "cinder-12788ecb-b4b9-43c6-a2e8-f650078962a6-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:50:37 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-03c1e95a-deb2-4648-9d7c-800365e57099 tempest-VolumesCloneTest-929848012 None] Acquiring lock "cinder-quobyte-12788ecb-b4b9-43c6-a2e8-f650078962a6" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:50:37 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-03c1e95a-deb2-4648-9d7c-800365e57099 tempest-VolumesCloneTest-929848012 None] Lock "cinder-quobyte-12788ecb-b4b9-43c6-a2e8-f650078962a6" acquired by "delete_volume" :: waited 0.030s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:50:37 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f0b967b-7cfd-417f-b243-b40b45bf316f]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 19:50:37 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-03c1e95a-deb2-4648-9d7c-800365e57099 tempest-VolumesCloneTest-929848012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-12788ecb-b4b9-43c6-a2e8-f650078962a6 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:50:38 devstack sudo[95669]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-12788ecb-b4b9-43c6-a2e8-f650078962a6
Jul 02 19:50:38 devstack sudo[95669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:50:38 devstack sudo[95640]: pam_unix(sudo:session): session closed for user root
Jul 02 19:50:38 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-3c3a06a3-f173-427c-b357-31ec9392875e tempest-VolumesCloneTest-929848012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e" returned: 0 in 1.238s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:50:38 devstack cinder-volume[86639]: DEBUG cinder.manager [None req-3c3a06a3-f173-427c-b357-31ec9392875e tempest-VolumesCloneTest-929848012 None] Notifying Schedulers of capabilities ... {{(pid=86639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 19:50:38 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-3c3a06a3-f173-427c-b357-31ec9392875e tempest-VolumesCloneTest-929848012 None] Deleted volume successfully.
Jul 02 19:50:38 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-3c3a06a3-f173-427c-b357-31ec9392875e tempest-VolumesCloneTest-929848012 None] Lock "cinder-2637e053-7eed-494f-9e8f-1c8d0ffac442-delete_volume" released by "delete_volume" :: held 4.362s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:50:38 devstack sudo[95642]: pam_unix(sudo:session): session closed for user root
Jul 02 19:50:38 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-050804f2-99d2-48fd-948a-214b56c303ad tempest-VolumesCloneNegativeTest-1843016306 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-b16aae51-20f7-4914-a553-c7c1c63bf24f" returned: 0 in 1.219s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:50:38 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-050804f2-99d2-48fd-948a-214b56c303ad tempest-VolumesCloneNegativeTest-1843016306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-b16aae51-20f7-4914-a553-c7c1c63bf24f {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:50:38 devstack sudo[95674]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-b16aae51-20f7-4914-a553-c7c1c63bf24f
Jul 02 19:50:38 devstack sudo[95674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:50:38 devstack sudo[95669]: pam_unix(sudo:session): session closed for user root
Jul 02 19:50:38 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-03c1e95a-deb2-4648-9d7c-800365e57099 tempest-VolumesCloneTest-929848012 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-12788ecb-b4b9-43c6-a2e8-f650078962a6" returned: 0 in 0.926s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:50:38 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-03c1e95a-deb2-4648-9d7c-800365e57099 tempest-VolumesCloneTest-929848012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-12788ecb-b4b9-43c6-a2e8-f650078962a6 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:50:38 devstack sudo[95679]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-12788ecb-b4b9-43c6-a2e8-f650078962a6
Jul 02 19:50:38 devstack sudo[95679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:50:39 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-050804f2-99d2-48fd-948a-214b56c303ad tempest-VolumesCloneNegativeTest-1843016306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-b16aae51-20f7-4914-a553-c7c1c63bf24f" returned: 0 in 0.717s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:50:39 devstack sudo[95674]: pam_unix(sudo:session): session closed for user root
Jul 02 19:50:39 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-050804f2-99d2-48fd-948a-214b56c303ad tempest-VolumesCloneNegativeTest-1843016306 None] Lock "cinder-quobyte-b16aae51-20f7-4914-a553-c7c1c63bf24f" released by "delete_volume" :: held 2.023s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:50:39 devstack cinder-volume[86639]: DEBUG cinder.quota [None req-050804f2-99d2-48fd-948a-214b56c303ad tempest-VolumesCloneNegativeTest-1843016306 None] Created reservations ['b05d7cd0-f3de-4f45-80c3-d4b79da29a02', 'd627d1f0-891e-48f1-883e-e77dabbfd771', 'd23aae63-af61-435e-b1a8-d1ae08b08f10', 'e002f995-e9e3-411a-8077-9c60ef59299f'] {{(pid=86639) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 19:50:39 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-050804f2-99d2-48fd-948a-214b56c303ad tempest-VolumesCloneNegativeTest-1843016306 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:50:39 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-050804f2-99d2-48fd-948a-214b56c303ad tempest-VolumesCloneNegativeTest-1843016306 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:50:39 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-050804f2-99d2-48fd-948a-214b56c303ad tempest-VolumesCloneNegativeTest-1843016306 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 19:50:39 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-050804f2-99d2-48fd-948a-214b56c303ad tempest-VolumesCloneNegativeTest-1843016306 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 19:50:39 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-050804f2-99d2-48fd-948a-214b56c303ad tempest-VolumesCloneNegativeTest-1843016306 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:50:39 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-050804f2-99d2-48fd-948a-214b56c303ad tempest-VolumesCloneNegativeTest-1843016306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:50:39 devstack sudo[95682]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e
Jul 02 19:50:39 devstack sudo[95682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:50:39 devstack sudo[95679]: pam_unix(sudo:session): session closed for user root
Jul 02 19:50:39 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-03c1e95a-deb2-4648-9d7c-800365e57099 tempest-VolumesCloneTest-929848012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-12788ecb-b4b9-43c6-a2e8-f650078962a6" returned: 0 in 0.727s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:50:39 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-03c1e95a-deb2-4648-9d7c-800365e57099 tempest-VolumesCloneTest-929848012 None] Lock "cinder-quobyte-12788ecb-b4b9-43c6-a2e8-f650078962a6" released by "delete_volume" :: held 1.770s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:50:39 devstack cinder-volume[86639]: DEBUG cinder.quota [None req-03c1e95a-deb2-4648-9d7c-800365e57099 tempest-VolumesCloneTest-929848012 None] Created reservations ['168b6ce3-24d2-4c35-83f2-1fc018015f4c', '50c3b437-0fae-40fe-8fb5-e8175e5ce1ce', 'd1b0a792-684d-43b3-ae18-dab1b290d52b', '33c16562-32db-4fb8-8317-cd4bcc7ca38e'] {{(pid=86639) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 19:50:39 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-03c1e95a-deb2-4648-9d7c-800365e57099 tempest-VolumesCloneTest-929848012 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:50:39 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-03c1e95a-deb2-4648-9d7c-800365e57099 tempest-VolumesCloneTest-929848012 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:50:39 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-03c1e95a-deb2-4648-9d7c-800365e57099 tempest-VolumesCloneTest-929848012 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 19:50:39 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-03c1e95a-deb2-4648-9d7c-800365e57099 tempest-VolumesCloneTest-929848012 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 19:50:39 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-03c1e95a-deb2-4648-9d7c-800365e57099 tempest-VolumesCloneTest-929848012 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:50:39 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-03c1e95a-deb2-4648-9d7c-800365e57099 tempest-VolumesCloneTest-929848012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:50:39 devstack sudo[95685]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e
Jul 02 19:50:39 devstack sudo[95685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:50:40 devstack sudo[95682]: pam_unix(sudo:session): session closed for user root
Jul 02 19:50:40 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-050804f2-99d2-48fd-948a-214b56c303ad tempest-VolumesCloneNegativeTest-1843016306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e" returned: 0 in 1.060s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:50:40 devstack cinder-volume[86639]: DEBUG cinder.manager [None req-050804f2-99d2-48fd-948a-214b56c303ad tempest-VolumesCloneNegativeTest-1843016306 None] Notifying Schedulers of capabilities ... {{(pid=86639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 19:50:40 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-050804f2-99d2-48fd-948a-214b56c303ad tempest-VolumesCloneNegativeTest-1843016306 None] Deleted volume successfully.
Jul 02 19:50:40 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-050804f2-99d2-48fd-948a-214b56c303ad tempest-VolumesCloneNegativeTest-1843016306 None] Lock "cinder-b16aae51-20f7-4914-a553-c7c1c63bf24f-delete_volume" released by "delete_volume" :: held 3.413s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:50:40 devstack sudo[95685]: pam_unix(sudo:session): session closed for user root
Jul 02 19:50:40 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-03c1e95a-deb2-4648-9d7c-800365e57099 tempest-VolumesCloneTest-929848012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e" returned: 0 in 0.849s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:50:40 devstack cinder-volume[86639]: DEBUG cinder.manager [None req-03c1e95a-deb2-4648-9d7c-800365e57099 tempest-VolumesCloneTest-929848012 None] Notifying Schedulers of capabilities ... {{(pid=86639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 19:50:40 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-03c1e95a-deb2-4648-9d7c-800365e57099 tempest-VolumesCloneTest-929848012 None] Deleted volume successfully.
Jul 02 19:50:40 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-03c1e95a-deb2-4648-9d7c-800365e57099 tempest-VolumesCloneTest-929848012 None] Lock "cinder-12788ecb-b4b9-43c6-a2e8-f650078962a6-delete_volume" released by "delete_volume" :: held 2.935s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:50:41 devstack cinder-volume[86639]: DEBUG oslo_service.periodic_task [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86639) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 02 19:50:41 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:50:41 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:50:41 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 19:50:41 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 19:50:41 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:50:41 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:50:41 devstack sudo[95689]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e
Jul 02 19:50:41 devstack sudo[95689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:50:42 devstack sudo[95689]: pam_unix(sudo:session): session closed for user root
Jul 02 19:50:42 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e" returned: 0 in 0.983s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:50:42 devstack cinder-volume[86639]: DEBUG cinder.manager [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] Notifying Schedulers of capabilities ... {{(pid=86639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 19:50:42 devstack cinder-volume[86639]: DEBUG oslo_service.periodic_task [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] Running periodic task VolumeManager._thread_info {{(pid=86639) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 02 19:50:42 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] thread count: 28 {{(pid=86639) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 02 19:50:42 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] thread info: [<_MainThread(MainThread, started 140525261275264)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 140525150678016)>, <Thread(Thread-3 (stat_writer), started daemon 140525150025920)>, <Thread(Rabbit-heartbeat, started daemon 140525150500864)>, <Thread(Thread-5 (_runner), started daemon 140525149847296)>, <Thread(Thread-7 (_runner), started daemon 140525149863424)>, <Thread(fd_logger, started daemon 140525146589376)>, <Thread(privsep_reader, started daemon 140525144562432)>, <Thread(tpool_thread_0, started daemon 140525137151680)>, <Thread(tpool_thread_1, started daemon 140525128758976)>, <Thread(tpool_thread_2, started daemon 140525120349888)>, <Thread(tpool_thread_3, started daemon 140525111940800)>, <Thread(tpool_thread_4, started daemon 140525103531712)>, <Thread(tpool_thread_5, started daemon 140525095122624)>, <Thread(tpool_thread_6, started daemon 140525086713536)>, <Thread(tpool_thread_7, started daemon 140525078304448)>, <Thread(tpool_thread_8, started daemon 140525069895360)>, <Thread(tpool_thread_9, started daemon 140525061486272)>, <Thread(tpool_thread_10, started daemon 140525053077184)>, <Thread(tpool_thread_11, started daemon 140525044668096)>, <Thread(tpool_thread_12, started daemon 140525036259008)>, <Thread(tpool_thread_13, started daemon 140525027849920)>, <Thread(tpool_thread_14, started daemon 140525019440832)>, <Thread(tpool_thread_15, started daemon 140525011031744)>, <Thread(tpool_thread_16, started daemon 140525002622656)>, <Thread(tpool_thread_17, started daemon 140524994213568)>, <Thread(tpool_thread_18, started daemon 140524985804480)>, <Thread(tpool_thread_19, started daemon 140524977395392)>] {{(pid=86639) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 02 19:50:44 devstack cinder-volume[86639]: DEBUG cinder.volume.flows.manager.create_volume [None req-453d4992-7f3a-4c75-810f-f43a6c5811eb tempest-VolumesExtendTest-772492329 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 19:50:44 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-453d4992-7f3a-4c75-810f-f43a6c5811eb tempest-VolumesExtendTest-772492329 None] Flow 'volume_create_manager' (b2d95828-6ae4-4c7d-b0a7-460c459b3919) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 19:50:44 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-453d4992-7f3a-4c75-810f-f43a6c5811eb tempest-VolumesExtendTest-772492329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23898743-6f20-4733-aa2a-a4dc9f5db1ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:50:44 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-453d4992-7f3a-4c75-810f-f43a6c5811eb tempest-VolumesExtendTest-772492329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23898743-6f20-4733-aa2a-a4dc9f5db1ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T17:50:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-550726070',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c5a2ba1-4443-4706-a9df-60b8520b4604,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3384f34d39640e8a617fe9125662a45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T17:50:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T17:50:45Z,use_quota=True,user_id='125ea1b3efb14d4fbc56bca4292ac635',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:50:44 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-453d4992-7f3a-4c75-810f-f43a6c5811eb tempest-VolumesExtendTest-772492329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ddee939-972f-4cd2-85cf-04716f2acfef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:50:44 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-453d4992-7f3a-4c75-810f-f43a6c5811eb tempest-VolumesExtendTest-772492329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ddee939-972f-4cd2-85cf-04716f2acfef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:50:44 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-453d4992-7f3a-4c75-810f-f43a6c5811eb tempest-VolumesExtendTest-772492329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25ad8e14-c68e-4f69-aaf6-b6deb1db173c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:50:44 devstack cinder-volume[86639]: DEBUG cinder.image.glance [None req-453d4992-7f3a-4c75-810f-f43a6c5811eb tempest-VolumesExtendTest-772492329 None] Creating Keystone auth plugin from conf {{(pid=86639) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jul 02 19:50:45 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-453d4992-7f3a-4c75-810f-f43a6c5811eb tempest-VolumesExtendTest-772492329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25ad8e14-c68e-4f69-aaf6-b6deb1db173c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '2c5a2ba1-4443-4706-a9df-60b8520b4604', 'volume_name': 'volume-2c5a2ba1-4443-4706-a9df-60b8520b4604', 'volume_size': 1, 'image_id': 'a2dc855a-b708-430d-973d-a136c6e54873', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a2dc855a-b708-430d-973d-a136c6e54873', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b6fd8f5b5bb142078118935d5734f463', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a2dc855a-b708-430d-973d-a136c6e54873', 'created_at': datetime.datetime(2026, 7, 2, 17, 34, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 2, 17, 34, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a2dc855a-b708-430d-973d-a136c6e54873/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fce8f262480>}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:50:45 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-453d4992-7f3a-4c75-810f-f43a6c5811eb tempest-VolumesExtendTest-772492329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b926ae53-baf8-427e-9912-5c2f389a328d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:50:45 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-453d4992-7f3a-4c75-810f-f43a6c5811eb tempest-VolumesExtendTest-772492329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b926ae53-baf8-427e-9912-5c2f389a328d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:50:45 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-453d4992-7f3a-4c75-810f-f43a6c5811eb tempest-VolumesExtendTest-772492329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e994ef99-7374-4299-8d6f-16dbad4faa52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:50:45 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-453d4992-7f3a-4c75-810f-f43a6c5811eb tempest-VolumesExtendTest-772492329 None] Volume 2c5a2ba1-4443-4706-a9df-60b8520b4604: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-2c5a2ba1-4443-4706-a9df-60b8520b4604', 'volume_size': 1, 'image_id': 'a2dc855a-b708-430d-973d-a136c6e54873', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a2dc855a-b708-430d-973d-a136c6e54873', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b6fd8f5b5bb142078118935d5734f463', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a2dc855a-b708-430d-973d-a136c6e54873', 'created_at': datetime.datetime(2026, 7, 2, 17, 34, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 2, 17, 34, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a2dc855a-b708-430d-973d-a136c6e54873/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fce8f262480>}
Jul 02 19:50:45 devstack cinder-volume[86639]: DEBUG cinder.volume.flows.manager.create_volume [None req-453d4992-7f3a-4c75-810f-f43a6c5811eb tempest-VolumesExtendTest-772492329 None] Trying to clone 2c5a2ba1-4443-4706-a9df-60b8520b4604 from image a2dc855a-b708-430d-973d-a136c6e54873 at location (None, [{'url': 'file:///opt/stack/data/glance/images/a2dc855a-b708-430d-973d-a136c6e54873', 'metadata': {}}]). {{(pid=86639) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jul 02 19:50:45 devstack cinder-volume[86639]: DEBUG cinder.image.image_utils [None req-453d4992-7f3a-4c75-810f-f43a6c5811eb tempest-VolumesExtendTest-772492329 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_a2dc855a-b708-430d-973d-a136c6e54873_mkjt3flqdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86639) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jul 02 19:50:45 devstack cinder-volume[86639]: INFO cinder.image.image_utils [None req-453d4992-7f3a-4c75-810f-f43a6c5811eb tempest-VolumesExtendTest-772492329 None] Image download 20.69 MB at 20.69 MB/s
Jul 02 19:50:45 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[40d1d128-a0d3-4200-b7d1-d5fc2d28c9bf]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 19:50:45 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-453d4992-7f3a-4c75-810f-f43a6c5811eb tempest-VolumesExtendTest-772492329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a2dc855a-b708-430d-973d-a136c6e54873_mkjt3flqdevstack@QuobyteHD {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:50:45 devstack sudo[95694]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a2dc855a-b708-430d-973d-a136c6e54873_mkjt3flqdevstack@QuobyteHD
Jul 02 19:50:45 devstack sudo[95694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:50:46 devstack sudo[95694]: pam_unix(sudo:session): session closed for user root
Jul 02 19:50:46 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-453d4992-7f3a-4c75-810f-f43a6c5811eb tempest-VolumesExtendTest-772492329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a2dc855a-b708-430d-973d-a136c6e54873_mkjt3flqdevstack@QuobyteHD" returned: 0 in 0.923s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:50:46 devstack cinder-volume[86639]: DEBUG cinder.image.image_utils [None req-453d4992-7f3a-4c75-810f-f43a6c5811eb tempest-VolumesExtendTest-772492329 None] Temporary image a2dc855a-b708-430d-973d-a136c6e54873 is fetched for user 125ea1b3efb14d4fbc56bca4292ac635. {{(pid=86639) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jul 02 19:50:46 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ea2d56d-2141-471c-aeda-edcbd4c1ee96]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 19:50:46 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-453d4992-7f3a-4c75-810f-f43a6c5811eb tempest-VolumesExtendTest-772492329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a2dc855a-b708-430d-973d-a136c6e54873_mkjt3flqdevstack@QuobyteHD {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:50:46 devstack sudo[95699]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a2dc855a-b708-430d-973d-a136c6e54873_mkjt3flqdevstack@QuobyteHD
Jul 02 19:50:46 devstack sudo[95699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:50:47 devstack sudo[95699]: pam_unix(sudo:session): session closed for user root
Jul 02 19:50:47 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-453d4992-7f3a-4c75-810f-f43a6c5811eb tempest-VolumesExtendTest-772492329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a2dc855a-b708-430d-973d-a136c6e54873_mkjt3flqdevstack@QuobyteHD" returned: 0 in 0.832s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:50:47 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-453d4992-7f3a-4c75-810f-f43a6c5811eb tempest-VolumesExtendTest-772492329 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:50:47 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-453d4992-7f3a-4c75-810f-f43a6c5811eb tempest-VolumesExtendTest-772492329 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:50:47 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-453d4992-7f3a-4c75-810f-f43a6c5811eb tempest-VolumesExtendTest-772492329 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce906cb830>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T17:50:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-550726070',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c5a2ba1-4443-4706-a9df-60b8520b4604,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3384f34d39640e8a617fe9125662a45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T17:50:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T17:50:45Z,use_quota=True,user_id='125ea1b3efb14d4fbc56bca4292ac635',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)}" {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 19:50:47 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-453d4992-7f3a-4c75-810f-f43a6c5811eb tempest-VolumesExtendTest-772492329 None] Creating volume 2c5a2ba1-4443-4706-a9df-60b8520b4604 {{(pid=86639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 19:50:47 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-453d4992-7f3a-4c75-810f-f43a6c5811eb tempest-VolumesExtendTest-772492329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:50:47 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-453d4992-7f3a-4c75-810f-f43a6c5811eb tempest-VolumesExtendTest-772492329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:50:47 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-453d4992-7f3a-4c75-810f-f43a6c5811eb tempest-VolumesExtendTest-772492329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 19:50:47 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-453d4992-7f3a-4c75-810f-f43a6c5811eb tempest-VolumesExtendTest-772492329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 19:50:47 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-453d4992-7f3a-4c75-810f-f43a6c5811eb tempest-VolumesExtendTest-772492329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:50:47 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-453d4992-7f3a-4c75-810f-f43a6c5811eb tempest-VolumesExtendTest-772492329 None] Selected osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92 as target Quobyte volume. {{(pid=86639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 19:50:47 devstack cinder-volume[86639]: INFO cinder.volume.drivers.remotefs [None req-453d4992-7f3a-4c75-810f-f43a6c5811eb tempest-VolumesExtendTest-772492329 None] casted to osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92
Jul 02 19:50:47 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-453d4992-7f3a-4c75-810f-f43a6c5811eb tempest-VolumesExtendTest-772492329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-2c5a2ba1-4443-4706-a9df-60b8520b4604 1073741824 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:50:47 devstack sudo[95705]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-2c5a2ba1-4443-4706-a9df-60b8520b4604 1073741824
Jul 02 19:50:47 devstack sudo[95705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:50:48 devstack sudo[95705]: pam_unix(sudo:session): session closed for user root
Jul 02 19:50:48 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-453d4992-7f3a-4c75-810f-f43a6c5811eb tempest-VolumesExtendTest-772492329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-2c5a2ba1-4443-4706-a9df-60b8520b4604 1073741824" returned: 0 in 1.191s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:50:48 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-453d4992-7f3a-4c75-810f-f43a6c5811eb tempest-VolumesExtendTest-772492329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-2c5a2ba1-4443-4706-a9df-60b8520b4604 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:50:48 devstack sudo[95712]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-2c5a2ba1-4443-4706-a9df-60b8520b4604
Jul 02 19:50:48 devstack sudo[95712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:50:49 devstack sudo[95712]: pam_unix(sudo:session): session closed for user root
Jul 02 19:50:49 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-453d4992-7f3a-4c75-810f-f43a6c5811eb tempest-VolumesExtendTest-772492329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-2c5a2ba1-4443-4706-a9df-60b8520b4604" returned: 0 in 1.036s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:50:49 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-453d4992-7f3a-4c75-810f-f43a6c5811eb tempest-VolumesExtendTest-772492329 None] <== create_volume: return (2288ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'} {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 19:50:49 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-453d4992-7f3a-4c75-810f-f43a6c5811eb tempest-VolumesExtendTest-772492329 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.292s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:50:49 devstack cinder-volume[86639]: DEBUG cinder.volume.volume_utils [None req-453d4992-7f3a-4c75-810f-f43a6c5811eb tempest-VolumesExtendTest-772492329 None] Attempting download of a2dc855a-b708-430d-973d-a136c6e54873 ((None, [{'url': 'file:///opt/stack/data/glance/images/a2dc855a-b708-430d-973d-a136c6e54873', 'metadata': {}}])) to volume 2c5a2ba1-4443-4706-a9df-60b8520b4604. {{(pid=86639) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jul 02 19:50:49 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e520947-adc9-4840-9c56-b394fb7566bf]: (4, 'raw') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 19:50:49 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-453d4992-7f3a-4c75-810f-f43a6c5811eb tempest-VolumesExtendTest-772492329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a2dc855a-b708-430d-973d-a136c6e54873_8jgkwp_h {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:50:50 devstack sudo[95715]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a2dc855a-b708-430d-973d-a136c6e54873_8jgkwp_h
Jul 02 19:50:50 devstack sudo[95715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:50:50 devstack sudo[95715]: pam_unix(sudo:session): session closed for user root
Jul 02 19:50:50 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-453d4992-7f3a-4c75-810f-f43a6c5811eb tempest-VolumesExtendTest-772492329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a2dc855a-b708-430d-973d-a136c6e54873_8jgkwp_h" returned: 0 in 0.981s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:50:50 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-453d4992-7f3a-4c75-810f-f43a6c5811eb tempest-VolumesExtendTest-772492329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a2dc855a-b708-430d-973d-a136c6e54873_8jgkwp_h {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:50:51 devstack sudo[95722]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a2dc855a-b708-430d-973d-a136c6e54873_8jgkwp_h
Jul 02 19:50:51 devstack sudo[95722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:50:51 devstack sudo[95722]: pam_unix(sudo:session): session closed for user root
Jul 02 19:50:51 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-453d4992-7f3a-4c75-810f-f43a6c5811eb tempest-VolumesExtendTest-772492329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a2dc855a-b708-430d-973d-a136c6e54873_8jgkwp_h" returned: 1 in 0.893s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:50:51 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-453d4992-7f3a-4c75-810f-f43a6c5811eb tempest-VolumesExtendTest-772492329 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a2dc855a-b708-430d-973d-a136c6e54873_8jgkwp_h' failed. Not Retrying. {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 02 19:50:51 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[460abe71-3ae6-4685-a300-a7c407fc3260]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 19:50:51 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-453d4992-7f3a-4c75-810f-f43a6c5811eb tempest-VolumesExtendTest-772492329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a2dc855a-b708-430d-973d-a136c6e54873_mkjt3flqdevstack@QuobyteHD {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:50:52 devstack sudo[95726]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a2dc855a-b708-430d-973d-a136c6e54873_mkjt3flqdevstack@QuobyteHD
Jul 02 19:50:52 devstack sudo[95726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:50:52 devstack sudo[95726]: pam_unix(sudo:session): session closed for user root
Jul 02 19:50:52 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-453d4992-7f3a-4c75-810f-f43a6c5811eb tempest-VolumesExtendTest-772492329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a2dc855a-b708-430d-973d-a136c6e54873_mkjt3flqdevstack@QuobyteHD" returned: 0 in 0.892s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:50:52 devstack cinder-volume[86639]: DEBUG cinder.image.image_utils [None req-453d4992-7f3a-4c75-810f-f43a6c5811eb tempest-VolumesExtendTest-772492329 None] a2dc855a-b708-430d-973d-a136c6e54873 was qcow2, converting to raw {{(pid=86639) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jul 02 19:50:52 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-453d4992-7f3a-4c75-810f-f43a6c5811eb tempest-VolumesExtendTest-772492329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a2dc855a-b708-430d-973d-a136c6e54873_mkjt3flqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-2c5a2ba1-4443-4706-a9df-60b8520b4604 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:50:52 devstack sudo[95734]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a2dc855a-b708-430d-973d-a136c6e54873_mkjt3flqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-2c5a2ba1-4443-4706-a9df-60b8520b4604
Jul 02 19:50:52 devstack sudo[95734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:50:55 devstack cinder-volume[86639]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d963441-7155-49ca-93ef-dd1024ef92cc tempest-AttachVolumeNegativeTest-732301193 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 19:50:55 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-7d963441-7155-49ca-93ef-dd1024ef92cc tempest-AttachVolumeNegativeTest-732301193 None] Flow 'volume_create_manager' (3e70c97a-dc06-4051-960a-a9727c25d6dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 19:50:55 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-7d963441-7155-49ca-93ef-dd1024ef92cc tempest-AttachVolumeNegativeTest-732301193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b76de4c-77d3-4275-bc75-251889e51a71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:50:55 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-7d963441-7155-49ca-93ef-dd1024ef92cc tempest-AttachVolumeNegativeTest-732301193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b76de4c-77d3-4275-bc75-251889e51a71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T17:50:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1711411815',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=685e72a6-174e-4aeb-b099-dec20f9da2f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07c1a061c5c147f690026cea928da2e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T17:50:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T17:50:55Z,use_quota=True,user_id='3be7789436f643fe94460f153a717254',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:50:55 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-7d963441-7155-49ca-93ef-dd1024ef92cc tempest-AttachVolumeNegativeTest-732301193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3f9a9b4-dc35-4f98-be53-ad8973dc74d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:50:55 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-7d963441-7155-49ca-93ef-dd1024ef92cc tempest-AttachVolumeNegativeTest-732301193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3f9a9b4-dc35-4f98-be53-ad8973dc74d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:50:55 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-7d963441-7155-49ca-93ef-dd1024ef92cc tempest-AttachVolumeNegativeTest-732301193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68eebaba-64a5-47e7-ba30-2133c9d76360) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:50:55 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-7d963441-7155-49ca-93ef-dd1024ef92cc tempest-AttachVolumeNegativeTest-732301193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68eebaba-64a5-47e7-ba30-2133c9d76360) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '685e72a6-174e-4aeb-b099-dec20f9da2f1', 'volume_name': 'volume-685e72a6-174e-4aeb-b099-dec20f9da2f1', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:50:55 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-7d963441-7155-49ca-93ef-dd1024ef92cc tempest-AttachVolumeNegativeTest-732301193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c04d4615-1352-4f34-bb57-a87ef3a15c1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:50:55 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-7d963441-7155-49ca-93ef-dd1024ef92cc tempest-AttachVolumeNegativeTest-732301193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c04d4615-1352-4f34-bb57-a87ef3a15c1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:50:55 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-7d963441-7155-49ca-93ef-dd1024ef92cc tempest-AttachVolumeNegativeTest-732301193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc6c3afe-0184-4125-a984-f93bb7c674bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:50:55 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-7d963441-7155-49ca-93ef-dd1024ef92cc tempest-AttachVolumeNegativeTest-732301193 None] Volume 685e72a6-174e-4aeb-b099-dec20f9da2f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-685e72a6-174e-4aeb-b099-dec20f9da2f1', 'volume_size': 1}
Jul 02 19:50:55 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-7d963441-7155-49ca-93ef-dd1024ef92cc tempest-AttachVolumeNegativeTest-732301193 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:50:55 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-7d963441-7155-49ca-93ef-dd1024ef92cc tempest-AttachVolumeNegativeTest-732301193 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:50:55 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-7d963441-7155-49ca-93ef-dd1024ef92cc tempest-AttachVolumeNegativeTest-732301193 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce906cb830>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T17:50:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1711411815',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=685e72a6-174e-4aeb-b099-dec20f9da2f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07c1a061c5c147f690026cea928da2e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T17:50:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T17:50:55Z,use_quota=True,user_id='3be7789436f643fe94460f153a717254',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)}" {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 19:50:55 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-7d963441-7155-49ca-93ef-dd1024ef92cc tempest-AttachVolumeNegativeTest-732301193 None] Creating volume 685e72a6-174e-4aeb-b099-dec20f9da2f1 {{(pid=86639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 19:50:55 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-7d963441-7155-49ca-93ef-dd1024ef92cc tempest-AttachVolumeNegativeTest-732301193 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:50:55 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-7d963441-7155-49ca-93ef-dd1024ef92cc tempest-AttachVolumeNegativeTest-732301193 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:50:55 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-7d963441-7155-49ca-93ef-dd1024ef92cc tempest-AttachVolumeNegativeTest-732301193 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 19:50:55 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-7d963441-7155-49ca-93ef-dd1024ef92cc tempest-AttachVolumeNegativeTest-732301193 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 19:50:55 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-7d963441-7155-49ca-93ef-dd1024ef92cc tempest-AttachVolumeNegativeTest-732301193 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:50:55 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-7d963441-7155-49ca-93ef-dd1024ef92cc tempest-AttachVolumeNegativeTest-732301193 None] Selected osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92 as target Quobyte volume. {{(pid=86639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 19:50:55 devstack cinder-volume[86639]: INFO cinder.volume.drivers.remotefs [None req-7d963441-7155-49ca-93ef-dd1024ef92cc tempest-AttachVolumeNegativeTest-732301193 None] casted to osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92
Jul 02 19:50:55 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-7d963441-7155-49ca-93ef-dd1024ef92cc tempest-AttachVolumeNegativeTest-732301193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-685e72a6-174e-4aeb-b099-dec20f9da2f1 1073741824 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:50:55 devstack sudo[95746]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-685e72a6-174e-4aeb-b099-dec20f9da2f1 1073741824
Jul 02 19:50:55 devstack sudo[95746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:50:55 devstack sudo[95734]: pam_unix(sudo:session): session closed for user root
Jul 02 19:50:55 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-453d4992-7f3a-4c75-810f-f43a6c5811eb tempest-VolumesExtendTest-772492329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a2dc855a-b708-430d-973d-a136c6e54873_mkjt3flqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-2c5a2ba1-4443-4706-a9df-60b8520b4604" returned: 0 in 2.722s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:50:55 devstack cinder-volume[86639]: DEBUG cinder.image.image_utils [None req-453d4992-7f3a-4c75-810f-f43a6c5811eb tempest-VolumesExtendTest-772492329 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_a2dc855a-b708-430d-973d-a136c6e54873_mkjt3flqdevstack@QuobyteHD, size 112.00 MB, duration 2.72 sec, destination /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-2c5a2ba1-4443-4706-a9df-60b8520b4604 {{(pid=86639) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 02 19:50:55 devstack cinder-volume[86639]: INFO cinder.image.image_utils [None req-453d4992-7f3a-4c75-810f-f43a6c5811eb tempest-VolumesExtendTest-772492329 None] Converted 112.00 MB image at 41.13 MB/s
Jul 02 19:50:55 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-453d4992-7f3a-4c75-810f-f43a6c5811eb tempest-VolumesExtendTest-772492329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-2c5a2ba1-4443-4706-a9df-60b8520b4604 1G {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:50:55 devstack sudo[95748]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-2c5a2ba1-4443-4706-a9df-60b8520b4604 1G
Jul 02 19:50:55 devstack sudo[95748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:50:56 devstack sudo[95746]: pam_unix(sudo:session): session closed for user root
Jul 02 19:50:56 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-7d963441-7155-49ca-93ef-dd1024ef92cc tempest-AttachVolumeNegativeTest-732301193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-685e72a6-174e-4aeb-b099-dec20f9da2f1 1073741824" returned: 0 in 1.125s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:50:56 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-7d963441-7155-49ca-93ef-dd1024ef92cc tempest-AttachVolumeNegativeTest-732301193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-685e72a6-174e-4aeb-b099-dec20f9da2f1 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:50:56 devstack sudo[95756]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-685e72a6-174e-4aeb-b099-dec20f9da2f1
Jul 02 19:50:56 devstack sudo[95756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:50:56 devstack sudo[95748]: pam_unix(sudo:session): session closed for user root
Jul 02 19:50:56 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-453d4992-7f3a-4c75-810f-f43a6c5811eb tempest-VolumesExtendTest-772492329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-2c5a2ba1-4443-4706-a9df-60b8520b4604 1G" returned: 0 in 1.062s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:50:56 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dc07ec0-85d5-45c8-9f53-1cacd5d6ac2b]: (4, 'raw') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 19:50:56 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-453d4992-7f3a-4c75-810f-f43a6c5811eb tempest-VolumesExtendTest-772492329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-2c5a2ba1-4443-4706-a9df-60b8520b4604 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:50:56 devstack sudo[95758]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-2c5a2ba1-4443-4706-a9df-60b8520b4604
Jul 02 19:50:56 devstack sudo[95758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:50:57 devstack sudo[95756]: pam_unix(sudo:session): session closed for user root
Jul 02 19:50:57 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-7d963441-7155-49ca-93ef-dd1024ef92cc tempest-AttachVolumeNegativeTest-732301193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-685e72a6-174e-4aeb-b099-dec20f9da2f1" returned: 0 in 0.861s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:50:57 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-7d963441-7155-49ca-93ef-dd1024ef92cc tempest-AttachVolumeNegativeTest-732301193 None] <== create_volume: return (2052ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'} {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 19:50:57 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-7d963441-7155-49ca-93ef-dd1024ef92cc tempest-AttachVolumeNegativeTest-732301193 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.056s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:50:57 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-7d963441-7155-49ca-93ef-dd1024ef92cc tempest-AttachVolumeNegativeTest-732301193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc6c3afe-0184-4125-a984-f93bb7c674bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-685e72a6-174e-4aeb-b099-dec20f9da2f1', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:50:57 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-7d963441-7155-49ca-93ef-dd1024ef92cc tempest-AttachVolumeNegativeTest-732301193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3907266-afdf-419f-8431-caad9af36ed3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:50:57 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-7d963441-7155-49ca-93ef-dd1024ef92cc tempest-AttachVolumeNegativeTest-732301193 None] Volume volume-685e72a6-174e-4aeb-b099-dec20f9da2f1 (685e72a6-174e-4aeb-b099-dec20f9da2f1): created successfully
Jul 02 19:50:57 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-7d963441-7155-49ca-93ef-dd1024ef92cc tempest-AttachVolumeNegativeTest-732301193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3907266-afdf-419f-8431-caad9af36ed3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:50:57 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-7d963441-7155-49ca-93ef-dd1024ef92cc tempest-AttachVolumeNegativeTest-732301193 None] Flow 'volume_create_manager' (3e70c97a-dc06-4051-960a-a9727c25d6dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 19:50:57 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-7d963441-7155-49ca-93ef-dd1024ef92cc tempest-AttachVolumeNegativeTest-732301193 None] Created volume successfully.
Jul 02 19:50:57 devstack sudo[95758]: pam_unix(sudo:session): session closed for user root
Jul 02 19:50:57 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-453d4992-7f3a-4c75-810f-f43a6c5811eb tempest-VolumesExtendTest-772492329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-2c5a2ba1-4443-4706-a9df-60b8520b4604" returned: 0 in 1.098s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:50:57 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-453d4992-7f3a-4c75-810f-f43a6c5811eb tempest-VolumesExtendTest-772492329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-2c5a2ba1-4443-4706-a9df-60b8520b4604 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:50:57 devstack sudo[95763]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-2c5a2ba1-4443-4706-a9df-60b8520b4604
Jul 02 19:50:57 devstack sudo[95763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:50:58 devstack sudo[95763]: pam_unix(sudo:session): session closed for user root
Jul 02 19:50:58 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-453d4992-7f3a-4c75-810f-f43a6c5811eb tempest-VolumesExtendTest-772492329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-2c5a2ba1-4443-4706-a9df-60b8520b4604" returned: 1 in 1.203s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:50:58 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-453d4992-7f3a-4c75-810f-f43a6c5811eb tempest-VolumesExtendTest-772492329 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-2c5a2ba1-4443-4706-a9df-60b8520b4604' failed. Not Retrying. {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 02 19:50:58 devstack cinder-volume[86639]: DEBUG cinder.volume.volume_utils [None req-453d4992-7f3a-4c75-810f-f43a6c5811eb tempest-VolumesExtendTest-772492329 None] Downloaded image a2dc855a-b708-430d-973d-a136c6e54873 ((None, [{'url': 'file:///opt/stack/data/glance/images/a2dc855a-b708-430d-973d-a136c6e54873', 'metadata': {}}])) to volume 2c5a2ba1-4443-4706-a9df-60b8520b4604 successfully. {{(pid=86639) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jul 02 19:50:58 devstack cinder-volume[86639]: DEBUG cinder.image.image_utils [None req-453d4992-7f3a-4c75-810f-f43a6c5811eb tempest-VolumesExtendTest-772492329 None] Temporary image a2dc855a-b708-430d-973d-a136c6e54873 for user 125ea1b3efb14d4fbc56bca4292ac635 is deleted. {{(pid=86639) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jul 02 19:50:58 devstack cinder-volume[86639]: DEBUG cinder.volume.volume_utils [None req-453d4992-7f3a-4c75-810f-f43a6c5811eb tempest-VolumesExtendTest-772492329 None] Marking volume 2c5a2ba1-4443-4706-a9df-60b8520b4604 as bootable. {{(pid=86639) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jul 02 19:50:58 devstack cinder-volume[86639]: DEBUG cinder.volume.flows.manager.create_volume [None req-453d4992-7f3a-4c75-810f-f43a6c5811eb tempest-VolumesExtendTest-772492329 None] Copying metadata from image a2dc855a-b708-430d-973d-a136c6e54873 to 2c5a2ba1-4443-4706-a9df-60b8520b4604. {{(pid=86639) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jul 02 19:50:58 devstack cinder-volume[86639]: DEBUG cinder.volume.flows.manager.create_volume [None req-453d4992-7f3a-4c75-810f-f43a6c5811eb tempest-VolumesExtendTest-772492329 None] Creating volume glance metadata for volume 2c5a2ba1-4443-4706-a9df-60b8520b4604 backed by image a2dc855a-b708-430d-973d-a136c6e54873 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'a2dc855a-b708-430d-973d-a136c6e54873', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86639) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jul 02 19:50:59 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-453d4992-7f3a-4c75-810f-f43a6c5811eb tempest-VolumesExtendTest-772492329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e994ef99-7374-4299-8d6f-16dbad4faa52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c5a2ba1-4443-4706-a9df-60b8520b4604', 'volume_size': 1, 'image_id': 'a2dc855a-b708-430d-973d-a136c6e54873', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a2dc855a-b708-430d-973d-a136c6e54873', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b6fd8f5b5bb142078118935d5734f463', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a2dc855a-b708-430d-973d-a136c6e54873', 'created_at': datetime.datetime(2026, 7, 2, 17, 34, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 2, 17, 34, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a2dc855a-b708-430d-973d-a136c6e54873/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fce8f262480>}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:50:59 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-453d4992-7f3a-4c75-810f-f43a6c5811eb tempest-VolumesExtendTest-772492329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2d0b3a6-09dc-4843-ac05-98f8940bc4ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:50:59 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-453d4992-7f3a-4c75-810f-f43a6c5811eb tempest-VolumesExtendTest-772492329 None] Volume volume-2c5a2ba1-4443-4706-a9df-60b8520b4604 (2c5a2ba1-4443-4706-a9df-60b8520b4604): created successfully
Jul 02 19:50:59 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-453d4992-7f3a-4c75-810f-f43a6c5811eb tempest-VolumesExtendTest-772492329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2d0b3a6-09dc-4843-ac05-98f8940bc4ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:50:59 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-453d4992-7f3a-4c75-810f-f43a6c5811eb tempest-VolumesExtendTest-772492329 None] Flow 'volume_create_manager' (b2d95828-6ae4-4c7d-b0a7-460c459b3919) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 19:50:59 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-453d4992-7f3a-4c75-810f-f43a6c5811eb tempest-VolumesExtendTest-772492329 None] Created volume successfully.
Jul 02 19:51:00 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-81cf9fd3-14f2-4e8b-a5c4-0b40a8647a1a tempest-VolumesExtendTest-772492329 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:51:00 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-81cf9fd3-14f2-4e8b-a5c4-0b40a8647a1a tempest-VolumesExtendTest-772492329 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:51:00 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd3fc906-aa99-44b3-9a05-6a57d87fa687]: (4, 'raw') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 19:51:00 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-81cf9fd3-14f2-4e8b-a5c4-0b40a8647a1a tempest-VolumesExtendTest-772492329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-2c5a2ba1-4443-4706-a9df-60b8520b4604 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:51:00 devstack sudo[95788]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-2c5a2ba1-4443-4706-a9df-60b8520b4604
Jul 02 19:51:00 devstack sudo[95788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:51:01 devstack sudo[95788]: pam_unix(sudo:session): session closed for user root
Jul 02 19:51:01 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-81cf9fd3-14f2-4e8b-a5c4-0b40a8647a1a tempest-VolumesExtendTest-772492329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-2c5a2ba1-4443-4706-a9df-60b8520b4604" returned: 0 in 0.968s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:51:01 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-81cf9fd3-14f2-4e8b-a5c4-0b40a8647a1a tempest-VolumesExtendTest-772492329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-2c5a2ba1-4443-4706-a9df-60b8520b4604 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:51:01 devstack sudo[95793]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-2c5a2ba1-4443-4706-a9df-60b8520b4604
Jul 02 19:51:01 devstack sudo[95793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:51:01 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [req-d5f5fbda-feb6-446a-9112-bc48b3ce1540 req-535ecb62-43ae-4e01-99e6-1a49d0906c13 tempest-AttachVolumeNegativeTest-732301193 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:51:02 devstack sudo[95793]: pam_unix(sudo:session): session closed for user root
Jul 02 19:51:02 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-81cf9fd3-14f2-4e8b-a5c4-0b40a8647a1a tempest-VolumesExtendTest-772492329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-2c5a2ba1-4443-4706-a9df-60b8520b4604" returned: 1 in 1.036s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:51:02 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-81cf9fd3-14f2-4e8b-a5c4-0b40a8647a1a tempest-VolumesExtendTest-772492329 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-2c5a2ba1-4443-4706-a9df-60b8520b4604' failed. Not Retrying. {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 02 19:51:02 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-81cf9fd3-14f2-4e8b-a5c4-0b40a8647a1a tempest-VolumesExtendTest-772492329 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-2c5a2ba1-4443-4706-a9df-60b8520b4604 2G {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:51:02 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-81cf9fd3-14f2-4e8b-a5c4-0b40a8647a1a tempest-VolumesExtendTest-772492329 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-2c5a2ba1-4443-4706-a9df-60b8520b4604 2G" returned: 0 in 0.077s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:51:02 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-81cf9fd3-14f2-4e8b-a5c4-0b40a8647a1a tempest-VolumesExtendTest-772492329 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 2.138s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:51:02 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [req-d5f5fbda-feb6-446a-9112-bc48b3ce1540 req-535ecb62-43ae-4e01-99e6-1a49d0906c13 tempest-AttachVolumeNegativeTest-732301193 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.302s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:51:02 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b7c2a1a-a32c-4935-be35-b541715da69a]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 19:51:02 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [req-d5f5fbda-feb6-446a-9112-bc48b3ce1540 req-535ecb62-43ae-4e01-99e6-1a49d0906c13 tempest-AttachVolumeNegativeTest-732301193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-685e72a6-174e-4aeb-b099-dec20f9da2f1 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:51:02 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-81cf9fd3-14f2-4e8b-a5c4-0b40a8647a1a tempest-VolumesExtendTest-772492329 None] Extend volume completed successfully.
Jul 02 19:51:02 devstack sudo[95810]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-685e72a6-174e-4aeb-b099-dec20f9da2f1
Jul 02 19:51:02 devstack sudo[95810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:51:03 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [req-d5f5fbda-feb6-446a-9112-bc48b3ce1540 req-535ecb62-43ae-4e01-99e6-1a49d0906c13 tempest-AttachVolumeNegativeTest-732301193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-685e72a6-174e-4aeb-b099-dec20f9da2f1" returned: 0 in 0.892s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:51:03 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [req-d5f5fbda-feb6-446a-9112-bc48b3ce1540 req-535ecb62-43ae-4e01-99e6-1a49d0906c13 tempest-AttachVolumeNegativeTest-732301193 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.931s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:51:03 devstack sudo[95810]: pam_unix(sudo:session): session closed for user root
Jul 02 19:51:03 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [req-d5f5fbda-feb6-446a-9112-bc48b3ce1540 req-535ecb62-43ae-4e01-99e6-1a49d0906c13 tempest-AttachVolumeNegativeTest-732301193 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92', 'name': 'volume-685e72a6-174e-4aeb-b099-dec20f9da2f1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6058cf51-250e-4e89-85e2-b4e688ca0e01', 'enforce_multipath': True} {{(pid=86639) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 02 19:51:03 devstack cinder-volume[86639]: INFO cinder.volume.manager [req-d5f5fbda-feb6-446a-9112-bc48b3ce1540 req-535ecb62-43ae-4e01-99e6-1a49d0906c13 tempest-AttachVolumeNegativeTest-732301193 None] attachment_update completed successfully.
Jul 02 19:51:03 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-6cd1f408-7f5e-49ba-bf9a-e39d3e8a8f6a tempest-VolumesExtendTest-772492329 None] Acquiring lock "cinder-2c5a2ba1-4443-4706-a9df-60b8520b4604-delete_volume" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:51:03 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-6cd1f408-7f5e-49ba-bf9a-e39d3e8a8f6a tempest-VolumesExtendTest-772492329 None] Lock "cinder-2c5a2ba1-4443-4706-a9df-60b8520b4604-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:51:03 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-6cd1f408-7f5e-49ba-bf9a-e39d3e8a8f6a tempest-VolumesExtendTest-772492329 None] Acquiring lock "cinder-quobyte-2c5a2ba1-4443-4706-a9df-60b8520b4604" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:51:03 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-6cd1f408-7f5e-49ba-bf9a-e39d3e8a8f6a tempest-VolumesExtendTest-772492329 None] Lock "cinder-quobyte-2c5a2ba1-4443-4706-a9df-60b8520b4604" acquired by "delete_volume" :: waited 0.030s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:51:03 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dc470de-fc20-472a-b936-425548abd219]: (4, 'raw') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 19:51:03 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-6cd1f408-7f5e-49ba-bf9a-e39d3e8a8f6a tempest-VolumesExtendTest-772492329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-2c5a2ba1-4443-4706-a9df-60b8520b4604 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:51:03 devstack sudo[95886]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-2c5a2ba1-4443-4706-a9df-60b8520b4604
Jul 02 19:51:03 devstack sudo[95886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:51:05 devstack sudo[95886]: pam_unix(sudo:session): session closed for user root
Jul 02 19:51:05 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-6cd1f408-7f5e-49ba-bf9a-e39d3e8a8f6a tempest-VolumesExtendTest-772492329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-2c5a2ba1-4443-4706-a9df-60b8520b4604" returned: 0 in 1.208s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:51:05 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-6cd1f408-7f5e-49ba-bf9a-e39d3e8a8f6a tempest-VolumesExtendTest-772492329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-2c5a2ba1-4443-4706-a9df-60b8520b4604 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:51:05 devstack sudo[96255]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-2c5a2ba1-4443-4706-a9df-60b8520b4604
Jul 02 19:51:05 devstack sudo[96255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:51:06 devstack sudo[96255]: pam_unix(sudo:session): session closed for user root
Jul 02 19:51:06 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-6cd1f408-7f5e-49ba-bf9a-e39d3e8a8f6a tempest-VolumesExtendTest-772492329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-2c5a2ba1-4443-4706-a9df-60b8520b4604" returned: 1 in 1.287s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:51:06 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-6cd1f408-7f5e-49ba-bf9a-e39d3e8a8f6a tempest-VolumesExtendTest-772492329 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-2c5a2ba1-4443-4706-a9df-60b8520b4604' failed. Not Retrying. {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 02 19:51:06 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-6cd1f408-7f5e-49ba-bf9a-e39d3e8a8f6a tempest-VolumesExtendTest-772492329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-2c5a2ba1-4443-4706-a9df-60b8520b4604 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:51:06 devstack sudo[96278]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-2c5a2ba1-4443-4706-a9df-60b8520b4604
Jul 02 19:51:06 devstack sudo[96278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:51:07 devstack sudo[96278]: pam_unix(sudo:session): session closed for user root
Jul 02 19:51:07 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-6cd1f408-7f5e-49ba-bf9a-e39d3e8a8f6a tempest-VolumesExtendTest-772492329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-2c5a2ba1-4443-4706-a9df-60b8520b4604" returned: 0 in 1.377s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:51:07 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-6cd1f408-7f5e-49ba-bf9a-e39d3e8a8f6a tempest-VolumesExtendTest-772492329 None] Lock "cinder-quobyte-2c5a2ba1-4443-4706-a9df-60b8520b4604" released by "delete_volume" :: held 3.973s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:51:07 devstack cinder-volume[86639]: DEBUG cinder.quota [None req-6cd1f408-7f5e-49ba-bf9a-e39d3e8a8f6a tempest-VolumesExtendTest-772492329 None] Created reservations ['95a8a057-c31e-4373-852b-5b7ca778c64c', 'ae10ff2d-f4a1-40d3-b6e2-a8a5cfa4a618', '78d0879f-259b-4a88-b4e3-d522087f5820', 'e70e7e6c-c58a-4f9e-adb9-278bfce095b2'] {{(pid=86639) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 19:51:07 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-6cd1f408-7f5e-49ba-bf9a-e39d3e8a8f6a tempest-VolumesExtendTest-772492329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:51:07 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-6cd1f408-7f5e-49ba-bf9a-e39d3e8a8f6a tempest-VolumesExtendTest-772492329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:51:07 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-6cd1f408-7f5e-49ba-bf9a-e39d3e8a8f6a tempest-VolumesExtendTest-772492329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 19:51:07 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-6cd1f408-7f5e-49ba-bf9a-e39d3e8a8f6a tempest-VolumesExtendTest-772492329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 19:51:07 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-6cd1f408-7f5e-49ba-bf9a-e39d3e8a8f6a tempest-VolumesExtendTest-772492329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:51:07 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-6cd1f408-7f5e-49ba-bf9a-e39d3e8a8f6a tempest-VolumesExtendTest-772492329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:51:07 devstack sudo[96281]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e
Jul 02 19:51:07 devstack sudo[96281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:51:09 devstack cinder-volume[86639]: DEBUG cinder.volume.flows.manager.create_volume [None req-754cead0-6414-4d41-bce1-7caab2321b16 tempest-VolumesExtendTest-772492329 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 19:51:09 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-754cead0-6414-4d41-bce1-7caab2321b16 tempest-VolumesExtendTest-772492329 None] Flow 'volume_create_manager' (91125e81-e730-4db5-a684-e66bc8d372f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 19:51:09 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-754cead0-6414-4d41-bce1-7caab2321b16 tempest-VolumesExtendTest-772492329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f2df81f-cfe5-477c-aca7-16e930b4b06d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:51:09 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-754cead0-6414-4d41-bce1-7caab2321b16 tempest-VolumesExtendTest-772492329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f2df81f-cfe5-477c-aca7-16e930b4b06d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T17:51:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-736337742',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cda30599-e98c-4f90-bcc0-0ba583eceba6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3384f34d39640e8a617fe9125662a45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T17:51:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T17:51:09Z,use_quota=True,user_id='125ea1b3efb14d4fbc56bca4292ac635',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:51:09 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-754cead0-6414-4d41-bce1-7caab2321b16 tempest-VolumesExtendTest-772492329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6f886cb-901c-4c40-b087-128b520cac62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:51:09 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-754cead0-6414-4d41-bce1-7caab2321b16 tempest-VolumesExtendTest-772492329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6f886cb-901c-4c40-b087-128b520cac62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:51:09 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-754cead0-6414-4d41-bce1-7caab2321b16 tempest-VolumesExtendTest-772492329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f5f4b99-61c3-4c3d-9f8f-d96cb318320d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:51:09 devstack sudo[96281]: pam_unix(sudo:session): session closed for user root
Jul 02 19:51:09 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-754cead0-6414-4d41-bce1-7caab2321b16 tempest-VolumesExtendTest-772492329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f5f4b99-61c3-4c3d-9f8f-d96cb318320d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cda30599-e98c-4f90-bcc0-0ba583eceba6', 'volume_name': 'volume-cda30599-e98c-4f90-bcc0-0ba583eceba6', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:51:09 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-754cead0-6414-4d41-bce1-7caab2321b16 tempest-VolumesExtendTest-772492329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95eedc27-ccd7-4c11-9bb8-4c9d7dca1422) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:51:09 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-754cead0-6414-4d41-bce1-7caab2321b16 tempest-VolumesExtendTest-772492329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95eedc27-ccd7-4c11-9bb8-4c9d7dca1422) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:51:09 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-754cead0-6414-4d41-bce1-7caab2321b16 tempest-VolumesExtendTest-772492329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13485c26-22c9-43b8-9333-de8ec113bfab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:51:09 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-754cead0-6414-4d41-bce1-7caab2321b16 tempest-VolumesExtendTest-772492329 None] Volume cda30599-e98c-4f90-bcc0-0ba583eceba6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cda30599-e98c-4f90-bcc0-0ba583eceba6', 'volume_size': 1}
Jul 02 19:51:09 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-754cead0-6414-4d41-bce1-7caab2321b16 tempest-VolumesExtendTest-772492329 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:51:09 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-754cead0-6414-4d41-bce1-7caab2321b16 tempest-VolumesExtendTest-772492329 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:51:09 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-754cead0-6414-4d41-bce1-7caab2321b16 tempest-VolumesExtendTest-772492329 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce906cb830>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T17:51:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-736337742',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cda30599-e98c-4f90-bcc0-0ba583eceba6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3384f34d39640e8a617fe9125662a45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T17:51:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T17:51:09Z,use_quota=True,user_id='125ea1b3efb14d4fbc56bca4292ac635',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)}" {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 19:51:09 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-754cead0-6414-4d41-bce1-7caab2321b16 tempest-VolumesExtendTest-772492329 None] Creating volume cda30599-e98c-4f90-bcc0-0ba583eceba6 {{(pid=86639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 19:51:09 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-754cead0-6414-4d41-bce1-7caab2321b16 tempest-VolumesExtendTest-772492329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:51:09 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-754cead0-6414-4d41-bce1-7caab2321b16 tempest-VolumesExtendTest-772492329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:51:09 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-754cead0-6414-4d41-bce1-7caab2321b16 tempest-VolumesExtendTest-772492329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 19:51:09 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-754cead0-6414-4d41-bce1-7caab2321b16 tempest-VolumesExtendTest-772492329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 19:51:09 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-754cead0-6414-4d41-bce1-7caab2321b16 tempest-VolumesExtendTest-772492329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:51:09 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-754cead0-6414-4d41-bce1-7caab2321b16 tempest-VolumesExtendTest-772492329 None] Selected osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92 as target Quobyte volume. {{(pid=86639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 19:51:09 devstack cinder-volume[86639]: INFO cinder.volume.drivers.remotefs [None req-754cead0-6414-4d41-bce1-7caab2321b16 tempest-VolumesExtendTest-772492329 None] casted to osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92
Jul 02 19:51:09 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-754cead0-6414-4d41-bce1-7caab2321b16 tempest-VolumesExtendTest-772492329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-cda30599-e98c-4f90-bcc0-0ba583eceba6 1073741824 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:51:09 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-6cd1f408-7f5e-49ba-bf9a-e39d3e8a8f6a tempest-VolumesExtendTest-772492329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e" returned: 0 in 1.634s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:51:09 devstack cinder-volume[86639]: DEBUG cinder.manager [None req-6cd1f408-7f5e-49ba-bf9a-e39d3e8a8f6a tempest-VolumesExtendTest-772492329 None] Notifying Schedulers of capabilities ... {{(pid=86639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 19:51:09 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-6cd1f408-7f5e-49ba-bf9a-e39d3e8a8f6a tempest-VolumesExtendTest-772492329 None] Deleted volume successfully.
Jul 02 19:51:09 devstack sudo[96284]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-cda30599-e98c-4f90-bcc0-0ba583eceba6 1073741824
Jul 02 19:51:09 devstack sudo[96284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:51:09 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-6cd1f408-7f5e-49ba-bf9a-e39d3e8a8f6a tempest-VolumesExtendTest-772492329 None] Lock "cinder-2c5a2ba1-4443-4706-a9df-60b8520b4604-delete_volume" released by "delete_volume" :: held 5.952s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:51:11 devstack sudo[96284]: pam_unix(sudo:session): session closed for user root
Jul 02 19:51:11 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-754cead0-6414-4d41-bce1-7caab2321b16 tempest-VolumesExtendTest-772492329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-cda30599-e98c-4f90-bcc0-0ba583eceba6 1073741824" returned: 0 in 1.775s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:51:11 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-754cead0-6414-4d41-bce1-7caab2321b16 tempest-VolumesExtendTest-772492329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-cda30599-e98c-4f90-bcc0-0ba583eceba6 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:51:11 devstack sudo[96318]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-cda30599-e98c-4f90-bcc0-0ba583eceba6
Jul 02 19:51:11 devstack sudo[96318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:51:11 devstack cinder-volume[86639]: INFO cinder.volume.manager [req-6f26884b-4981-41d7-9cee-1cd52113c2a4 req-6aae25df-3f20-4edb-9327-f681ff825a1f tempest-AttachVolumeNegativeTest-732301193 None] Terminate volume connection completed successfully.
Jul 02 19:51:11 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [req-6f26884b-4981-41d7-9cee-1cd52113c2a4 req-6aae25df-3f20-4edb-9327-f681ff825a1f tempest-AttachVolumeNegativeTest-732301193 None] Deleting attachment 6058cf51-250e-4e89-85e2-b4e688ca0e01. {{(pid=86639) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 02 19:51:11 devstack cinder-volume[86639]: DEBUG cinder.volume.flows.manager.create_volume [None req-74ed023f-692a-4c99-86e1-49373ad960fe tempest-VolumesActionsTest-1228615496 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 19:51:11 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-74ed023f-692a-4c99-86e1-49373ad960fe tempest-VolumesActionsTest-1228615496 None] Flow 'volume_create_manager' (baabd0a0-af98-42f1-a021-b330823aec7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 19:51:11 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-74ed023f-692a-4c99-86e1-49373ad960fe tempest-VolumesActionsTest-1228615496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8729c4eb-7129-4c9c-a827-d4e3475aad21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:51:11 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-74ed023f-692a-4c99-86e1-49373ad960fe tempest-VolumesActionsTest-1228615496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8729c4eb-7129-4c9c-a827-d4e3475aad21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T17:51:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1630050708',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=713a796c-662c-4bef-9d59-26cb2b7f9bfc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2f0573874b94459818ba0ae6982b9a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T17:51:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T17:51:12Z,use_quota=True,user_id='b348b993dc1042c0ad54fb21d75aca2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:51:11 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-74ed023f-692a-4c99-86e1-49373ad960fe tempest-VolumesActionsTest-1228615496 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ecbc303-9e72-4d9e-b641-a47c11bed327) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:51:11 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-74ed023f-692a-4c99-86e1-49373ad960fe tempest-VolumesActionsTest-1228615496 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ecbc303-9e72-4d9e-b641-a47c11bed327) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:51:11 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-74ed023f-692a-4c99-86e1-49373ad960fe tempest-VolumesActionsTest-1228615496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4513351-8e0d-4c92-b2c3-0db698444586) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:51:11 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-74ed023f-692a-4c99-86e1-49373ad960fe tempest-VolumesActionsTest-1228615496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4513351-8e0d-4c92-b2c3-0db698444586) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '713a796c-662c-4bef-9d59-26cb2b7f9bfc', 'volume_name': 'volume-713a796c-662c-4bef-9d59-26cb2b7f9bfc', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:51:11 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-74ed023f-692a-4c99-86e1-49373ad960fe tempest-VolumesActionsTest-1228615496 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46288a10-2a22-47fc-b5db-be917c9911b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:51:11 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-74ed023f-692a-4c99-86e1-49373ad960fe tempest-VolumesActionsTest-1228615496 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46288a10-2a22-47fc-b5db-be917c9911b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:51:11 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-74ed023f-692a-4c99-86e1-49373ad960fe tempest-VolumesActionsTest-1228615496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6cb3503-f723-4da2-806a-3f9fa98ad12b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:51:11 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-74ed023f-692a-4c99-86e1-49373ad960fe tempest-VolumesActionsTest-1228615496 None] Volume 713a796c-662c-4bef-9d59-26cb2b7f9bfc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-713a796c-662c-4bef-9d59-26cb2b7f9bfc', 'volume_size': 1}
Jul 02 19:51:11 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-74ed023f-692a-4c99-86e1-49373ad960fe tempest-VolumesActionsTest-1228615496 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:51:12 devstack sudo[96318]: pam_unix(sudo:session): session closed for user root
Jul 02 19:51:12 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-754cead0-6414-4d41-bce1-7caab2321b16 tempest-VolumesExtendTest-772492329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-cda30599-e98c-4f90-bcc0-0ba583eceba6" returned: 0 in 1.174s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:51:12 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-754cead0-6414-4d41-bce1-7caab2321b16 tempest-VolumesExtendTest-772492329 None] <== create_volume: return (3065ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'} {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 19:51:12 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-754cead0-6414-4d41-bce1-7caab2321b16 tempest-VolumesExtendTest-772492329 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.069s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:51:12 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-74ed023f-692a-4c99-86e1-49373ad960fe tempest-VolumesActionsTest-1228615496 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.752s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:51:12 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-74ed023f-692a-4c99-86e1-49373ad960fe tempest-VolumesActionsTest-1228615496 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce906cb830>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T17:51:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1630050708',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=713a796c-662c-4bef-9d59-26cb2b7f9bfc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2f0573874b94459818ba0ae6982b9a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T17:51:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T17:51:12Z,use_quota=True,user_id='b348b993dc1042c0ad54fb21d75aca2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)}" {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 19:51:12 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-74ed023f-692a-4c99-86e1-49373ad960fe tempest-VolumesActionsTest-1228615496 None] Creating volume 713a796c-662c-4bef-9d59-26cb2b7f9bfc {{(pid=86639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 19:51:12 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-74ed023f-692a-4c99-86e1-49373ad960fe tempest-VolumesActionsTest-1228615496 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:51:12 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-74ed023f-692a-4c99-86e1-49373ad960fe tempest-VolumesActionsTest-1228615496 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:51:12 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-74ed023f-692a-4c99-86e1-49373ad960fe tempest-VolumesActionsTest-1228615496 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 19:51:12 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-74ed023f-692a-4c99-86e1-49373ad960fe tempest-VolumesActionsTest-1228615496 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 19:51:12 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-74ed023f-692a-4c99-86e1-49373ad960fe tempest-VolumesActionsTest-1228615496 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:51:12 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-74ed023f-692a-4c99-86e1-49373ad960fe tempest-VolumesActionsTest-1228615496 None] Selected osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92 as target Quobyte volume. {{(pid=86639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 19:51:12 devstack cinder-volume[86639]: INFO cinder.volume.drivers.remotefs [None req-74ed023f-692a-4c99-86e1-49373ad960fe tempest-VolumesActionsTest-1228615496 None] casted to osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92
Jul 02 19:51:12 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-74ed023f-692a-4c99-86e1-49373ad960fe tempest-VolumesActionsTest-1228615496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-713a796c-662c-4bef-9d59-26cb2b7f9bfc 1073741824 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:51:12 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-754cead0-6414-4d41-bce1-7caab2321b16 tempest-VolumesExtendTest-772492329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13485c26-22c9-43b8-9333-de8ec113bfab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cda30599-e98c-4f90-bcc0-0ba583eceba6', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:51:12 devstack sudo[96321]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-713a796c-662c-4bef-9d59-26cb2b7f9bfc 1073741824
Jul 02 19:51:12 devstack sudo[96321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:51:12 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-754cead0-6414-4d41-bce1-7caab2321b16 tempest-VolumesExtendTest-772492329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07b888da-045f-4d20-a236-39d653b2b07c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:51:12 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-754cead0-6414-4d41-bce1-7caab2321b16 tempest-VolumesExtendTest-772492329 None] Volume volume-cda30599-e98c-4f90-bcc0-0ba583eceba6 (cda30599-e98c-4f90-bcc0-0ba583eceba6): created successfully
Jul 02 19:51:12 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-754cead0-6414-4d41-bce1-7caab2321b16 tempest-VolumesExtendTest-772492329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07b888da-045f-4d20-a236-39d653b2b07c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:51:12 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-754cead0-6414-4d41-bce1-7caab2321b16 tempest-VolumesExtendTest-772492329 None] Flow 'volume_create_manager' (91125e81-e730-4db5-a684-e66bc8d372f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 19:51:12 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-754cead0-6414-4d41-bce1-7caab2321b16 tempest-VolumesExtendTest-772492329 None] Created volume successfully.
Jul 02 19:51:14 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-904d3c70-58b3-40fb-9906-c775d55c7dae tempest-VolumesExtendTest-772492329 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:51:14 devstack sudo[96321]: pam_unix(sudo:session): session closed for user root
Jul 02 19:51:14 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-74ed023f-692a-4c99-86e1-49373ad960fe tempest-VolumesActionsTest-1228615496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-713a796c-662c-4bef-9d59-26cb2b7f9bfc 1073741824" returned: 0 in 1.770s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:51:14 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-74ed023f-692a-4c99-86e1-49373ad960fe tempest-VolumesActionsTest-1228615496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-713a796c-662c-4bef-9d59-26cb2b7f9bfc {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:51:14 devstack sudo[96329]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-713a796c-662c-4bef-9d59-26cb2b7f9bfc
Jul 02 19:51:14 devstack sudo[96329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:51:15 devstack sudo[96329]: pam_unix(sudo:session): session closed for user root
Jul 02 19:51:15 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-74ed023f-692a-4c99-86e1-49373ad960fe tempest-VolumesActionsTest-1228615496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-713a796c-662c-4bef-9d59-26cb2b7f9bfc" returned: 0 in 1.113s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:51:15 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-74ed023f-692a-4c99-86e1-49373ad960fe tempest-VolumesActionsTest-1228615496 None] <== create_volume: return (2954ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'} {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 19:51:15 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-74ed023f-692a-4c99-86e1-49373ad960fe tempest-VolumesActionsTest-1228615496 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.957s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:51:15 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-904d3c70-58b3-40fb-9906-c775d55c7dae tempest-VolumesExtendTest-772492329 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.427s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:51:15 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-74ed023f-692a-4c99-86e1-49373ad960fe tempest-VolumesActionsTest-1228615496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6cb3503-f723-4da2-806a-3f9fa98ad12b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-713a796c-662c-4bef-9d59-26cb2b7f9bfc', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:51:15 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-74ed023f-692a-4c99-86e1-49373ad960fe tempest-VolumesActionsTest-1228615496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b15a5b4-15bc-4f93-b1c6-fdb56eac2f82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:51:15 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-904d3c70-58b3-40fb-9906-c775d55c7dae tempest-VolumesExtendTest-772492329 None] Creating offline snapshot ebb98198-48ab-4c90-9a55-ae2c4552fe0c of volume cda30599-e98c-4f90-bcc0-0ba583eceba6 {{(pid=86639) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 02 19:51:15 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-74ed023f-692a-4c99-86e1-49373ad960fe tempest-VolumesActionsTest-1228615496 None] Volume volume-713a796c-662c-4bef-9d59-26cb2b7f9bfc (713a796c-662c-4bef-9d59-26cb2b7f9bfc): created successfully
Jul 02 19:51:15 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-74ed023f-692a-4c99-86e1-49373ad960fe tempest-VolumesActionsTest-1228615496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b15a5b4-15bc-4f93-b1c6-fdb56eac2f82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:51:15 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-74ed023f-692a-4c99-86e1-49373ad960fe tempest-VolumesActionsTest-1228615496 None] Flow 'volume_create_manager' (baabd0a0-af98-42f1-a021-b330823aec7d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 19:51:15 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[29b6bd74-2c58-4c0d-8a1c-292d006dd4bc]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 19:51:15 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-904d3c70-58b3-40fb-9906-c775d55c7dae tempest-VolumesExtendTest-772492329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-cda30599-e98c-4f90-bcc0-0ba583eceba6 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:51:15 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-74ed023f-692a-4c99-86e1-49373ad960fe tempest-VolumesActionsTest-1228615496 None] Created volume successfully.
Jul 02 19:51:15 devstack sudo[96367]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-cda30599-e98c-4f90-bcc0-0ba583eceba6
Jul 02 19:51:15 devstack sudo[96367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:51:16 devstack sudo[96367]: pam_unix(sudo:session): session closed for user root
Jul 02 19:51:16 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-904d3c70-58b3-40fb-9906-c775d55c7dae tempest-VolumesExtendTest-772492329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-cda30599-e98c-4f90-bcc0-0ba583eceba6" returned: 0 in 1.231s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:51:16 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-904d3c70-58b3-40fb-9906-c775d55c7dae tempest-VolumesExtendTest-772492329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-cda30599-e98c-4f90-bcc0-0ba583eceba6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-cda30599-e98c-4f90-bcc0-0ba583eceba6.ebb98198-48ab-4c90-9a55-ae2c4552fe0c 1G {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:51:16 devstack sudo[96373]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-cda30599-e98c-4f90-bcc0-0ba583eceba6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-cda30599-e98c-4f90-bcc0-0ba583eceba6.ebb98198-48ab-4c90-9a55-ae2c4552fe0c 1G
Jul 02 19:51:16 devstack sudo[96373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:51:17 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-5f8d59b5-9c7c-441b-809b-f7d8f417564d tempest-VolumesActionsTest-1228615496 None] Acquiring lock "cinder-713a796c-662c-4bef-9d59-26cb2b7f9bfc" by "attach_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:51:17 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-5f8d59b5-9c7c-441b-809b-f7d8f417564d tempest-VolumesActionsTest-1228615496 None] Lock "cinder-713a796c-662c-4bef-9d59-26cb2b7f9bfc" acquired by "attach_volume" :: waited 0.028s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:51:17 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-5f8d59b5-9c7c-441b-809b-f7d8f417564d tempest-VolumesActionsTest-1228615496 None] Attaching volume 713a796c-662c-4bef-9d59-26cb2b7f9bfc to instance d76abd35-f3fb-4d0b-95b5-c16ac48d1d7b at mountpoint /dev/vdb on host None.
Jul 02 19:51:17 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-5f8d59b5-9c7c-441b-809b-f7d8f417564d tempest-VolumesActionsTest-1228615496 None] Attach volume completed successfully.
Jul 02 19:51:17 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-5f8d59b5-9c7c-441b-809b-f7d8f417564d tempest-VolumesActionsTest-1228615496 None] Lock "cinder-713a796c-662c-4bef-9d59-26cb2b7f9bfc" released by "attach_volume" :: held 0.267s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:51:18 devstack sudo[96373]: pam_unix(sudo:session): session closed for user root
Jul 02 19:51:18 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-904d3c70-58b3-40fb-9906-c775d55c7dae tempest-VolumesExtendTest-772492329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-cda30599-e98c-4f90-bcc0-0ba583eceba6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-cda30599-e98c-4f90-bcc0-0ba583eceba6.ebb98198-48ab-4c90-9a55-ae2c4552fe0c 1G" returned: 0 in 1.653s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:51:18 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-904d3c70-58b3-40fb-9906-c775d55c7dae tempest-VolumesExtendTest-772492329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cda30599-e98c-4f90-bcc0-0ba583eceba6 -F qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-cda30599-e98c-4f90-bcc0-0ba583eceba6.ebb98198-48ab-4c90-9a55-ae2c4552fe0c {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:51:18 devstack sudo[96380]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cda30599-e98c-4f90-bcc0-0ba583eceba6 -F qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-cda30599-e98c-4f90-bcc0-0ba583eceba6.ebb98198-48ab-4c90-9a55-ae2c4552fe0c
Jul 02 19:51:18 devstack sudo[96380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:51:18 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-83b813ef-0042-466e-8c02-ca727954b72e tempest-VolumesActionsTest-210282356 None] Terminate volume connection completed successfully.
Jul 02 19:51:19 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-83b813ef-0042-466e-8c02-ca727954b72e tempest-VolumesActionsTest-210282356 None] Acquiring lock "cinder-713a796c-662c-4bef-9d59-26cb2b7f9bfc-detach_volume" by "detach_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:51:19 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-83b813ef-0042-466e-8c02-ca727954b72e tempest-VolumesActionsTest-210282356 None] Lock "cinder-713a796c-662c-4bef-9d59-26cb2b7f9bfc-detach_volume" acquired by "detach_volume" :: waited 0.074s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:51:19 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-83b813ef-0042-466e-8c02-ca727954b72e tempest-VolumesActionsTest-210282356 None] Detaching volume 713a796c-662c-4bef-9d59-26cb2b7f9bfc from instance d76abd35-f3fb-4d0b-95b5-c16ac48d1d7b.
Jul 02 19:51:19 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-83b813ef-0042-466e-8c02-ca727954b72e tempest-VolumesActionsTest-210282356 None] Detach volume completed successfully.
Jul 02 19:51:19 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-83b813ef-0042-466e-8c02-ca727954b72e tempest-VolumesActionsTest-210282356 None] Lock "cinder-713a796c-662c-4bef-9d59-26cb2b7f9bfc-detach_volume" released by "detach_volume" :: held 0.134s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:51:19 devstack sudo[96380]: pam_unix(sudo:session): session closed for user root
Jul 02 19:51:19 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-904d3c70-58b3-40fb-9906-c775d55c7dae tempest-VolumesExtendTest-772492329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cda30599-e98c-4f90-bcc0-0ba583eceba6 -F qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-cda30599-e98c-4f90-bcc0-0ba583eceba6.ebb98198-48ab-4c90-9a55-ae2c4552fe0c" returned: 0 in 1.040s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:51:19 devstack cinder-volume[86639]: WARNING cinder.volume.drivers.remotefs [None req-904d3c70-58b3-40fb-9906-c775d55c7dae tempest-VolumesExtendTest-772492329 None] /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-cda30599-e98c-4f90-bcc0-0ba583eceba6.ebb98198-48ab-4c90-9a55-ae2c4552fe0c is being set with open permissions: ugo+rw
Jul 02 19:51:19 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-904d3c70-58b3-40fb-9906-c775d55c7dae tempest-VolumesExtendTest-772492329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-cda30599-e98c-4f90-bcc0-0ba583eceba6.ebb98198-48ab-4c90-9a55-ae2c4552fe0c {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:51:19 devstack sudo[96398]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-cda30599-e98c-4f90-bcc0-0ba583eceba6.ebb98198-48ab-4c90-9a55-ae2c4552fe0c
Jul 02 19:51:19 devstack sudo[96398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:51:19 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-63ab515d-133b-4914-adbf-58349b270758 tempest-VolumesActionsTest-1228615496 None] Acquiring lock "cinder-713a796c-662c-4bef-9d59-26cb2b7f9bfc-detach_volume" by "detach_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:51:20 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-63ab515d-133b-4914-adbf-58349b270758 tempest-VolumesActionsTest-1228615496 None] Lock "cinder-713a796c-662c-4bef-9d59-26cb2b7f9bfc-detach_volume" acquired by "detach_volume" :: waited 0.029s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:51:20 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-63ab515d-133b-4914-adbf-58349b270758 tempest-VolumesActionsTest-1228615496 None] Volume detach called, but volume not attached.
Jul 02 19:51:20 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-63ab515d-133b-4914-adbf-58349b270758 tempest-VolumesActionsTest-1228615496 None] Lock "cinder-713a796c-662c-4bef-9d59-26cb2b7f9bfc-detach_volume" released by "detach_volume" :: held 0.027s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:51:20 devstack sudo[96398]: pam_unix(sudo:session): session closed for user root
Jul 02 19:51:20 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-904d3c70-58b3-40fb-9906-c775d55c7dae tempest-VolumesExtendTest-772492329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-cda30599-e98c-4f90-bcc0-0ba583eceba6.ebb98198-48ab-4c90-9a55-ae2c4552fe0c" returned: 0 in 0.996s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:51:20 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-904d3c70-58b3-40fb-9906-c775d55c7dae tempest-VolumesExtendTest-772492329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-cda30599-e98c-4f90-bcc0-0ba583eceba6.info {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:51:20 devstack sudo[96425]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-cda30599-e98c-4f90-bcc0-0ba583eceba6.info
Jul 02 19:51:20 devstack sudo[96425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:51:20 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-bbb21ab8-6379-43f6-8192-0968dc34f321 tempest-VolumesActionsTest-1228615496 None] Acquiring lock "cinder-713a796c-662c-4bef-9d59-26cb2b7f9bfc-delete_volume" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:51:20 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-bbb21ab8-6379-43f6-8192-0968dc34f321 tempest-VolumesActionsTest-1228615496 None] Lock "cinder-713a796c-662c-4bef-9d59-26cb2b7f9bfc-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:51:20 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-bbb21ab8-6379-43f6-8192-0968dc34f321 tempest-VolumesActionsTest-1228615496 None] Acquiring lock "cinder-quobyte-713a796c-662c-4bef-9d59-26cb2b7f9bfc" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:51:20 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-bbb21ab8-6379-43f6-8192-0968dc34f321 tempest-VolumesActionsTest-1228615496 None] Lock "cinder-quobyte-713a796c-662c-4bef-9d59-26cb2b7f9bfc" acquired by "delete_volume" :: waited 0.020s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:51:20 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[959e36d2-eadb-4a84-9f9d-0db19f3052a6]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 19:51:20 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-bbb21ab8-6379-43f6-8192-0968dc34f321 tempest-VolumesActionsTest-1228615496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-713a796c-662c-4bef-9d59-26cb2b7f9bfc {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:51:21 devstack sudo[96427]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-713a796c-662c-4bef-9d59-26cb2b7f9bfc
Jul 02 19:51:21 devstack sudo[96427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:51:21 devstack sudo[96425]: pam_unix(sudo:session): session closed for user root
Jul 02 19:51:21 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-904d3c70-58b3-40fb-9906-c775d55c7dae tempest-VolumesExtendTest-772492329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-cda30599-e98c-4f90-bcc0-0ba583eceba6.info" returned: 0 in 0.895s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:51:21 devstack cinder-volume[86639]: WARNING cinder.volume.drivers.remotefs [None req-904d3c70-58b3-40fb-9906-c775d55c7dae tempest-VolumesExtendTest-772492329 None] /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-cda30599-e98c-4f90-bcc0-0ba583eceba6.info is being set with open permissions: ugo+rw
Jul 02 19:51:21 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-904d3c70-58b3-40fb-9906-c775d55c7dae tempest-VolumesExtendTest-772492329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-cda30599-e98c-4f90-bcc0-0ba583eceba6.info {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:51:21 devstack sudo[96430]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-cda30599-e98c-4f90-bcc0-0ba583eceba6.info
Jul 02 19:51:21 devstack sudo[96430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:51:22 devstack sudo[96427]: pam_unix(sudo:session): session closed for user root
Jul 02 19:51:22 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-bbb21ab8-6379-43f6-8192-0968dc34f321 tempest-VolumesActionsTest-1228615496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-713a796c-662c-4bef-9d59-26cb2b7f9bfc" returned: 0 in 1.250s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:51:22 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-bbb21ab8-6379-43f6-8192-0968dc34f321 tempest-VolumesActionsTest-1228615496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-713a796c-662c-4bef-9d59-26cb2b7f9bfc {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:51:22 devstack sudo[96435]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-713a796c-662c-4bef-9d59-26cb2b7f9bfc
Jul 02 19:51:22 devstack sudo[96435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:51:22 devstack sudo[96430]: pam_unix(sudo:session): session closed for user root
Jul 02 19:51:22 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-904d3c70-58b3-40fb-9906-c775d55c7dae tempest-VolumesExtendTest-772492329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-cda30599-e98c-4f90-bcc0-0ba583eceba6.info" returned: 0 in 1.291s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:51:22 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-904d3c70-58b3-40fb-9906-c775d55c7dae tempest-VolumesExtendTest-772492329 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 7.334s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:51:22 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-904d3c70-58b3-40fb-9906-c775d55c7dae tempest-VolumesExtendTest-772492329 None] Create snapshot completed successfully
Jul 02 19:51:23 devstack sudo[96435]: pam_unix(sudo:session): session closed for user root
Jul 02 19:51:23 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-bbb21ab8-6379-43f6-8192-0968dc34f321 tempest-VolumesActionsTest-1228615496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-713a796c-662c-4bef-9d59-26cb2b7f9bfc" returned: 0 in 0.984s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:51:23 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-bbb21ab8-6379-43f6-8192-0968dc34f321 tempest-VolumesActionsTest-1228615496 None] Lock "cinder-quobyte-713a796c-662c-4bef-9d59-26cb2b7f9bfc" released by "delete_volume" :: held 2.297s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:51:23 devstack cinder-volume[86639]: DEBUG cinder.quota [None req-bbb21ab8-6379-43f6-8192-0968dc34f321 tempest-VolumesActionsTest-1228615496 None] Created reservations ['0691c7e9-78b8-4519-8bc7-34c45147c8a7', 'cbe6d70e-c311-480b-b38f-403b1706b52e', '3cfa6998-e51b-4d4a-aba4-3fe14d176bda', 'ada84d2a-4dba-414b-801b-c90a55c38ea0'] {{(pid=86639) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 19:51:23 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-bbb21ab8-6379-43f6-8192-0968dc34f321 tempest-VolumesActionsTest-1228615496 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:51:23 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-bbb21ab8-6379-43f6-8192-0968dc34f321 tempest-VolumesActionsTest-1228615496 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:51:23 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-bbb21ab8-6379-43f6-8192-0968dc34f321 tempest-VolumesActionsTest-1228615496 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 19:51:23 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-bbb21ab8-6379-43f6-8192-0968dc34f321 tempest-VolumesActionsTest-1228615496 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 19:51:23 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-bbb21ab8-6379-43f6-8192-0968dc34f321 tempest-VolumesActionsTest-1228615496 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:51:23 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-bbb21ab8-6379-43f6-8192-0968dc34f321 tempest-VolumesActionsTest-1228615496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:51:23 devstack sudo[96444]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e
Jul 02 19:51:23 devstack sudo[96444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:51:24 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-402c10ff-4535-4f97-8e6d-d24cebacb79c tempest-VolumesExtendTest-772492329 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:51:24 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-402c10ff-4535-4f97-8e6d-d24cebacb79c tempest-VolumesExtendTest-772492329 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:51:24 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c6724e8-0532-4c1e-afc2-0806d2340801]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 19:51:24 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-402c10ff-4535-4f97-8e6d-d24cebacb79c tempest-VolumesExtendTest-772492329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-cda30599-e98c-4f90-bcc0-0ba583eceba6 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:51:24 devstack sudo[96444]: pam_unix(sudo:session): session closed for user root
Jul 02 19:51:24 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-bbb21ab8-6379-43f6-8192-0968dc34f321 tempest-VolumesActionsTest-1228615496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e" returned: 0 in 0.830s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:51:24 devstack cinder-volume[86639]: DEBUG cinder.manager [None req-bbb21ab8-6379-43f6-8192-0968dc34f321 tempest-VolumesActionsTest-1228615496 None] Notifying Schedulers of capabilities ... {{(pid=86639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 19:51:24 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-bbb21ab8-6379-43f6-8192-0968dc34f321 tempest-VolumesActionsTest-1228615496 None] Deleted volume successfully.
Jul 02 19:51:24 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-bbb21ab8-6379-43f6-8192-0968dc34f321 tempest-VolumesActionsTest-1228615496 None] Lock "cinder-713a796c-662c-4bef-9d59-26cb2b7f9bfc-delete_volume" released by "delete_volume" :: held 3.420s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:51:24 devstack sudo[96447]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-cda30599-e98c-4f90-bcc0-0ba583eceba6
Jul 02 19:51:24 devstack sudo[96447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:51:24 devstack sudo[96447]: pam_unix(sudo:session): session closed for user root
Jul 02 19:51:24 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-402c10ff-4535-4f97-8e6d-d24cebacb79c tempest-VolumesExtendTest-772492329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-cda30599-e98c-4f90-bcc0-0ba583eceba6" returned: 0 in 0.934s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:51:24 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-402c10ff-4535-4f97-8e6d-d24cebacb79c tempest-VolumesExtendTest-772492329 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-cda30599-e98c-4f90-bcc0-0ba583eceba6.ebb98198-48ab-4c90-9a55-ae2c4552fe0c 2G {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:51:25 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-402c10ff-4535-4f97-8e6d-d24cebacb79c tempest-VolumesExtendTest-772492329 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-cda30599-e98c-4f90-bcc0-0ba583eceba6.ebb98198-48ab-4c90-9a55-ae2c4552fe0c 2G" returned: 0 in 0.204s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:51:25 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-402c10ff-4535-4f97-8e6d-d24cebacb79c tempest-VolumesExtendTest-772492329 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.183s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:51:25 devstack cinder-volume[86639]: DEBUG dbcounter [-] [86639] Writing DB stats cinder:UPDATE=66,cinder:SELECT=69,cinder:INSERT=12,cinder:DELETE=4 {{(pid=86639) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 02 19:51:25 devstack cinder-volume[86639]: DEBUG dbcounter [-] [86639] Writing DB stats cinder:SELECT=57,cinder:UPDATE=72,cinder:INSERT=30,cinder:DELETE=8 {{(pid=86639) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 02 19:51:25 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-402c10ff-4535-4f97-8e6d-d24cebacb79c tempest-VolumesExtendTest-772492329 None] Extend volume completed successfully.
Jul 02 19:51:26 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-010731f8-648d-4aa3-837a-2f22ed6456a8 tempest-VolumesExtendTest-772492329 None] Acquiring lock "cinder-ebb98198-48ab-4c90-9a55-ae2c4552fe0c-delete_snapshot" by "delete_snapshot" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:51:26 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-010731f8-648d-4aa3-837a-2f22ed6456a8 tempest-VolumesExtendTest-772492329 None] Lock "cinder-ebb98198-48ab-4c90-9a55-ae2c4552fe0c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:51:26 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-010731f8-648d-4aa3-837a-2f22ed6456a8 tempest-VolumesExtendTest-772492329 None] Acquiring lock "cinder-quobyte-cda30599-e98c-4f90-bcc0-0ba583eceba6" by "delete_snapshot" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:51:26 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-010731f8-648d-4aa3-837a-2f22ed6456a8 tempest-VolumesExtendTest-772492329 None] Lock "cinder-quobyte-cda30599-e98c-4f90-bcc0-0ba583eceba6" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:51:26 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-010731f8-648d-4aa3-837a-2f22ed6456a8 tempest-VolumesExtendTest-772492329 None] Acquiring lock "cinder-quobyte-ebb98198-48ab-4c90-9a55-ae2c4552fe0c" by "_delete_snapshot" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:51:26 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-010731f8-648d-4aa3-837a-2f22ed6456a8 tempest-VolumesExtendTest-772492329 None] Lock "cinder-quobyte-ebb98198-48ab-4c90-9a55-ae2c4552fe0c" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:51:26 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-010731f8-648d-4aa3-837a-2f22ed6456a8 tempest-VolumesExtendTest-772492329 None] Deleting offline snapshot ebb98198-48ab-4c90-9a55-ae2c4552fe0c of volume cda30599-e98c-4f90-bcc0-0ba583eceba6 {{(pid=86639) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 02 19:51:26 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-010731f8-648d-4aa3-837a-2f22ed6456a8 tempest-VolumesExtendTest-772492329 None] snapshot_file for this snap is: volume-cda30599-e98c-4f90-bcc0-0ba583eceba6.ebb98198-48ab-4c90-9a55-ae2c4552fe0c {{(pid=86639) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 02 19:51:26 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd7482e4-3114-4133-b41f-6a54e5041083]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 19:51:26 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-010731f8-648d-4aa3-837a-2f22ed6456a8 tempest-VolumesExtendTest-772492329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-cda30599-e98c-4f90-bcc0-0ba583eceba6.ebb98198-48ab-4c90-9a55-ae2c4552fe0c {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:51:26 devstack sudo[96532]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-cda30599-e98c-4f90-bcc0-0ba583eceba6.ebb98198-48ab-4c90-9a55-ae2c4552fe0c
Jul 02 19:51:26 devstack sudo[96532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:51:27 devstack sudo[96532]: pam_unix(sudo:session): session closed for user root
Jul 02 19:51:27 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-010731f8-648d-4aa3-837a-2f22ed6456a8 tempest-VolumesExtendTest-772492329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-cda30599-e98c-4f90-bcc0-0ba583eceba6.ebb98198-48ab-4c90-9a55-ae2c4552fe0c" returned: 0 in 1.116s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:51:27 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-010731f8-648d-4aa3-837a-2f22ed6456a8 tempest-VolumesExtendTest-772492329 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cda30599-e98c-4f90-bcc0-0ba583eceba6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86639) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 02 19:51:27 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe84660d-da12-4d7d-a297-fe327b34abbf]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 19:51:27 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-010731f8-648d-4aa3-837a-2f22ed6456a8 tempest-VolumesExtendTest-772492329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-cda30599-e98c-4f90-bcc0-0ba583eceba6 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:51:27 devstack sudo[96544]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-cda30599-e98c-4f90-bcc0-0ba583eceba6
Jul 02 19:51:27 devstack sudo[96544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:51:28 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-010731f8-648d-4aa3-837a-2f22ed6456a8 tempest-VolumesExtendTest-772492329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-cda30599-e98c-4f90-bcc0-0ba583eceba6" returned: 0 in 1.025s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:51:28 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-010731f8-648d-4aa3-837a-2f22ed6456a8 tempest-VolumesExtendTest-772492329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-cda30599-e98c-4f90-bcc0-0ba583eceba6.ebb98198-48ab-4c90-9a55-ae2c4552fe0c {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:51:28 devstack sudo[96544]: pam_unix(sudo:session): session closed for user root
Jul 02 19:51:28 devstack sudo[96550]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-cda30599-e98c-4f90-bcc0-0ba583eceba6.ebb98198-48ab-4c90-9a55-ae2c4552fe0c
Jul 02 19:51:28 devstack sudo[96550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:51:29 devstack sudo[96550]: pam_unix(sudo:session): session closed for user root
Jul 02 19:51:29 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-010731f8-648d-4aa3-837a-2f22ed6456a8 tempest-VolumesExtendTest-772492329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-cda30599-e98c-4f90-bcc0-0ba583eceba6.ebb98198-48ab-4c90-9a55-ae2c4552fe0c" returned: 0 in 1.060s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:51:29 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-010731f8-648d-4aa3-837a-2f22ed6456a8 tempest-VolumesExtendTest-772492329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-cda30599-e98c-4f90-bcc0-0ba583eceba6.ebb98198-48ab-4c90-9a55-ae2c4552fe0c {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:51:29 devstack sudo[96556]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-cda30599-e98c-4f90-bcc0-0ba583eceba6.ebb98198-48ab-4c90-9a55-ae2c4552fe0c
Jul 02 19:51:29 devstack sudo[96556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:51:30 devstack sudo[96556]: pam_unix(sudo:session): session closed for user root
Jul 02 19:51:30 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-010731f8-648d-4aa3-837a-2f22ed6456a8 tempest-VolumesExtendTest-772492329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-cda30599-e98c-4f90-bcc0-0ba583eceba6.ebb98198-48ab-4c90-9a55-ae2c4552fe0c" returned: 0 in 0.890s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:51:30 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-010731f8-648d-4aa3-837a-2f22ed6456a8 tempest-VolumesExtendTest-772492329 None] Lock "cinder-quobyte-ebb98198-48ab-4c90-9a55-ae2c4552fe0c" released by "_delete_snapshot" :: held 4.193s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:51:30 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-010731f8-648d-4aa3-837a-2f22ed6456a8 tempest-VolumesExtendTest-772492329 None] Lock "cinder-quobyte-cda30599-e98c-4f90-bcc0-0ba583eceba6" released by "delete_snapshot" :: held 4.222s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:51:30 devstack cinder-volume[86639]: DEBUG cinder.quota [None req-010731f8-648d-4aa3-837a-2f22ed6456a8 tempest-VolumesExtendTest-772492329 None] Created reservations ['82a3146f-3f54-4dd8-b840-0ce602be9f79', '3b3d4e41-a923-46c9-af13-e5cf6c153f7c', 'f9141fd3-f5e9-4af0-ad54-678f9fd08324', '96d337e6-78de-405c-96a1-014376396c19'] {{(pid=86639) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 19:51:30 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-010731f8-648d-4aa3-837a-2f22ed6456a8 tempest-VolumesExtendTest-772492329 None] Delete snapshot completed successfully.
Jul 02 19:51:30 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-010731f8-648d-4aa3-837a-2f22ed6456a8 tempest-VolumesExtendTest-772492329 None] Lock "cinder-ebb98198-48ab-4c90-9a55-ae2c4552fe0c-delete_snapshot" released by "delete_snapshot" :: held 4.417s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:51:31 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-3f8e203f-bf8d-4e6b-849b-b9486014e64c tempest-VolumesExtendTest-772492329 None] Acquiring lock "cinder-cda30599-e98c-4f90-bcc0-0ba583eceba6-delete_volume" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:51:32 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-3f8e203f-bf8d-4e6b-849b-b9486014e64c tempest-VolumesExtendTest-772492329 None] Lock "cinder-cda30599-e98c-4f90-bcc0-0ba583eceba6-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:51:32 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-3f8e203f-bf8d-4e6b-849b-b9486014e64c tempest-VolumesExtendTest-772492329 None] Acquiring lock "cinder-quobyte-cda30599-e98c-4f90-bcc0-0ba583eceba6" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:51:32 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-3f8e203f-bf8d-4e6b-849b-b9486014e64c tempest-VolumesExtendTest-772492329 None] Lock "cinder-quobyte-cda30599-e98c-4f90-bcc0-0ba583eceba6" acquired by "delete_volume" :: waited 0.022s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:51:32 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[52967597-bf5e-41fd-baf1-652a9db95fca]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 19:51:32 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-3f8e203f-bf8d-4e6b-849b-b9486014e64c tempest-VolumesExtendTest-772492329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-cda30599-e98c-4f90-bcc0-0ba583eceba6 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:51:32 devstack sudo[96590]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-cda30599-e98c-4f90-bcc0-0ba583eceba6
Jul 02 19:51:32 devstack sudo[96590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:51:32 devstack cinder-volume[86639]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4d84bc0-6e7a-4f69-bda7-f548086d1c11 tempest-VolumesActionsTest-1228615496 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 19:51:32 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-f4d84bc0-6e7a-4f69-bda7-f548086d1c11 tempest-VolumesActionsTest-1228615496 None] Flow 'volume_create_manager' (6556a0fb-8b4f-4734-ba69-8dfb4d92477d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 19:51:32 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-f4d84bc0-6e7a-4f69-bda7-f548086d1c11 tempest-VolumesActionsTest-1228615496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f54d4df-c93a-44b6-b838-fcec2f7b158b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:51:32 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-f4d84bc0-6e7a-4f69-bda7-f548086d1c11 tempest-VolumesActionsTest-1228615496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f54d4df-c93a-44b6-b838-fcec2f7b158b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T17:51:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-465039542',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6db0879d-d3ab-42f4-a5ef-16f78b666c95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2f0573874b94459818ba0ae6982b9a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T17:51:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T17:51:33Z,use_quota=True,user_id='b348b993dc1042c0ad54fb21d75aca2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:51:32 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-f4d84bc0-6e7a-4f69-bda7-f548086d1c11 tempest-VolumesActionsTest-1228615496 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb6aa060-09f8-4369-ba44-0a883e9084ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:51:32 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-f4d84bc0-6e7a-4f69-bda7-f548086d1c11 tempest-VolumesActionsTest-1228615496 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb6aa060-09f8-4369-ba44-0a883e9084ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:51:32 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-f4d84bc0-6e7a-4f69-bda7-f548086d1c11 tempest-VolumesActionsTest-1228615496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0d19a6d-fc70-48bf-93ab-73c8891b9ee2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:51:33 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-f4d84bc0-6e7a-4f69-bda7-f548086d1c11 tempest-VolumesActionsTest-1228615496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0d19a6d-fc70-48bf-93ab-73c8891b9ee2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6db0879d-d3ab-42f4-a5ef-16f78b666c95', 'volume_name': 'volume-6db0879d-d3ab-42f4-a5ef-16f78b666c95', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:51:33 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-f4d84bc0-6e7a-4f69-bda7-f548086d1c11 tempest-VolumesActionsTest-1228615496 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65d9c280-db31-497a-8868-98de29af34cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:51:33 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-f4d84bc0-6e7a-4f69-bda7-f548086d1c11 tempest-VolumesActionsTest-1228615496 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65d9c280-db31-497a-8868-98de29af34cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:51:33 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-f4d84bc0-6e7a-4f69-bda7-f548086d1c11 tempest-VolumesActionsTest-1228615496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f83baaa-e08b-4c88-993d-b4efe9dd99f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:51:33 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-f4d84bc0-6e7a-4f69-bda7-f548086d1c11 tempest-VolumesActionsTest-1228615496 None] Volume 6db0879d-d3ab-42f4-a5ef-16f78b666c95: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6db0879d-d3ab-42f4-a5ef-16f78b666c95', 'volume_size': 1}
Jul 02 19:51:33 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-f4d84bc0-6e7a-4f69-bda7-f548086d1c11 tempest-VolumesActionsTest-1228615496 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:51:33 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-f4d84bc0-6e7a-4f69-bda7-f548086d1c11 tempest-VolumesActionsTest-1228615496 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:51:33 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-f4d84bc0-6e7a-4f69-bda7-f548086d1c11 tempest-VolumesActionsTest-1228615496 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce906cb830>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T17:51:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-465039542',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6db0879d-d3ab-42f4-a5ef-16f78b666c95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2f0573874b94459818ba0ae6982b9a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T17:51:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T17:51:33Z,use_quota=True,user_id='b348b993dc1042c0ad54fb21d75aca2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)}" {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 19:51:33 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-f4d84bc0-6e7a-4f69-bda7-f548086d1c11 tempest-VolumesActionsTest-1228615496 None] Creating volume 6db0879d-d3ab-42f4-a5ef-16f78b666c95 {{(pid=86639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 19:51:33 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-f4d84bc0-6e7a-4f69-bda7-f548086d1c11 tempest-VolumesActionsTest-1228615496 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:51:33 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-f4d84bc0-6e7a-4f69-bda7-f548086d1c11 tempest-VolumesActionsTest-1228615496 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:51:33 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-f4d84bc0-6e7a-4f69-bda7-f548086d1c11 tempest-VolumesActionsTest-1228615496 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 19:51:33 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-f4d84bc0-6e7a-4f69-bda7-f548086d1c11 tempest-VolumesActionsTest-1228615496 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 19:51:33 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-f4d84bc0-6e7a-4f69-bda7-f548086d1c11 tempest-VolumesActionsTest-1228615496 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:51:33 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-f4d84bc0-6e7a-4f69-bda7-f548086d1c11 tempest-VolumesActionsTest-1228615496 None] Selected osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92 as target Quobyte volume. {{(pid=86639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 19:51:33 devstack cinder-volume[86639]: INFO cinder.volume.drivers.remotefs [None req-f4d84bc0-6e7a-4f69-bda7-f548086d1c11 tempest-VolumesActionsTest-1228615496 None] casted to osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92
Jul 02 19:51:33 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-f4d84bc0-6e7a-4f69-bda7-f548086d1c11 tempest-VolumesActionsTest-1228615496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-6db0879d-d3ab-42f4-a5ef-16f78b666c95 1073741824 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:51:33 devstack sudo[96603]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-6db0879d-d3ab-42f4-a5ef-16f78b666c95 1073741824
Jul 02 19:51:33 devstack sudo[96603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:51:33 devstack sudo[96590]: pam_unix(sudo:session): session closed for user root
Jul 02 19:51:33 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-3f8e203f-bf8d-4e6b-849b-b9486014e64c tempest-VolumesExtendTest-772492329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-cda30599-e98c-4f90-bcc0-0ba583eceba6" returned: 0 in 1.153s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:51:33 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-3f8e203f-bf8d-4e6b-849b-b9486014e64c tempest-VolumesExtendTest-772492329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-cda30599-e98c-4f90-bcc0-0ba583eceba6 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:51:33 devstack sudo[96605]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-cda30599-e98c-4f90-bcc0-0ba583eceba6
Jul 02 19:51:33 devstack sudo[96605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:51:34 devstack sudo[96605]: pam_unix(sudo:session): session closed for user root
Jul 02 19:51:34 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-3f8e203f-bf8d-4e6b-849b-b9486014e64c tempest-VolumesExtendTest-772492329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-cda30599-e98c-4f90-bcc0-0ba583eceba6" returned: 0 in 0.916s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:51:34 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-3f8e203f-bf8d-4e6b-849b-b9486014e64c tempest-VolumesExtendTest-772492329 None] Lock "cinder-quobyte-cda30599-e98c-4f90-bcc0-0ba583eceba6" released by "delete_volume" :: held 2.188s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:51:34 devstack sudo[96603]: pam_unix(sudo:session): session closed for user root
Jul 02 19:51:34 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-f4d84bc0-6e7a-4f69-bda7-f548086d1c11 tempest-VolumesActionsTest-1228615496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-6db0879d-d3ab-42f4-a5ef-16f78b666c95 1073741824" returned: 0 in 1.280s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:51:34 devstack cinder-volume[86639]: DEBUG cinder.quota [None req-3f8e203f-bf8d-4e6b-849b-b9486014e64c tempest-VolumesExtendTest-772492329 None] Created reservations ['f89f1615-e05c-4213-8e43-86c81fcaa827', '0cdc8211-d53d-4039-9cdf-f9695130b2e6', 'c8a8a968-aa07-4d2b-b1d3-cb7045b16c89', '85180638-3b2b-43fc-bff2-b6cb29b702e4'] {{(pid=86639) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 19:51:34 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-f4d84bc0-6e7a-4f69-bda7-f548086d1c11 tempest-VolumesActionsTest-1228615496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-6db0879d-d3ab-42f4-a5ef-16f78b666c95 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:51:34 devstack sudo[96613]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-6db0879d-d3ab-42f4-a5ef-16f78b666c95
Jul 02 19:51:34 devstack sudo[96613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:51:34 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-3f8e203f-bf8d-4e6b-849b-b9486014e64c tempest-VolumesExtendTest-772492329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:51:34 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-3f8e203f-bf8d-4e6b-849b-b9486014e64c tempest-VolumesExtendTest-772492329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:51:34 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-3f8e203f-bf8d-4e6b-849b-b9486014e64c tempest-VolumesExtendTest-772492329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 19:51:34 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-3f8e203f-bf8d-4e6b-849b-b9486014e64c tempest-VolumesExtendTest-772492329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 19:51:34 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-3f8e203f-bf8d-4e6b-849b-b9486014e64c tempest-VolumesExtendTest-772492329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:51:34 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-3f8e203f-bf8d-4e6b-849b-b9486014e64c tempest-VolumesExtendTest-772492329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:51:34 devstack sudo[96618]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e
Jul 02 19:51:34 devstack sudo[96618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:51:35 devstack sudo[96613]: pam_unix(sudo:session): session closed for user root
Jul 02 19:51:35 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-f4d84bc0-6e7a-4f69-bda7-f548086d1c11 tempest-VolumesActionsTest-1228615496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-6db0879d-d3ab-42f4-a5ef-16f78b666c95" returned: 0 in 1.104s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:51:35 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-f4d84bc0-6e7a-4f69-bda7-f548086d1c11 tempest-VolumesActionsTest-1228615496 None] <== create_volume: return (2471ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'} {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 19:51:35 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-f4d84bc0-6e7a-4f69-bda7-f548086d1c11 tempest-VolumesActionsTest-1228615496 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.478s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:51:35 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-f4d84bc0-6e7a-4f69-bda7-f548086d1c11 tempest-VolumesActionsTest-1228615496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f83baaa-e08b-4c88-993d-b4efe9dd99f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6db0879d-d3ab-42f4-a5ef-16f78b666c95', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:51:35 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-f4d84bc0-6e7a-4f69-bda7-f548086d1c11 tempest-VolumesActionsTest-1228615496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a93db0c8-b04e-4a22-bd1c-5372603e76bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:51:35 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-f4d84bc0-6e7a-4f69-bda7-f548086d1c11 tempest-VolumesActionsTest-1228615496 None] Volume volume-6db0879d-d3ab-42f4-a5ef-16f78b666c95 (6db0879d-d3ab-42f4-a5ef-16f78b666c95): created successfully
Jul 02 19:51:35 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-f4d84bc0-6e7a-4f69-bda7-f548086d1c11 tempest-VolumesActionsTest-1228615496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a93db0c8-b04e-4a22-bd1c-5372603e76bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:51:35 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-f4d84bc0-6e7a-4f69-bda7-f548086d1c11 tempest-VolumesActionsTest-1228615496 None] Flow 'volume_create_manager' (6556a0fb-8b4f-4734-ba69-8dfb4d92477d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 19:51:35 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-f4d84bc0-6e7a-4f69-bda7-f548086d1c11 tempest-VolumesActionsTest-1228615496 None] Created volume successfully.
Jul 02 19:51:35 devstack sudo[96618]: pam_unix(sudo:session): session closed for user root
Jul 02 19:51:35 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-3f8e203f-bf8d-4e6b-849b-b9486014e64c tempest-VolumesExtendTest-772492329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e" returned: 0 in 1.044s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:51:35 devstack cinder-volume[86639]: DEBUG cinder.manager [None req-3f8e203f-bf8d-4e6b-849b-b9486014e64c tempest-VolumesExtendTest-772492329 None] Notifying Schedulers of capabilities ... {{(pid=86639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 19:51:35 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-3f8e203f-bf8d-4e6b-849b-b9486014e64c tempest-VolumesExtendTest-772492329 None] Deleted volume successfully.
Jul 02 19:51:35 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-3f8e203f-bf8d-4e6b-849b-b9486014e64c tempest-VolumesExtendTest-772492329 None] Lock "cinder-cda30599-e98c-4f90-bcc0-0ba583eceba6-delete_volume" released by "delete_volume" :: held 3.751s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:51:36 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-d6937aa7-b864-47ce-801f-6f33f0d537cf tempest-VolumesActionsTest-210282356 None] Acquiring lock "cinder-6db0879d-d3ab-42f4-a5ef-16f78b666c95-delete_volume" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:51:36 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-d6937aa7-b864-47ce-801f-6f33f0d537cf tempest-VolumesActionsTest-210282356 None] Lock "cinder-6db0879d-d3ab-42f4-a5ef-16f78b666c95-delete_volume" acquired by "delete_volume" :: waited 0.091s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:51:36 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-d6937aa7-b864-47ce-801f-6f33f0d537cf tempest-VolumesActionsTest-210282356 None] Acquiring lock "cinder-quobyte-6db0879d-d3ab-42f4-a5ef-16f78b666c95" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:51:36 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-d6937aa7-b864-47ce-801f-6f33f0d537cf tempest-VolumesActionsTest-210282356 None] Lock "cinder-quobyte-6db0879d-d3ab-42f4-a5ef-16f78b666c95" acquired by "delete_volume" :: waited 0.020s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:51:36 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[2728464d-5de5-4890-aedb-1ef192cfd8f6]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 19:51:36 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-d6937aa7-b864-47ce-801f-6f33f0d537cf tempest-VolumesActionsTest-210282356 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-6db0879d-d3ab-42f4-a5ef-16f78b666c95 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:51:36 devstack sudo[96678]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-6db0879d-d3ab-42f4-a5ef-16f78b666c95
Jul 02 19:51:36 devstack sudo[96678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:51:38 devstack sudo[96678]: pam_unix(sudo:session): session closed for user root
Jul 02 19:51:38 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-d6937aa7-b864-47ce-801f-6f33f0d537cf tempest-VolumesActionsTest-210282356 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-6db0879d-d3ab-42f4-a5ef-16f78b666c95" returned: 0 in 1.453s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:51:38 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-d6937aa7-b864-47ce-801f-6f33f0d537cf tempest-VolumesActionsTest-210282356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-6db0879d-d3ab-42f4-a5ef-16f78b666c95 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:51:38 devstack sudo[96709]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-6db0879d-d3ab-42f4-a5ef-16f78b666c95
Jul 02 19:51:38 devstack sudo[96709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:51:38 devstack sudo[96709]: pam_unix(sudo:session): session closed for user root
Jul 02 19:51:38 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-d6937aa7-b864-47ce-801f-6f33f0d537cf tempest-VolumesActionsTest-210282356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-6db0879d-d3ab-42f4-a5ef-16f78b666c95" returned: 0 in 0.792s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:51:38 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-d6937aa7-b864-47ce-801f-6f33f0d537cf tempest-VolumesActionsTest-210282356 None] Lock "cinder-quobyte-6db0879d-d3ab-42f4-a5ef-16f78b666c95" released by "delete_volume" :: held 2.345s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:51:38 devstack cinder-volume[86639]: DEBUG cinder.quota [None req-d6937aa7-b864-47ce-801f-6f33f0d537cf tempest-VolumesActionsTest-210282356 None] Created reservations ['2a7cf430-c66e-469b-bbc7-eee3aac8d93e', '61efe2cf-7873-4e12-a779-aa6c31755636', '11930f39-1861-41cb-93cc-5ca40386dd1d', '30ebad9c-4e8f-48e2-b8d7-16e9e65f982f'] {{(pid=86639) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 19:51:39 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-d6937aa7-b864-47ce-801f-6f33f0d537cf tempest-VolumesActionsTest-210282356 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:51:39 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-d6937aa7-b864-47ce-801f-6f33f0d537cf tempest-VolumesActionsTest-210282356 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:51:39 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-d6937aa7-b864-47ce-801f-6f33f0d537cf tempest-VolumesActionsTest-210282356 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 19:51:39 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-d6937aa7-b864-47ce-801f-6f33f0d537cf tempest-VolumesActionsTest-210282356 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 19:51:39 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-d6937aa7-b864-47ce-801f-6f33f0d537cf tempest-VolumesActionsTest-210282356 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:51:39 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-d6937aa7-b864-47ce-801f-6f33f0d537cf tempest-VolumesActionsTest-210282356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:51:39 devstack sudo[96712]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e
Jul 02 19:51:39 devstack sudo[96712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:51:39 devstack sudo[96712]: pam_unix(sudo:session): session closed for user root
Jul 02 19:51:39 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-d6937aa7-b864-47ce-801f-6f33f0d537cf tempest-VolumesActionsTest-210282356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e" returned: 0 in 0.756s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:51:39 devstack cinder-volume[86639]: DEBUG cinder.manager [None req-d6937aa7-b864-47ce-801f-6f33f0d537cf tempest-VolumesActionsTest-210282356 None] Notifying Schedulers of capabilities ... {{(pid=86639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 19:51:39 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-d6937aa7-b864-47ce-801f-6f33f0d537cf tempest-VolumesActionsTest-210282356 None] Deleted volume successfully.
Jul 02 19:51:39 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-d6937aa7-b864-47ce-801f-6f33f0d537cf tempest-VolumesActionsTest-210282356 None] Lock "cinder-6db0879d-d3ab-42f4-a5ef-16f78b666c95-delete_volume" released by "delete_volume" :: held 3.503s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:51:40 devstack cinder-volume[86639]: DEBUG cinder.volume.flows.manager.create_volume [None req-a310f5cc-14f4-4e77-b29c-f398a7f99b98 tempest-VolumesGetTest-901652034 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 19:51:40 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-a310f5cc-14f4-4e77-b29c-f398a7f99b98 tempest-VolumesGetTest-901652034 None] Flow 'volume_create_manager' (0d98f353-54d3-49e5-95a0-fedd1f8f2375) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 19:51:40 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-a310f5cc-14f4-4e77-b29c-f398a7f99b98 tempest-VolumesGetTest-901652034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71d4d637-aef4-4f27-b7ec-b74719b5f6ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:51:40 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-a310f5cc-14f4-4e77-b29c-f398a7f99b98 tempest-VolumesGetTest-901652034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71d4d637-aef4-4f27-b7ec-b74719b5f6ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T17:51:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-856706282',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c773e4c9-08ed-4793-9a96-e4eeec3f0fb6,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='d2427e68dfc641f3844a8667f3020ea8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T17:51:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T17:51:40Z,use_quota=True,user_id='faeb231eb6a04c5bbd7ba1e8049b6120',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:51:40 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-a310f5cc-14f4-4e77-b29c-f398a7f99b98 tempest-VolumesGetTest-901652034 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15e9f109-a509-4bda-aa2a-958ef2088f4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:51:40 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-a310f5cc-14f4-4e77-b29c-f398a7f99b98 tempest-VolumesGetTest-901652034 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15e9f109-a509-4bda-aa2a-958ef2088f4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:51:40 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-a310f5cc-14f4-4e77-b29c-f398a7f99b98 tempest-VolumesGetTest-901652034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99364984-496f-4459-a2b2-cd3c9f8e0a74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:51:40 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-a310f5cc-14f4-4e77-b29c-f398a7f99b98 tempest-VolumesGetTest-901652034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99364984-496f-4459-a2b2-cd3c9f8e0a74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c773e4c9-08ed-4793-9a96-e4eeec3f0fb6', 'volume_name': 'volume-c773e4c9-08ed-4793-9a96-e4eeec3f0fb6', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:51:40 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-a310f5cc-14f4-4e77-b29c-f398a7f99b98 tempest-VolumesGetTest-901652034 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a58e464-9a36-423c-a309-36af143e1cc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:51:40 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-a310f5cc-14f4-4e77-b29c-f398a7f99b98 tempest-VolumesGetTest-901652034 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a58e464-9a36-423c-a309-36af143e1cc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:51:40 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-a310f5cc-14f4-4e77-b29c-f398a7f99b98 tempest-VolumesGetTest-901652034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fae4dff-513c-4def-8f85-08400db81864) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:51:40 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-a310f5cc-14f4-4e77-b29c-f398a7f99b98 tempest-VolumesGetTest-901652034 None] Volume c773e4c9-08ed-4793-9a96-e4eeec3f0fb6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c773e4c9-08ed-4793-9a96-e4eeec3f0fb6', 'volume_size': 1}
Jul 02 19:51:40 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-a310f5cc-14f4-4e77-b29c-f398a7f99b98 tempest-VolumesGetTest-901652034 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:51:40 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-a310f5cc-14f4-4e77-b29c-f398a7f99b98 tempest-VolumesGetTest-901652034 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:51:40 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-a310f5cc-14f4-4e77-b29c-f398a7f99b98 tempest-VolumesGetTest-901652034 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce906cb830>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T17:51:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-856706282',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c773e4c9-08ed-4793-9a96-e4eeec3f0fb6,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='d2427e68dfc641f3844a8667f3020ea8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T17:51:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T17:51:40Z,use_quota=True,user_id='faeb231eb6a04c5bbd7ba1e8049b6120',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)}" {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 19:51:40 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-a310f5cc-14f4-4e77-b29c-f398a7f99b98 tempest-VolumesGetTest-901652034 None] Creating volume c773e4c9-08ed-4793-9a96-e4eeec3f0fb6 {{(pid=86639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 19:51:40 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-a310f5cc-14f4-4e77-b29c-f398a7f99b98 tempest-VolumesGetTest-901652034 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:51:40 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-a310f5cc-14f4-4e77-b29c-f398a7f99b98 tempest-VolumesGetTest-901652034 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:51:40 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-a310f5cc-14f4-4e77-b29c-f398a7f99b98 tempest-VolumesGetTest-901652034 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 19:51:40 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-a310f5cc-14f4-4e77-b29c-f398a7f99b98 tempest-VolumesGetTest-901652034 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 19:51:40 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-a310f5cc-14f4-4e77-b29c-f398a7f99b98 tempest-VolumesGetTest-901652034 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:51:40 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-a310f5cc-14f4-4e77-b29c-f398a7f99b98 tempest-VolumesGetTest-901652034 None] Selected osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92 as target Quobyte volume. {{(pid=86639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 19:51:40 devstack cinder-volume[86639]: INFO cinder.volume.drivers.remotefs [None req-a310f5cc-14f4-4e77-b29c-f398a7f99b98 tempest-VolumesGetTest-901652034 None] casted to osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92
Jul 02 19:51:40 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-a310f5cc-14f4-4e77-b29c-f398a7f99b98 tempest-VolumesGetTest-901652034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-c773e4c9-08ed-4793-9a96-e4eeec3f0fb6 1073741824 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:51:40 devstack sudo[96721]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-c773e4c9-08ed-4793-9a96-e4eeec3f0fb6 1073741824
Jul 02 19:51:40 devstack sudo[96721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:51:40 devstack cinder-volume[86639]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc9ccd54-aad6-4a16-8c23-6a32413d8f61 tempest-VolumesActionsTest-1228615496 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 19:51:40 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-fc9ccd54-aad6-4a16-8c23-6a32413d8f61 tempest-VolumesActionsTest-1228615496 None] Flow 'volume_create_manager' (da8846b0-ca21-404d-aa96-a8747935ca41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 19:51:40 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-fc9ccd54-aad6-4a16-8c23-6a32413d8f61 tempest-VolumesActionsTest-1228615496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cd82e27-e743-4f45-b7e5-2e1ea0ef1942) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:51:40 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-fc9ccd54-aad6-4a16-8c23-6a32413d8f61 tempest-VolumesActionsTest-1228615496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cd82e27-e743-4f45-b7e5-2e1ea0ef1942) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T17:51:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-921753098',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c96092d3-cf63-42f9-add9-2028b7849927,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2f0573874b94459818ba0ae6982b9a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T17:51:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T17:51:41Z,use_quota=True,user_id='b348b993dc1042c0ad54fb21d75aca2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:51:40 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-fc9ccd54-aad6-4a16-8c23-6a32413d8f61 tempest-VolumesActionsTest-1228615496 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78581769-d203-4fbf-a840-6d01037041c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:51:41 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-fc9ccd54-aad6-4a16-8c23-6a32413d8f61 tempest-VolumesActionsTest-1228615496 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78581769-d203-4fbf-a840-6d01037041c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:51:41 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-fc9ccd54-aad6-4a16-8c23-6a32413d8f61 tempest-VolumesActionsTest-1228615496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccdd5172-7426-4c5d-ae75-051204b1d67d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:51:41 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-fc9ccd54-aad6-4a16-8c23-6a32413d8f61 tempest-VolumesActionsTest-1228615496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccdd5172-7426-4c5d-ae75-051204b1d67d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c96092d3-cf63-42f9-add9-2028b7849927', 'volume_name': 'volume-c96092d3-cf63-42f9-add9-2028b7849927', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:51:41 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-fc9ccd54-aad6-4a16-8c23-6a32413d8f61 tempest-VolumesActionsTest-1228615496 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (800dd1d3-0370-49d4-95de-8ecf8146edae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:51:41 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-fc9ccd54-aad6-4a16-8c23-6a32413d8f61 tempest-VolumesActionsTest-1228615496 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (800dd1d3-0370-49d4-95de-8ecf8146edae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:51:41 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-fc9ccd54-aad6-4a16-8c23-6a32413d8f61 tempest-VolumesActionsTest-1228615496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (887ed48d-1678-4635-b4fa-5488de2eeff8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:51:41 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-fc9ccd54-aad6-4a16-8c23-6a32413d8f61 tempest-VolumesActionsTest-1228615496 None] Volume c96092d3-cf63-42f9-add9-2028b7849927: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c96092d3-cf63-42f9-add9-2028b7849927', 'volume_size': 1}
Jul 02 19:51:41 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-fc9ccd54-aad6-4a16-8c23-6a32413d8f61 tempest-VolumesActionsTest-1228615496 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:51:41 devstack cinder-volume[86639]: DEBUG oslo_service.periodic_task [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86639) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 02 19:51:41 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:51:41 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:51:41 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 19:51:41 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 19:51:41 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:51:41 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:51:41 devstack sudo[96774]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e
Jul 02 19:51:41 devstack sudo[96774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:51:42 devstack sudo[96721]: pam_unix(sudo:session): session closed for user root
Jul 02 19:51:42 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-a310f5cc-14f4-4e77-b29c-f398a7f99b98 tempest-VolumesGetTest-901652034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-c773e4c9-08ed-4793-9a96-e4eeec3f0fb6 1073741824" returned: 0 in 1.844s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:51:42 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-a310f5cc-14f4-4e77-b29c-f398a7f99b98 tempest-VolumesGetTest-901652034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-c773e4c9-08ed-4793-9a96-e4eeec3f0fb6 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:51:42 devstack sudo[96788]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-c773e4c9-08ed-4793-9a96-e4eeec3f0fb6
Jul 02 19:51:42 devstack sudo[96788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:51:43 devstack sudo[96774]: pam_unix(sudo:session): session closed for user root
Jul 02 19:51:43 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e" returned: 0 in 1.651s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:51:43 devstack cinder-volume[86639]: DEBUG cinder.manager [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] Notifying Schedulers of capabilities ... {{(pid=86639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 19:51:43 devstack cinder-volume[86639]: DEBUG oslo_service.periodic_task [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] Running periodic task VolumeManager._thread_info {{(pid=86639) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 02 19:51:43 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] thread count: 28 {{(pid=86639) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 02 19:51:43 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] thread info: [<_MainThread(MainThread, started 140525261275264)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 140525150678016)>, <Thread(Thread-3 (stat_writer), started daemon 140525150025920)>, <Thread(Rabbit-heartbeat, started daemon 140525150500864)>, <Thread(Thread-5 (_runner), started daemon 140525149847296)>, <Thread(Thread-7 (_runner), started daemon 140525149863424)>, <Thread(fd_logger, started daemon 140525146589376)>, <Thread(privsep_reader, started daemon 140525144562432)>, <Thread(tpool_thread_0, started daemon 140525137151680)>, <Thread(tpool_thread_1, started daemon 140525128758976)>, <Thread(tpool_thread_2, started daemon 140525120349888)>, <Thread(tpool_thread_3, started daemon 140525111940800)>, <Thread(tpool_thread_4, started daemon 140525103531712)>, <Thread(tpool_thread_5, started daemon 140525095122624)>, <Thread(tpool_thread_6, started daemon 140525086713536)>, <Thread(tpool_thread_7, started daemon 140525078304448)>, <Thread(tpool_thread_8, started daemon 140525069895360)>, <Thread(tpool_thread_9, started daemon 140525061486272)>, <Thread(tpool_thread_10, started daemon 140525053077184)>, <Thread(tpool_thread_11, started daemon 140525044668096)>, <Thread(tpool_thread_12, started daemon 140525036259008)>, <Thread(tpool_thread_13, started daemon 140525027849920)>, <Thread(tpool_thread_14, started daemon 140525019440832)>, <Thread(tpool_thread_15, started daemon 140525011031744)>, <Thread(tpool_thread_16, started daemon 140525002622656)>, <Thread(tpool_thread_17, started daemon 140524994213568)>, <Thread(tpool_thread_18, started daemon 140524985804480)>, <Thread(tpool_thread_19, started daemon 140524977395392)>] {{(pid=86639) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 02 19:51:44 devstack sudo[96788]: pam_unix(sudo:session): session closed for user root
Jul 02 19:51:44 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-a310f5cc-14f4-4e77-b29c-f398a7f99b98 tempest-VolumesGetTest-901652034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-c773e4c9-08ed-4793-9a96-e4eeec3f0fb6" returned: 0 in 1.653s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:51:44 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-a310f5cc-14f4-4e77-b29c-f398a7f99b98 tempest-VolumesGetTest-901652034 None] <== create_volume: return (3599ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'} {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 19:51:44 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-a310f5cc-14f4-4e77-b29c-f398a7f99b98 tempest-VolumesGetTest-901652034 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.602s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:51:44 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-fc9ccd54-aad6-4a16-8c23-6a32413d8f61 tempest-VolumesActionsTest-1228615496 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.075s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:51:44 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-fc9ccd54-aad6-4a16-8c23-6a32413d8f61 tempest-VolumesActionsTest-1228615496 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce906cb830>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T17:51:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-921753098',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c96092d3-cf63-42f9-add9-2028b7849927,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2f0573874b94459818ba0ae6982b9a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T17:51:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T17:51:41Z,use_quota=True,user_id='b348b993dc1042c0ad54fb21d75aca2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)}" {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 19:51:44 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-fc9ccd54-aad6-4a16-8c23-6a32413d8f61 tempest-VolumesActionsTest-1228615496 None] Creating volume c96092d3-cf63-42f9-add9-2028b7849927 {{(pid=86639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 19:51:44 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-fc9ccd54-aad6-4a16-8c23-6a32413d8f61 tempest-VolumesActionsTest-1228615496 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:51:44 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-fc9ccd54-aad6-4a16-8c23-6a32413d8f61 tempest-VolumesActionsTest-1228615496 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:51:44 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-fc9ccd54-aad6-4a16-8c23-6a32413d8f61 tempest-VolumesActionsTest-1228615496 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 19:51:44 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-fc9ccd54-aad6-4a16-8c23-6a32413d8f61 tempest-VolumesActionsTest-1228615496 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 19:51:44 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-fc9ccd54-aad6-4a16-8c23-6a32413d8f61 tempest-VolumesActionsTest-1228615496 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:51:44 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-fc9ccd54-aad6-4a16-8c23-6a32413d8f61 tempest-VolumesActionsTest-1228615496 None] Selected osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92 as target Quobyte volume. {{(pid=86639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 19:51:44 devstack cinder-volume[86639]: INFO cinder.volume.drivers.remotefs [None req-fc9ccd54-aad6-4a16-8c23-6a32413d8f61 tempest-VolumesActionsTest-1228615496 None] casted to osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92
Jul 02 19:51:44 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-fc9ccd54-aad6-4a16-8c23-6a32413d8f61 tempest-VolumesActionsTest-1228615496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-c96092d3-cf63-42f9-add9-2028b7849927 1073741824 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:51:44 devstack sudo[96804]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-c96092d3-cf63-42f9-add9-2028b7849927 1073741824
Jul 02 19:51:44 devstack sudo[96804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:51:44 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-a310f5cc-14f4-4e77-b29c-f398a7f99b98 tempest-VolumesGetTest-901652034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fae4dff-513c-4def-8f85-08400db81864) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c773e4c9-08ed-4793-9a96-e4eeec3f0fb6', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:51:44 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-a310f5cc-14f4-4e77-b29c-f398a7f99b98 tempest-VolumesGetTest-901652034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c7248f0-06bb-4be1-a9b2-42cfd03d6ff6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:51:44 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-a310f5cc-14f4-4e77-b29c-f398a7f99b98 tempest-VolumesGetTest-901652034 None] Volume volume-c773e4c9-08ed-4793-9a96-e4eeec3f0fb6 (c773e4c9-08ed-4793-9a96-e4eeec3f0fb6): created successfully
Jul 02 19:51:44 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-a310f5cc-14f4-4e77-b29c-f398a7f99b98 tempest-VolumesGetTest-901652034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c7248f0-06bb-4be1-a9b2-42cfd03d6ff6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:51:44 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-a310f5cc-14f4-4e77-b29c-f398a7f99b98 tempest-VolumesGetTest-901652034 None] Flow 'volume_create_manager' (0d98f353-54d3-49e5-95a0-fedd1f8f2375) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 19:51:44 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-a310f5cc-14f4-4e77-b29c-f398a7f99b98 tempest-VolumesGetTest-901652034 None] Created volume successfully.
Jul 02 19:51:45 devstack sudo[96804]: pam_unix(sudo:session): session closed for user root
Jul 02 19:51:45 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-fc9ccd54-aad6-4a16-8c23-6a32413d8f61 tempest-VolumesActionsTest-1228615496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-c96092d3-cf63-42f9-add9-2028b7849927 1073741824" returned: 0 in 1.592s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:51:45 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-fc9ccd54-aad6-4a16-8c23-6a32413d8f61 tempest-VolumesActionsTest-1228615496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-c96092d3-cf63-42f9-add9-2028b7849927 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:51:45 devstack sudo[96810]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-c96092d3-cf63-42f9-add9-2028b7849927
Jul 02 19:51:45 devstack sudo[96810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:51:45 devstack cinder-volume[86639]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0e764c9-10a4-4044-979e-8eaab787542f tempest-TestMinimumBasicScenario-118664991 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 19:51:45 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-b0e764c9-10a4-4044-979e-8eaab787542f tempest-TestMinimumBasicScenario-118664991 None] Flow 'volume_create_manager' (98efa586-7685-4788-b0a4-da5ca3bc3c1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 19:51:45 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-b0e764c9-10a4-4044-979e-8eaab787542f tempest-TestMinimumBasicScenario-118664991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85750df2-eb4e-4491-b6bd-f43952b27fc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:51:46 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-b0e764c9-10a4-4044-979e-8eaab787542f tempest-TestMinimumBasicScenario-118664991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85750df2-eb4e-4491-b6bd-f43952b27fc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T17:51:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-269903346',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=535e3510-b25a-4143-9eb7-369c450ffce6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45a36ccab9fc4c83a48e1931b71cdc9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T17:51:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T17:51:46Z,use_quota=True,user_id='999e87c834e94427a85323b195c29d6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:51:46 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-b0e764c9-10a4-4044-979e-8eaab787542f tempest-TestMinimumBasicScenario-118664991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b677c541-65c0-4ae1-90fb-ad1b8488b506) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:51:46 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-b0e764c9-10a4-4044-979e-8eaab787542f tempest-TestMinimumBasicScenario-118664991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b677c541-65c0-4ae1-90fb-ad1b8488b506) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:51:46 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-b0e764c9-10a4-4044-979e-8eaab787542f tempest-TestMinimumBasicScenario-118664991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (505b1e0a-37bb-4291-be6f-6e5e00d87f09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:51:46 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-b0e764c9-10a4-4044-979e-8eaab787542f tempest-TestMinimumBasicScenario-118664991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (505b1e0a-37bb-4291-be6f-6e5e00d87f09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '535e3510-b25a-4143-9eb7-369c450ffce6', 'volume_name': 'volume-535e3510-b25a-4143-9eb7-369c450ffce6', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:51:46 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-b0e764c9-10a4-4044-979e-8eaab787542f tempest-TestMinimumBasicScenario-118664991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5864e39e-2232-4455-b31c-bded7465e95d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:51:46 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-b0e764c9-10a4-4044-979e-8eaab787542f tempest-TestMinimumBasicScenario-118664991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5864e39e-2232-4455-b31c-bded7465e95d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:51:46 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-b0e764c9-10a4-4044-979e-8eaab787542f tempest-TestMinimumBasicScenario-118664991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ca216f9-738a-4d14-aea5-3ff75839bb37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:51:46 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-b0e764c9-10a4-4044-979e-8eaab787542f tempest-TestMinimumBasicScenario-118664991 None] Volume 535e3510-b25a-4143-9eb7-369c450ffce6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-535e3510-b25a-4143-9eb7-369c450ffce6', 'volume_size': 1}
Jul 02 19:51:46 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-b0e764c9-10a4-4044-979e-8eaab787542f tempest-TestMinimumBasicScenario-118664991 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:51:46 devstack cinder-volume[86639]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0e016d9-79bd-4c98-8af8-e0ff8efadd8f tempest-VolumesGetTest-901652034 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 19:51:46 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-c0e016d9-79bd-4c98-8af8-e0ff8efadd8f tempest-VolumesGetTest-901652034 None] Flow 'volume_create_manager' (d6849ce7-2590-4cac-a301-54b14cc69ee1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 19:51:46 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-c0e016d9-79bd-4c98-8af8-e0ff8efadd8f tempest-VolumesGetTest-901652034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01fc78d4-2b17-4330-aa24-e6dcd74c083f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:51:46 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-c0e016d9-79bd-4c98-8af8-e0ff8efadd8f tempest-VolumesGetTest-901652034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01fc78d4-2b17-4330-aa24-e6dcd74c083f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T17:51:46Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-117266993',display_name='tempest-VolumesGetTest-Volume-809749659',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8037939-4687-422d-b137-f391497a0d91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2427e68dfc641f3844a8667f3020ea8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T17:51:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T17:51:46Z,use_quota=True,user_id='faeb231eb6a04c5bbd7ba1e8049b6120',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:51:46 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-c0e016d9-79bd-4c98-8af8-e0ff8efadd8f tempest-VolumesGetTest-901652034 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbcf1b1f-6207-42fb-b419-3f2c2035ecce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:51:46 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-c0e016d9-79bd-4c98-8af8-e0ff8efadd8f tempest-VolumesGetTest-901652034 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbcf1b1f-6207-42fb-b419-3f2c2035ecce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:51:46 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-c0e016d9-79bd-4c98-8af8-e0ff8efadd8f tempest-VolumesGetTest-901652034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (486bbfcb-543b-4243-af44-bb687b6584bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:51:46 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-c0e016d9-79bd-4c98-8af8-e0ff8efadd8f tempest-VolumesGetTest-901652034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (486bbfcb-543b-4243-af44-bb687b6584bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b8037939-4687-422d-b137-f391497a0d91', 'volume_name': 'volume-b8037939-4687-422d-b137-f391497a0d91', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:51:46 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-c0e016d9-79bd-4c98-8af8-e0ff8efadd8f tempest-VolumesGetTest-901652034 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fed8bbc-e89b-410e-a745-d6adeb2b26dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:51:46 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-c0e016d9-79bd-4c98-8af8-e0ff8efadd8f tempest-VolumesGetTest-901652034 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fed8bbc-e89b-410e-a745-d6adeb2b26dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:51:46 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-c0e016d9-79bd-4c98-8af8-e0ff8efadd8f tempest-VolumesGetTest-901652034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79fc42ec-e90c-445c-a8cd-6f030ee18a55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:51:46 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-c0e016d9-79bd-4c98-8af8-e0ff8efadd8f tempest-VolumesGetTest-901652034 None] Volume b8037939-4687-422d-b137-f391497a0d91: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b8037939-4687-422d-b137-f391497a0d91', 'volume_size': 1}
Jul 02 19:51:46 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-c0e016d9-79bd-4c98-8af8-e0ff8efadd8f tempest-VolumesGetTest-901652034 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:51:46 devstack sudo[96810]: pam_unix(sudo:session): session closed for user root
Jul 02 19:51:46 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-fc9ccd54-aad6-4a16-8c23-6a32413d8f61 tempest-VolumesActionsTest-1228615496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-c96092d3-cf63-42f9-add9-2028b7849927" returned: 0 in 1.078s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:51:46 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-fc9ccd54-aad6-4a16-8c23-6a32413d8f61 tempest-VolumesActionsTest-1228615496 None] <== create_volume: return (2790ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'} {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 19:51:46 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-fc9ccd54-aad6-4a16-8c23-6a32413d8f61 tempest-VolumesActionsTest-1228615496 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.794s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:51:46 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-b0e764c9-10a4-4044-979e-8eaab787542f tempest-TestMinimumBasicScenario-118664991 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.777s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:51:46 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-b0e764c9-10a4-4044-979e-8eaab787542f tempest-TestMinimumBasicScenario-118664991 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce906cb830>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T17:51:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-269903346',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=535e3510-b25a-4143-9eb7-369c450ffce6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45a36ccab9fc4c83a48e1931b71cdc9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T17:51:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T17:51:46Z,use_quota=True,user_id='999e87c834e94427a85323b195c29d6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)}" {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 19:51:46 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-b0e764c9-10a4-4044-979e-8eaab787542f tempest-TestMinimumBasicScenario-118664991 None] Creating volume 535e3510-b25a-4143-9eb7-369c450ffce6 {{(pid=86639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 19:51:46 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-b0e764c9-10a4-4044-979e-8eaab787542f tempest-TestMinimumBasicScenario-118664991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:51:46 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-b0e764c9-10a4-4044-979e-8eaab787542f tempest-TestMinimumBasicScenario-118664991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:51:46 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-b0e764c9-10a4-4044-979e-8eaab787542f tempest-TestMinimumBasicScenario-118664991 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 19:51:46 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-b0e764c9-10a4-4044-979e-8eaab787542f tempest-TestMinimumBasicScenario-118664991 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 19:51:46 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-b0e764c9-10a4-4044-979e-8eaab787542f tempest-TestMinimumBasicScenario-118664991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:51:46 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-b0e764c9-10a4-4044-979e-8eaab787542f tempest-TestMinimumBasicScenario-118664991 None] Selected osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92 as target Quobyte volume. {{(pid=86639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 19:51:46 devstack cinder-volume[86639]: INFO cinder.volume.drivers.remotefs [None req-b0e764c9-10a4-4044-979e-8eaab787542f tempest-TestMinimumBasicScenario-118664991 None] casted to osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92
Jul 02 19:51:46 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-b0e764c9-10a4-4044-979e-8eaab787542f tempest-TestMinimumBasicScenario-118664991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-535e3510-b25a-4143-9eb7-369c450ffce6 1073741824 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:51:46 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-fc9ccd54-aad6-4a16-8c23-6a32413d8f61 tempest-VolumesActionsTest-1228615496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (887ed48d-1678-4635-b4fa-5488de2eeff8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c96092d3-cf63-42f9-add9-2028b7849927', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:51:46 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-fc9ccd54-aad6-4a16-8c23-6a32413d8f61 tempest-VolumesActionsTest-1228615496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b679c3b0-90b2-4ec5-8ef4-62f2cbf021c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:51:47 devstack sudo[96813]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-535e3510-b25a-4143-9eb7-369c450ffce6 1073741824
Jul 02 19:51:47 devstack sudo[96813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:51:47 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-fc9ccd54-aad6-4a16-8c23-6a32413d8f61 tempest-VolumesActionsTest-1228615496 None] Volume volume-c96092d3-cf63-42f9-add9-2028b7849927 (c96092d3-cf63-42f9-add9-2028b7849927): created successfully
Jul 02 19:51:47 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-fc9ccd54-aad6-4a16-8c23-6a32413d8f61 tempest-VolumesActionsTest-1228615496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b679c3b0-90b2-4ec5-8ef4-62f2cbf021c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:51:47 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-fc9ccd54-aad6-4a16-8c23-6a32413d8f61 tempest-VolumesActionsTest-1228615496 None] Flow 'volume_create_manager' (da8846b0-ca21-404d-aa96-a8747935ca41) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 19:51:47 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-fc9ccd54-aad6-4a16-8c23-6a32413d8f61 tempest-VolumesActionsTest-1228615496 None] Created volume successfully.
Jul 02 19:51:48 devstack sudo[96813]: pam_unix(sudo:session): session closed for user root
Jul 02 19:51:48 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-b0e764c9-10a4-4044-979e-8eaab787542f tempest-TestMinimumBasicScenario-118664991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-535e3510-b25a-4143-9eb7-369c450ffce6 1073741824" returned: 0 in 1.191s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:51:48 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-b0e764c9-10a4-4044-979e-8eaab787542f tempest-TestMinimumBasicScenario-118664991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-535e3510-b25a-4143-9eb7-369c450ffce6 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:51:48 devstack sudo[96821]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-535e3510-b25a-4143-9eb7-369c450ffce6
Jul 02 19:51:48 devstack sudo[96821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:51:48 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-25bee131-ec6f-4e6d-b6c3-48587fc8df3e tempest-VolumesActionsTest-210282356 None] Acquiring lock "cinder-c96092d3-cf63-42f9-add9-2028b7849927-delete_volume" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:51:48 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-25bee131-ec6f-4e6d-b6c3-48587fc8df3e tempest-VolumesActionsTest-210282356 None] Lock "cinder-c96092d3-cf63-42f9-add9-2028b7849927-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:51:48 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-25bee131-ec6f-4e6d-b6c3-48587fc8df3e tempest-VolumesActionsTest-210282356 None] Acquiring lock "cinder-quobyte-c96092d3-cf63-42f9-add9-2028b7849927" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:51:48 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-25bee131-ec6f-4e6d-b6c3-48587fc8df3e tempest-VolumesActionsTest-210282356 None] Lock "cinder-quobyte-c96092d3-cf63-42f9-add9-2028b7849927" acquired by "delete_volume" :: waited 0.020s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:51:48 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4bd02b7-c420-4d33-b7ed-99eec315365c]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 19:51:48 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-25bee131-ec6f-4e6d-b6c3-48587fc8df3e tempest-VolumesActionsTest-210282356 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-c96092d3-cf63-42f9-add9-2028b7849927 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:51:48 devstack sudo[96823]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-c96092d3-cf63-42f9-add9-2028b7849927
Jul 02 19:51:48 devstack sudo[96823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:51:49 devstack sudo[96821]: pam_unix(sudo:session): session closed for user root
Jul 02 19:51:49 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-b0e764c9-10a4-4044-979e-8eaab787542f tempest-TestMinimumBasicScenario-118664991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-535e3510-b25a-4143-9eb7-369c450ffce6" returned: 0 in 1.258s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:51:49 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-b0e764c9-10a4-4044-979e-8eaab787542f tempest-TestMinimumBasicScenario-118664991 None] <== create_volume: return (2549ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'} {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 19:51:49 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-b0e764c9-10a4-4044-979e-8eaab787542f tempest-TestMinimumBasicScenario-118664991 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.555s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:51:49 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-c0e016d9-79bd-4c98-8af8-e0ff8efadd8f tempest-VolumesGetTest-901652034 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.796s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:51:49 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-c0e016d9-79bd-4c98-8af8-e0ff8efadd8f tempest-VolumesGetTest-901652034 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce906cb830>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T17:51:46Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-117266993',display_name='tempest-VolumesGetTest-Volume-809749659',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8037939-4687-422d-b137-f391497a0d91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2427e68dfc641f3844a8667f3020ea8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T17:51:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T17:51:46Z,use_quota=True,user_id='faeb231eb6a04c5bbd7ba1e8049b6120',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)}" {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 19:51:49 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-c0e016d9-79bd-4c98-8af8-e0ff8efadd8f tempest-VolumesGetTest-901652034 None] Creating volume b8037939-4687-422d-b137-f391497a0d91 {{(pid=86639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 19:51:49 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-c0e016d9-79bd-4c98-8af8-e0ff8efadd8f tempest-VolumesGetTest-901652034 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:51:49 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-c0e016d9-79bd-4c98-8af8-e0ff8efadd8f tempest-VolumesGetTest-901652034 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:51:49 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-c0e016d9-79bd-4c98-8af8-e0ff8efadd8f tempest-VolumesGetTest-901652034 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 19:51:49 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-c0e016d9-79bd-4c98-8af8-e0ff8efadd8f tempest-VolumesGetTest-901652034 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 19:51:49 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-c0e016d9-79bd-4c98-8af8-e0ff8efadd8f tempest-VolumesGetTest-901652034 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:51:49 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-c0e016d9-79bd-4c98-8af8-e0ff8efadd8f tempest-VolumesGetTest-901652034 None] Selected osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92 as target Quobyte volume. {{(pid=86639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 19:51:49 devstack cinder-volume[86639]: INFO cinder.volume.drivers.remotefs [None req-c0e016d9-79bd-4c98-8af8-e0ff8efadd8f tempest-VolumesGetTest-901652034 None] casted to osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92
Jul 02 19:51:49 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-c0e016d9-79bd-4c98-8af8-e0ff8efadd8f tempest-VolumesGetTest-901652034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-b8037939-4687-422d-b137-f391497a0d91 1073741824 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:51:49 devstack sudo[96829]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-b8037939-4687-422d-b137-f391497a0d91 1073741824
Jul 02 19:51:49 devstack sudo[96829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:51:49 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-b0e764c9-10a4-4044-979e-8eaab787542f tempest-TestMinimumBasicScenario-118664991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ca216f9-738a-4d14-aea5-3ff75839bb37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-535e3510-b25a-4143-9eb7-369c450ffce6', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:51:49 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-b0e764c9-10a4-4044-979e-8eaab787542f tempest-TestMinimumBasicScenario-118664991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8ea2e3f-01a8-4ba2-9d7d-993a96f0bee9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:51:49 devstack sudo[96823]: pam_unix(sudo:session): session closed for user root
Jul 02 19:51:49 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-25bee131-ec6f-4e6d-b6c3-48587fc8df3e tempest-VolumesActionsTest-210282356 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-c96092d3-cf63-42f9-add9-2028b7849927" returned: 0 in 1.101s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:51:49 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-25bee131-ec6f-4e6d-b6c3-48587fc8df3e tempest-VolumesActionsTest-210282356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-c96092d3-cf63-42f9-add9-2028b7849927 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:51:49 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-b0e764c9-10a4-4044-979e-8eaab787542f tempest-TestMinimumBasicScenario-118664991 None] Volume volume-535e3510-b25a-4143-9eb7-369c450ffce6 (535e3510-b25a-4143-9eb7-369c450ffce6): created successfully
Jul 02 19:51:49 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-b0e764c9-10a4-4044-979e-8eaab787542f tempest-TestMinimumBasicScenario-118664991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8ea2e3f-01a8-4ba2-9d7d-993a96f0bee9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:51:49 devstack sudo[96831]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-c96092d3-cf63-42f9-add9-2028b7849927
Jul 02 19:51:49 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-b0e764c9-10a4-4044-979e-8eaab787542f tempest-TestMinimumBasicScenario-118664991 None] Flow 'volume_create_manager' (98efa586-7685-4788-b0a4-da5ca3bc3c1c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 19:51:49 devstack sudo[96831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:51:49 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-b0e764c9-10a4-4044-979e-8eaab787542f tempest-TestMinimumBasicScenario-118664991 None] Created volume successfully.
Jul 02 19:51:50 devstack sudo[96831]: pam_unix(sudo:session): session closed for user root
Jul 02 19:51:50 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-25bee131-ec6f-4e6d-b6c3-48587fc8df3e tempest-VolumesActionsTest-210282356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-c96092d3-cf63-42f9-add9-2028b7849927" returned: 0 in 1.309s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:51:50 devstack sudo[96829]: pam_unix(sudo:session): session closed for user root
Jul 02 19:51:50 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-c0e016d9-79bd-4c98-8af8-e0ff8efadd8f tempest-VolumesGetTest-901652034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-b8037939-4687-422d-b137-f391497a0d91 1073741824" returned: 0 in 1.465s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:51:50 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-25bee131-ec6f-4e6d-b6c3-48587fc8df3e tempest-VolumesActionsTest-210282356 None] Lock "cinder-quobyte-c96092d3-cf63-42f9-add9-2028b7849927" released by "delete_volume" :: held 2.480s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:51:51 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-c0e016d9-79bd-4c98-8af8-e0ff8efadd8f tempest-VolumesGetTest-901652034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-b8037939-4687-422d-b137-f391497a0d91 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:51:51 devstack sudo[96840]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-b8037939-4687-422d-b137-f391497a0d91
Jul 02 19:51:51 devstack sudo[96840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:51:51 devstack cinder-volume[86639]: DEBUG cinder.quota [None req-25bee131-ec6f-4e6d-b6c3-48587fc8df3e tempest-VolumesActionsTest-210282356 None] Created reservations ['78e52001-a6dc-425b-ac87-7838fcdb3d97', '9ed43d2b-f94c-488a-8ec4-e4169659b8e6', '74a93884-ec98-4fce-beac-ce18a17ae41a', '21cf8de2-f679-4a46-9192-059e64fea326'] {{(pid=86639) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 19:51:51 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-25bee131-ec6f-4e6d-b6c3-48587fc8df3e tempest-VolumesActionsTest-210282356 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:51:51 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-25bee131-ec6f-4e6d-b6c3-48587fc8df3e tempest-VolumesActionsTest-210282356 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:51:51 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-25bee131-ec6f-4e6d-b6c3-48587fc8df3e tempest-VolumesActionsTest-210282356 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 19:51:51 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-25bee131-ec6f-4e6d-b6c3-48587fc8df3e tempest-VolumesActionsTest-210282356 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 19:51:51 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-25bee131-ec6f-4e6d-b6c3-48587fc8df3e tempest-VolumesActionsTest-210282356 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:51:51 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-25bee131-ec6f-4e6d-b6c3-48587fc8df3e tempest-VolumesActionsTest-210282356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:51:51 devstack sudo[96842]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e
Jul 02 19:51:51 devstack sudo[96842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:51:51 devstack sudo[96840]: pam_unix(sudo:session): session closed for user root
Jul 02 19:51:51 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-c0e016d9-79bd-4c98-8af8-e0ff8efadd8f tempest-VolumesGetTest-901652034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-b8037939-4687-422d-b137-f391497a0d91" returned: 0 in 0.800s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:51:51 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-c0e016d9-79bd-4c98-8af8-e0ff8efadd8f tempest-VolumesGetTest-901652034 None] <== create_volume: return (2347ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'} {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 19:51:51 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-c0e016d9-79bd-4c98-8af8-e0ff8efadd8f tempest-VolumesGetTest-901652034 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.352s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:51:51 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-c0e016d9-79bd-4c98-8af8-e0ff8efadd8f tempest-VolumesGetTest-901652034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79fc42ec-e90c-445c-a8cd-6f030ee18a55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b8037939-4687-422d-b137-f391497a0d91', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:51:51 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-c0e016d9-79bd-4c98-8af8-e0ff8efadd8f tempest-VolumesGetTest-901652034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5851a4b-4915-4038-8b4f-a3b3893c91b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:51:51 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-c0e016d9-79bd-4c98-8af8-e0ff8efadd8f tempest-VolumesGetTest-901652034 None] Volume volume-b8037939-4687-422d-b137-f391497a0d91 (b8037939-4687-422d-b137-f391497a0d91): created successfully
Jul 02 19:51:51 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-c0e016d9-79bd-4c98-8af8-e0ff8efadd8f tempest-VolumesGetTest-901652034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5851a4b-4915-4038-8b4f-a3b3893c91b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:51:51 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-c0e016d9-79bd-4c98-8af8-e0ff8efadd8f tempest-VolumesGetTest-901652034 None] Flow 'volume_create_manager' (d6849ce7-2590-4cac-a301-54b14cc69ee1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 19:51:51 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-c0e016d9-79bd-4c98-8af8-e0ff8efadd8f tempest-VolumesGetTest-901652034 None] Created volume successfully.
Jul 02 19:51:52 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-fc6367c6-d450-49b7-8a9e-43b9f89e8b76 tempest-VolumesGetTest-901652034 None] Acquiring lock "cinder-b8037939-4687-422d-b137-f391497a0d91-delete_volume" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:51:52 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-fc6367c6-d450-49b7-8a9e-43b9f89e8b76 tempest-VolumesGetTest-901652034 None] Lock "cinder-b8037939-4687-422d-b137-f391497a0d91-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:51:52 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-fc6367c6-d450-49b7-8a9e-43b9f89e8b76 tempest-VolumesGetTest-901652034 None] Acquiring lock "cinder-quobyte-b8037939-4687-422d-b137-f391497a0d91" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:51:52 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-fc6367c6-d450-49b7-8a9e-43b9f89e8b76 tempest-VolumesGetTest-901652034 None] Lock "cinder-quobyte-b8037939-4687-422d-b137-f391497a0d91" acquired by "delete_volume" :: waited 0.035s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:51:52 devstack sudo[96842]: pam_unix(sudo:session): session closed for user root
Jul 02 19:51:52 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-25bee131-ec6f-4e6d-b6c3-48587fc8df3e tempest-VolumesActionsTest-210282356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e" returned: 0 in 1.506s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:51:52 devstack cinder-volume[86639]: DEBUG cinder.manager [None req-25bee131-ec6f-4e6d-b6c3-48587fc8df3e tempest-VolumesActionsTest-210282356 None] Notifying Schedulers of capabilities ... {{(pid=86639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 19:51:52 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[cffba57f-a686-43a1-abc5-45a76b8126f2]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 19:51:52 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-fc6367c6-d450-49b7-8a9e-43b9f89e8b76 tempest-VolumesGetTest-901652034 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-b8037939-4687-422d-b137-f391497a0d91 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:51:52 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-25bee131-ec6f-4e6d-b6c3-48587fc8df3e tempest-VolumesActionsTest-210282356 None] Deleted volume successfully.
Jul 02 19:51:52 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-25bee131-ec6f-4e6d-b6c3-48587fc8df3e tempest-VolumesActionsTest-210282356 None] Lock "cinder-c96092d3-cf63-42f9-add9-2028b7849927-delete_volume" released by "delete_volume" :: held 4.395s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:51:52 devstack cinder-volume[86639]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e90d37c-ac95-41b8-85e2-4a3b7c3aaa05 tempest-VolumesActionsTest-1228615496 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 19:51:52 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-4e90d37c-ac95-41b8-85e2-4a3b7c3aaa05 tempest-VolumesActionsTest-1228615496 None] Flow 'volume_create_manager' (7342817b-b8fe-4f73-b5c0-371a855493c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 19:51:52 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-4e90d37c-ac95-41b8-85e2-4a3b7c3aaa05 tempest-VolumesActionsTest-1228615496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc1d224e-07e4-4504-8763-bcf18896d0ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:51:52 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-4e90d37c-ac95-41b8-85e2-4a3b7c3aaa05 tempest-VolumesActionsTest-1228615496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc1d224e-07e4-4504-8763-bcf18896d0ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T17:51:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-160584638',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42232683-3fce-4eed-ba62-8fbf31925783,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2f0573874b94459818ba0ae6982b9a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T17:51:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T17:51:53Z,use_quota=True,user_id='b348b993dc1042c0ad54fb21d75aca2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:51:52 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-4e90d37c-ac95-41b8-85e2-4a3b7c3aaa05 tempest-VolumesActionsTest-1228615496 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2bcec661-9a2b-4f7d-8aaf-e8ad9acc7679) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:51:52 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-4e90d37c-ac95-41b8-85e2-4a3b7c3aaa05 tempest-VolumesActionsTest-1228615496 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2bcec661-9a2b-4f7d-8aaf-e8ad9acc7679) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:51:52 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-4e90d37c-ac95-41b8-85e2-4a3b7c3aaa05 tempest-VolumesActionsTest-1228615496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64450524-d0db-4859-88a1-27a40b603f58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:51:52 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-4e90d37c-ac95-41b8-85e2-4a3b7c3aaa05 tempest-VolumesActionsTest-1228615496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64450524-d0db-4859-88a1-27a40b603f58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '42232683-3fce-4eed-ba62-8fbf31925783', 'volume_name': 'volume-42232683-3fce-4eed-ba62-8fbf31925783', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:51:52 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-4e90d37c-ac95-41b8-85e2-4a3b7c3aaa05 tempest-VolumesActionsTest-1228615496 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4ffc803-eb7e-45ff-a700-e0d3d6ab086e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:51:52 devstack sudo[96848]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-b8037939-4687-422d-b137-f391497a0d91
Jul 02 19:51:52 devstack sudo[96848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:51:52 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-4e90d37c-ac95-41b8-85e2-4a3b7c3aaa05 tempest-VolumesActionsTest-1228615496 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4ffc803-eb7e-45ff-a700-e0d3d6ab086e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:51:52 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-4e90d37c-ac95-41b8-85e2-4a3b7c3aaa05 tempest-VolumesActionsTest-1228615496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9cebc341-58fa-4adb-9646-8b160199e2a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:51:52 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-4e90d37c-ac95-41b8-85e2-4a3b7c3aaa05 tempest-VolumesActionsTest-1228615496 None] Volume 42232683-3fce-4eed-ba62-8fbf31925783: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-42232683-3fce-4eed-ba62-8fbf31925783', 'volume_size': 1}
Jul 02 19:51:52 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-4e90d37c-ac95-41b8-85e2-4a3b7c3aaa05 tempest-VolumesActionsTest-1228615496 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:51:52 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-4e90d37c-ac95-41b8-85e2-4a3b7c3aaa05 tempest-VolumesActionsTest-1228615496 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:51:52 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-4e90d37c-ac95-41b8-85e2-4a3b7c3aaa05 tempest-VolumesActionsTest-1228615496 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce906cb830>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T17:51:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-160584638',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42232683-3fce-4eed-ba62-8fbf31925783,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2f0573874b94459818ba0ae6982b9a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T17:51:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T17:51:53Z,use_quota=True,user_id='b348b993dc1042c0ad54fb21d75aca2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)}" {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 19:51:52 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-4e90d37c-ac95-41b8-85e2-4a3b7c3aaa05 tempest-VolumesActionsTest-1228615496 None] Creating volume 42232683-3fce-4eed-ba62-8fbf31925783 {{(pid=86639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 19:51:52 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-4e90d37c-ac95-41b8-85e2-4a3b7c3aaa05 tempest-VolumesActionsTest-1228615496 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:51:52 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-4e90d37c-ac95-41b8-85e2-4a3b7c3aaa05 tempest-VolumesActionsTest-1228615496 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:51:52 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-4e90d37c-ac95-41b8-85e2-4a3b7c3aaa05 tempest-VolumesActionsTest-1228615496 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 19:51:52 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-4e90d37c-ac95-41b8-85e2-4a3b7c3aaa05 tempest-VolumesActionsTest-1228615496 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 19:51:52 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-4e90d37c-ac95-41b8-85e2-4a3b7c3aaa05 tempest-VolumesActionsTest-1228615496 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:51:52 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-4e90d37c-ac95-41b8-85e2-4a3b7c3aaa05 tempest-VolumesActionsTest-1228615496 None] Selected osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92 as target Quobyte volume. {{(pid=86639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 19:51:52 devstack cinder-volume[86639]: INFO cinder.volume.drivers.remotefs [None req-4e90d37c-ac95-41b8-85e2-4a3b7c3aaa05 tempest-VolumesActionsTest-1228615496 None] casted to osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92
Jul 02 19:51:52 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-4e90d37c-ac95-41b8-85e2-4a3b7c3aaa05 tempest-VolumesActionsTest-1228615496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-42232683-3fce-4eed-ba62-8fbf31925783 1073741824 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:51:53 devstack sudo[96850]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-42232683-3fce-4eed-ba62-8fbf31925783 1073741824
Jul 02 19:51:53 devstack sudo[96850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:51:53 devstack sudo[96848]: pam_unix(sudo:session): session closed for user root
Jul 02 19:51:53 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-fc6367c6-d450-49b7-8a9e-43b9f89e8b76 tempest-VolumesGetTest-901652034 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-b8037939-4687-422d-b137-f391497a0d91" returned: 0 in 1.148s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:51:53 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-fc6367c6-d450-49b7-8a9e-43b9f89e8b76 tempest-VolumesGetTest-901652034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-b8037939-4687-422d-b137-f391497a0d91 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:51:53 devstack sudo[96856]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-b8037939-4687-422d-b137-f391497a0d91
Jul 02 19:51:53 devstack sudo[96856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:51:54 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [req-bb506bbe-2cf0-4439-82a6-cb2f84a3a442 req-f40ef013-d7f2-4662-9332-bb5965aa9e41 tempest-TestMinimumBasicScenario-118664991 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:51:54 devstack sudo[96856]: pam_unix(sudo:session): session closed for user root
Jul 02 19:51:54 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-fc6367c6-d450-49b7-8a9e-43b9f89e8b76 tempest-VolumesGetTest-901652034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-b8037939-4687-422d-b137-f391497a0d91" returned: 0 in 0.955s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:51:54 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-fc6367c6-d450-49b7-8a9e-43b9f89e8b76 tempest-VolumesGetTest-901652034 None] Lock "cinder-quobyte-b8037939-4687-422d-b137-f391497a0d91" released by "delete_volume" :: held 2.214s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:51:55 devstack sudo[96850]: pam_unix(sudo:session): session closed for user root
Jul 02 19:51:55 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-4e90d37c-ac95-41b8-85e2-4a3b7c3aaa05 tempest-VolumesActionsTest-1228615496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-42232683-3fce-4eed-ba62-8fbf31925783 1073741824" returned: 0 in 2.059s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:51:55 devstack cinder-volume[86639]: DEBUG cinder.quota [None req-fc6367c6-d450-49b7-8a9e-43b9f89e8b76 tempest-VolumesGetTest-901652034 None] Created reservations ['defaf855-59b4-46df-aae7-cb4feec87300', 'd385e24e-6a2a-4513-ad99-3d632348552f', '51a2d997-7182-4bcf-8607-9debaf81405b', 'b56bebd6-2780-4554-bcbd-af38f89ca631'] {{(pid=86639) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 19:51:55 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-4e90d37c-ac95-41b8-85e2-4a3b7c3aaa05 tempest-VolumesActionsTest-1228615496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-42232683-3fce-4eed-ba62-8fbf31925783 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:51:55 devstack sudo[96891]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-42232683-3fce-4eed-ba62-8fbf31925783
Jul 02 19:51:55 devstack sudo[96891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:51:55 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-fc6367c6-d450-49b7-8a9e-43b9f89e8b76 tempest-VolumesGetTest-901652034 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:51:55 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-fc6367c6-d450-49b7-8a9e-43b9f89e8b76 tempest-VolumesGetTest-901652034 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:51:55 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-fc6367c6-d450-49b7-8a9e-43b9f89e8b76 tempest-VolumesGetTest-901652034 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 19:51:55 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-fc6367c6-d450-49b7-8a9e-43b9f89e8b76 tempest-VolumesGetTest-901652034 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 19:51:55 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-fc6367c6-d450-49b7-8a9e-43b9f89e8b76 tempest-VolumesGetTest-901652034 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:51:55 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-fc6367c6-d450-49b7-8a9e-43b9f89e8b76 tempest-VolumesGetTest-901652034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:51:55 devstack sudo[96893]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e
Jul 02 19:51:55 devstack sudo[96893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:51:55 devstack sudo[96893]: pam_unix(sudo:session): session closed for user root
Jul 02 19:51:56 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-fc6367c6-d450-49b7-8a9e-43b9f89e8b76 tempest-VolumesGetTest-901652034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e" returned: 0 in 0.809s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:51:56 devstack cinder-volume[86639]: DEBUG cinder.manager [None req-fc6367c6-d450-49b7-8a9e-43b9f89e8b76 tempest-VolumesGetTest-901652034 None] Notifying Schedulers of capabilities ... {{(pid=86639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 19:51:56 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-fc6367c6-d450-49b7-8a9e-43b9f89e8b76 tempest-VolumesGetTest-901652034 None] Deleted volume successfully.
Jul 02 19:51:56 devstack sudo[96891]: pam_unix(sudo:session): session closed for user root
Jul 02 19:51:56 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-4e90d37c-ac95-41b8-85e2-4a3b7c3aaa05 tempest-VolumesActionsTest-1228615496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-42232683-3fce-4eed-ba62-8fbf31925783" returned: 0 in 0.936s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:51:56 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-4e90d37c-ac95-41b8-85e2-4a3b7c3aaa05 tempest-VolumesActionsTest-1228615496 None] <== create_volume: return (3086ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'} {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 19:51:56 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-4e90d37c-ac95-41b8-85e2-4a3b7c3aaa05 tempest-VolumesActionsTest-1228615496 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.093s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:51:56 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [req-bb506bbe-2cf0-4439-82a6-cb2f84a3a442 req-f40ef013-d7f2-4662-9332-bb5965aa9e41 tempest-TestMinimumBasicScenario-118664991 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.389s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:51:56 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-4e90d37c-ac95-41b8-85e2-4a3b7c3aaa05 tempest-VolumesActionsTest-1228615496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9cebc341-58fa-4adb-9646-8b160199e2a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-42232683-3fce-4eed-ba62-8fbf31925783', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:51:56 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-4e90d37c-ac95-41b8-85e2-4a3b7c3aaa05 tempest-VolumesActionsTest-1228615496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8dc1bf03-321b-4727-b983-f8d9c9420edc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:51:56 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-fc6367c6-d450-49b7-8a9e-43b9f89e8b76 tempest-VolumesGetTest-901652034 None] Lock "cinder-b8037939-4687-422d-b137-f391497a0d91-delete_volume" released by "delete_volume" :: held 3.516s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:51:56 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[23e37016-adbb-4912-9c0b-6ae738e414e9]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 19:51:56 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [req-bb506bbe-2cf0-4439-82a6-cb2f84a3a442 req-f40ef013-d7f2-4662-9332-bb5965aa9e41 tempest-TestMinimumBasicScenario-118664991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-535e3510-b25a-4143-9eb7-369c450ffce6 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:51:56 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-4e90d37c-ac95-41b8-85e2-4a3b7c3aaa05 tempest-VolumesActionsTest-1228615496 None] Volume volume-42232683-3fce-4eed-ba62-8fbf31925783 (42232683-3fce-4eed-ba62-8fbf31925783): created successfully
Jul 02 19:51:56 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-4e90d37c-ac95-41b8-85e2-4a3b7c3aaa05 tempest-VolumesActionsTest-1228615496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8dc1bf03-321b-4727-b983-f8d9c9420edc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:51:56 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-4e90d37c-ac95-41b8-85e2-4a3b7c3aaa05 tempest-VolumesActionsTest-1228615496 None] Flow 'volume_create_manager' (7342817b-b8fe-4f73-b5c0-371a855493c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 19:51:56 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-4e90d37c-ac95-41b8-85e2-4a3b7c3aaa05 tempest-VolumesActionsTest-1228615496 None] Created volume successfully.
Jul 02 19:51:56 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-48cd2e14-d132-4fac-8efd-cc9526129273 tempest-VolumesGetTest-901652034 None] Acquiring lock "cinder-c773e4c9-08ed-4793-9a96-e4eeec3f0fb6-delete_volume" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:51:56 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-48cd2e14-d132-4fac-8efd-cc9526129273 tempest-VolumesGetTest-901652034 None] Lock "cinder-c773e4c9-08ed-4793-9a96-e4eeec3f0fb6-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:51:56 devstack sudo[96897]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-535e3510-b25a-4143-9eb7-369c450ffce6
Jul 02 19:51:56 devstack sudo[96897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:51:56 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-48cd2e14-d132-4fac-8efd-cc9526129273 tempest-VolumesGetTest-901652034 None] Acquiring lock "cinder-quobyte-c773e4c9-08ed-4793-9a96-e4eeec3f0fb6" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:51:56 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-48cd2e14-d132-4fac-8efd-cc9526129273 tempest-VolumesGetTest-901652034 None] Lock "cinder-quobyte-c773e4c9-08ed-4793-9a96-e4eeec3f0fb6" acquired by "delete_volume" :: waited 0.026s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:51:56 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[81f6c2d7-bb80-4275-b7d3-f10a1cd6da1d]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 19:51:56 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-48cd2e14-d132-4fac-8efd-cc9526129273 tempest-VolumesGetTest-901652034 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-c773e4c9-08ed-4793-9a96-e4eeec3f0fb6 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:51:56 devstack sudo[96899]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-c773e4c9-08ed-4793-9a96-e4eeec3f0fb6
Jul 02 19:51:56 devstack sudo[96899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:51:57 devstack sudo[96897]: pam_unix(sudo:session): session closed for user root
Jul 02 19:51:57 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [req-bb506bbe-2cf0-4439-82a6-cb2f84a3a442 req-f40ef013-d7f2-4662-9332-bb5965aa9e41 tempest-TestMinimumBasicScenario-118664991 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-535e3510-b25a-4143-9eb7-369c450ffce6" returned: 0 in 0.950s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:51:57 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [req-bb506bbe-2cf0-4439-82a6-cb2f84a3a442 req-f40ef013-d7f2-4662-9332-bb5965aa9e41 tempest-TestMinimumBasicScenario-118664991 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.002s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:51:57 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [req-bb506bbe-2cf0-4439-82a6-cb2f84a3a442 req-f40ef013-d7f2-4662-9332-bb5965aa9e41 tempest-TestMinimumBasicScenario-118664991 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92', 'name': 'volume-535e3510-b25a-4143-9eb7-369c450ffce6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '06a4de29-3065-4356-9d7c-029b3168f27b', 'enforce_multipath': True} {{(pid=86639) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 02 19:51:57 devstack cinder-volume[86639]: INFO cinder.volume.manager [req-bb506bbe-2cf0-4439-82a6-cb2f84a3a442 req-f40ef013-d7f2-4662-9332-bb5965aa9e41 tempest-TestMinimumBasicScenario-118664991 None] attachment_update completed successfully.
Jul 02 19:51:57 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-646217ef-e869-4395-9912-6a0b76bea246 tempest-VolumesActionsTest-210282356 None] Acquiring lock "cinder-42232683-3fce-4eed-ba62-8fbf31925783-delete_volume" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:51:57 devstack sudo[96899]: pam_unix(sudo:session): session closed for user root
Jul 02 19:51:57 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-646217ef-e869-4395-9912-6a0b76bea246 tempest-VolumesActionsTest-210282356 None] Lock "cinder-42232683-3fce-4eed-ba62-8fbf31925783-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:51:57 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-48cd2e14-d132-4fac-8efd-cc9526129273 tempest-VolumesGetTest-901652034 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-c773e4c9-08ed-4793-9a96-e4eeec3f0fb6" returned: 0 in 0.960s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:51:57 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-48cd2e14-d132-4fac-8efd-cc9526129273 tempest-VolumesGetTest-901652034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-c773e4c9-08ed-4793-9a96-e4eeec3f0fb6 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:51:57 devstack sudo[96908]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-c773e4c9-08ed-4793-9a96-e4eeec3f0fb6
Jul 02 19:51:57 devstack sudo[96908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:51:57 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-646217ef-e869-4395-9912-6a0b76bea246 tempest-VolumesActionsTest-210282356 None] Acquiring lock "cinder-quobyte-42232683-3fce-4eed-ba62-8fbf31925783" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:51:57 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-646217ef-e869-4395-9912-6a0b76bea246 tempest-VolumesActionsTest-210282356 None] Lock "cinder-quobyte-42232683-3fce-4eed-ba62-8fbf31925783" acquired by "delete_volume" :: waited 0.021s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:51:57 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[493470ae-8c46-478b-bd17-1b506d1ade6d]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 19:51:57 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-646217ef-e869-4395-9912-6a0b76bea246 tempest-VolumesActionsTest-210282356 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-42232683-3fce-4eed-ba62-8fbf31925783 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:51:57 devstack sudo[96910]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-42232683-3fce-4eed-ba62-8fbf31925783
Jul 02 19:51:57 devstack sudo[96910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:51:58 devstack sudo[96908]: pam_unix(sudo:session): session closed for user root
Jul 02 19:51:58 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-48cd2e14-d132-4fac-8efd-cc9526129273 tempest-VolumesGetTest-901652034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-c773e4c9-08ed-4793-9a96-e4eeec3f0fb6" returned: 0 in 0.912s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:51:58 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-48cd2e14-d132-4fac-8efd-cc9526129273 tempest-VolumesGetTest-901652034 None] Lock "cinder-quobyte-c773e4c9-08ed-4793-9a96-e4eeec3f0fb6" released by "delete_volume" :: held 1.943s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:51:58 devstack cinder-volume[86639]: DEBUG cinder.quota [None req-48cd2e14-d132-4fac-8efd-cc9526129273 tempest-VolumesGetTest-901652034 None] Created reservations ['f619739b-844b-4f1b-9806-ef3be9478cc8', '7e167925-7f4f-4146-ab2b-e7d4d022e1b5', 'ba8e821d-f6dc-483e-b99e-9a47cf2aacbf', '90dcaa99-ef4e-4116-8231-1817fd78450e'] {{(pid=86639) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 19:51:58 devstack sudo[96910]: pam_unix(sudo:session): session closed for user root
Jul 02 19:51:58 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-646217ef-e869-4395-9912-6a0b76bea246 tempest-VolumesActionsTest-210282356 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-42232683-3fce-4eed-ba62-8fbf31925783" returned: 0 in 0.890s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:51:58 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-646217ef-e869-4395-9912-6a0b76bea246 tempest-VolumesActionsTest-210282356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-42232683-3fce-4eed-ba62-8fbf31925783 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:51:58 devstack sudo[97011]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-42232683-3fce-4eed-ba62-8fbf31925783
Jul 02 19:51:58 devstack sudo[97011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:51:58 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-48cd2e14-d132-4fac-8efd-cc9526129273 tempest-VolumesGetTest-901652034 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:51:58 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-48cd2e14-d132-4fac-8efd-cc9526129273 tempest-VolumesGetTest-901652034 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:51:58 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-48cd2e14-d132-4fac-8efd-cc9526129273 tempest-VolumesGetTest-901652034 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 19:51:58 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-48cd2e14-d132-4fac-8efd-cc9526129273 tempest-VolumesGetTest-901652034 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 19:51:58 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-48cd2e14-d132-4fac-8efd-cc9526129273 tempest-VolumesGetTest-901652034 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:51:58 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-48cd2e14-d132-4fac-8efd-cc9526129273 tempest-VolumesGetTest-901652034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:51:58 devstack sudo[97326]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e
Jul 02 19:51:58 devstack sudo[97326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:51:59 devstack cinder-volume[86639]: DEBUG cinder.volume.flows.manager.create_volume [None req-640b75b2-b149-498c-9ce2-d6db24b3737f tempest-VolumesGetTest-901652034 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 19:51:59 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-640b75b2-b149-498c-9ce2-d6db24b3737f tempest-VolumesGetTest-901652034 None] Flow 'volume_create_manager' (297ebbf7-7b91-42a6-a4e8-e576cfa58304) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 19:51:59 devstack sudo[97011]: pam_unix(sudo:session): session closed for user root
Jul 02 19:51:59 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-640b75b2-b149-498c-9ce2-d6db24b3737f tempest-VolumesGetTest-901652034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee214819-2c70-4775-8e8c-aa590e7efffa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:51:59 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-646217ef-e869-4395-9912-6a0b76bea246 tempest-VolumesActionsTest-210282356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-42232683-3fce-4eed-ba62-8fbf31925783" returned: 0 in 0.844s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:51:59 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-640b75b2-b149-498c-9ce2-d6db24b3737f tempest-VolumesGetTest-901652034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee214819-2c70-4775-8e8c-aa590e7efffa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T17:51:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2042719565',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63ab0fdb-1014-4a84-9921-9e3e4482d948,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2427e68dfc641f3844a8667f3020ea8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T17:51:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T17:51:59Z,use_quota=True,user_id='faeb231eb6a04c5bbd7ba1e8049b6120',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:51:59 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-640b75b2-b149-498c-9ce2-d6db24b3737f tempest-VolumesGetTest-901652034 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59ae6968-96ff-4a1b-8c21-dd23fe97ba1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:51:59 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-640b75b2-b149-498c-9ce2-d6db24b3737f tempest-VolumesGetTest-901652034 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59ae6968-96ff-4a1b-8c21-dd23fe97ba1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:51:59 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-640b75b2-b149-498c-9ce2-d6db24b3737f tempest-VolumesGetTest-901652034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe5b3d33-3e9c-4934-a4d7-24b5727d2865) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:51:59 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-640b75b2-b149-498c-9ce2-d6db24b3737f tempest-VolumesGetTest-901652034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe5b3d33-3e9c-4934-a4d7-24b5727d2865) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '63ab0fdb-1014-4a84-9921-9e3e4482d948', 'volume_name': 'volume-63ab0fdb-1014-4a84-9921-9e3e4482d948', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:51:59 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-640b75b2-b149-498c-9ce2-d6db24b3737f tempest-VolumesGetTest-901652034 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1db067e7-45b3-4adf-a870-6e29139aeeeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:51:59 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-640b75b2-b149-498c-9ce2-d6db24b3737f tempest-VolumesGetTest-901652034 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1db067e7-45b3-4adf-a870-6e29139aeeeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:51:59 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-640b75b2-b149-498c-9ce2-d6db24b3737f tempest-VolumesGetTest-901652034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c782d90a-b70c-4b39-939f-10247d7796f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:51:59 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-640b75b2-b149-498c-9ce2-d6db24b3737f tempest-VolumesGetTest-901652034 None] Volume 63ab0fdb-1014-4a84-9921-9e3e4482d948: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-63ab0fdb-1014-4a84-9921-9e3e4482d948', 'volume_size': 1}
Jul 02 19:51:59 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-640b75b2-b149-498c-9ce2-d6db24b3737f tempest-VolumesGetTest-901652034 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:51:59 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-640b75b2-b149-498c-9ce2-d6db24b3737f tempest-VolumesGetTest-901652034 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:51:59 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-640b75b2-b149-498c-9ce2-d6db24b3737f tempest-VolumesGetTest-901652034 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce906cb830>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T17:51:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2042719565',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63ab0fdb-1014-4a84-9921-9e3e4482d948,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2427e68dfc641f3844a8667f3020ea8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T17:51:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T17:51:59Z,use_quota=True,user_id='faeb231eb6a04c5bbd7ba1e8049b6120',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)}" {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 19:51:59 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-640b75b2-b149-498c-9ce2-d6db24b3737f tempest-VolumesGetTest-901652034 None] Creating volume 63ab0fdb-1014-4a84-9921-9e3e4482d948 {{(pid=86639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 19:51:59 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-640b75b2-b149-498c-9ce2-d6db24b3737f tempest-VolumesGetTest-901652034 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:51:59 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-640b75b2-b149-498c-9ce2-d6db24b3737f tempest-VolumesGetTest-901652034 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:51:59 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-640b75b2-b149-498c-9ce2-d6db24b3737f tempest-VolumesGetTest-901652034 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 19:51:59 devstack sudo[97326]: pam_unix(sudo:session): session closed for user root
Jul 02 19:51:59 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-640b75b2-b149-498c-9ce2-d6db24b3737f tempest-VolumesGetTest-901652034 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 19:51:59 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-640b75b2-b149-498c-9ce2-d6db24b3737f tempest-VolumesGetTest-901652034 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:51:59 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-640b75b2-b149-498c-9ce2-d6db24b3737f tempest-VolumesGetTest-901652034 None] Selected osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92 as target Quobyte volume. {{(pid=86639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 19:51:59 devstack cinder-volume[86639]: INFO cinder.volume.drivers.remotefs [None req-640b75b2-b149-498c-9ce2-d6db24b3737f tempest-VolumesGetTest-901652034 None] casted to osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92
Jul 02 19:51:59 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-640b75b2-b149-498c-9ce2-d6db24b3737f tempest-VolumesGetTest-901652034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-63ab0fdb-1014-4a84-9921-9e3e4482d948 1073741824 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:51:59 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-646217ef-e869-4395-9912-6a0b76bea246 tempest-VolumesActionsTest-210282356 None] Lock "cinder-quobyte-42232683-3fce-4eed-ba62-8fbf31925783" released by "delete_volume" :: held 1.861s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:51:59 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-48cd2e14-d132-4fac-8efd-cc9526129273 tempest-VolumesGetTest-901652034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e" returned: 0 in 0.830s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:51:59 devstack cinder-volume[86639]: DEBUG cinder.manager [None req-48cd2e14-d132-4fac-8efd-cc9526129273 tempest-VolumesGetTest-901652034 None] Notifying Schedulers of capabilities ... {{(pid=86639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 19:51:59 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-48cd2e14-d132-4fac-8efd-cc9526129273 tempest-VolumesGetTest-901652034 None] Deleted volume successfully.
Jul 02 19:51:59 devstack sudo[97333]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-63ab0fdb-1014-4a84-9921-9e3e4482d948 1073741824
Jul 02 19:51:59 devstack sudo[97333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:51:59 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-48cd2e14-d132-4fac-8efd-cc9526129273 tempest-VolumesGetTest-901652034 None] Lock "cinder-c773e4c9-08ed-4793-9a96-e4eeec3f0fb6-delete_volume" released by "delete_volume" :: held 3.118s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:51:59 devstack cinder-volume[86639]: DEBUG cinder.quota [None req-646217ef-e869-4395-9912-6a0b76bea246 tempest-VolumesActionsTest-210282356 None] Created reservations ['1a900066-c6f0-48d8-90ed-d3cbae6a1956', '314405ab-0e2d-4e58-8d52-01508d867558', '5596ac12-1f6b-41d8-aa15-9289cb62c27a', '02ed4987-ff9f-4672-8e65-78b944c08dfa'] {{(pid=86639) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 19:51:59 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-646217ef-e869-4395-9912-6a0b76bea246 tempest-VolumesActionsTest-210282356 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:51:59 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-646217ef-e869-4395-9912-6a0b76bea246 tempest-VolumesActionsTest-210282356 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:51:59 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-646217ef-e869-4395-9912-6a0b76bea246 tempest-VolumesActionsTest-210282356 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 19:51:59 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-646217ef-e869-4395-9912-6a0b76bea246 tempest-VolumesActionsTest-210282356 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 19:51:59 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-646217ef-e869-4395-9912-6a0b76bea246 tempest-VolumesActionsTest-210282356 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:51:59 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-646217ef-e869-4395-9912-6a0b76bea246 tempest-VolumesActionsTest-210282356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:51:59 devstack sudo[97335]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e
Jul 02 19:51:59 devstack sudo[97335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:52:00 devstack sudo[97335]: pam_unix(sudo:session): session closed for user root
Jul 02 19:52:00 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-646217ef-e869-4395-9912-6a0b76bea246 tempest-VolumesActionsTest-210282356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e" returned: 0 in 0.725s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:52:00 devstack cinder-volume[86639]: DEBUG cinder.manager [None req-646217ef-e869-4395-9912-6a0b76bea246 tempest-VolumesActionsTest-210282356 None] Notifying Schedulers of capabilities ... {{(pid=86639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 19:52:00 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-646217ef-e869-4395-9912-6a0b76bea246 tempest-VolumesActionsTest-210282356 None] Deleted volume successfully.
Jul 02 19:52:00 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-646217ef-e869-4395-9912-6a0b76bea246 tempest-VolumesActionsTest-210282356 None] Lock "cinder-42232683-3fce-4eed-ba62-8fbf31925783-delete_volume" released by "delete_volume" :: held 2.887s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:52:00 devstack cinder-volume[86639]: DEBUG cinder.volume.flows.manager.create_volume [None req-e07a0c1f-b5d2-458d-94a0-2afb569ba268 tempest-VolumesActionsTest-1228615496 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 19:52:00 devstack sudo[97333]: pam_unix(sudo:session): session closed for user root
Jul 02 19:52:00 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-e07a0c1f-b5d2-458d-94a0-2afb569ba268 tempest-VolumesActionsTest-1228615496 None] Flow 'volume_create_manager' (17f99ec9-a529-46b9-8450-15024df96d8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 19:52:00 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-e07a0c1f-b5d2-458d-94a0-2afb569ba268 tempest-VolumesActionsTest-1228615496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a301add-c10f-4dd3-a740-cb2744f502a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:52:00 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-640b75b2-b149-498c-9ce2-d6db24b3737f tempest-VolumesGetTest-901652034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-63ab0fdb-1014-4a84-9921-9e3e4482d948 1073741824" returned: 0 in 1.024s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:52:00 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-e07a0c1f-b5d2-458d-94a0-2afb569ba268 tempest-VolumesActionsTest-1228615496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a301add-c10f-4dd3-a740-cb2744f502a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T17:52:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1899068437',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0721af0e-458d-443f-bdbb-221295da8fb0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2f0573874b94459818ba0ae6982b9a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T17:52:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T17:52:00Z,use_quota=True,user_id='b348b993dc1042c0ad54fb21d75aca2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:52:00 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-e07a0c1f-b5d2-458d-94a0-2afb569ba268 tempest-VolumesActionsTest-1228615496 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88044cd8-b490-4e23-b008-080d91dd8f68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:52:00 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-e07a0c1f-b5d2-458d-94a0-2afb569ba268 tempest-VolumesActionsTest-1228615496 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88044cd8-b490-4e23-b008-080d91dd8f68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:52:00 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-e07a0c1f-b5d2-458d-94a0-2afb569ba268 tempest-VolumesActionsTest-1228615496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (317dd27e-8f9e-40ba-af9f-afbc46abe5cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:52:00 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-e07a0c1f-b5d2-458d-94a0-2afb569ba268 tempest-VolumesActionsTest-1228615496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (317dd27e-8f9e-40ba-af9f-afbc46abe5cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0721af0e-458d-443f-bdbb-221295da8fb0', 'volume_name': 'volume-0721af0e-458d-443f-bdbb-221295da8fb0', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:52:00 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-e07a0c1f-b5d2-458d-94a0-2afb569ba268 tempest-VolumesActionsTest-1228615496 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8f95695-7541-4f36-aedc-1930c48b62f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:52:00 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-e07a0c1f-b5d2-458d-94a0-2afb569ba268 tempest-VolumesActionsTest-1228615496 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8f95695-7541-4f36-aedc-1930c48b62f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:52:00 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-e07a0c1f-b5d2-458d-94a0-2afb569ba268 tempest-VolumesActionsTest-1228615496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9cd8ca43-70fd-4127-bc8b-d96f57b0ab5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:52:00 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-e07a0c1f-b5d2-458d-94a0-2afb569ba268 tempest-VolumesActionsTest-1228615496 None] Volume 0721af0e-458d-443f-bdbb-221295da8fb0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0721af0e-458d-443f-bdbb-221295da8fb0', 'volume_size': 1}
Jul 02 19:52:00 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-e07a0c1f-b5d2-458d-94a0-2afb569ba268 tempest-VolumesActionsTest-1228615496 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:52:00 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-640b75b2-b149-498c-9ce2-d6db24b3737f tempest-VolumesGetTest-901652034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-63ab0fdb-1014-4a84-9921-9e3e4482d948 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:52:00 devstack sudo[97342]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-63ab0fdb-1014-4a84-9921-9e3e4482d948
Jul 02 19:52:00 devstack sudo[97342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:52:01 devstack sudo[97342]: pam_unix(sudo:session): session closed for user root
Jul 02 19:52:01 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-640b75b2-b149-498c-9ce2-d6db24b3737f tempest-VolumesGetTest-901652034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-63ab0fdb-1014-4a84-9921-9e3e4482d948" returned: 0 in 0.635s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:52:01 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-640b75b2-b149-498c-9ce2-d6db24b3737f tempest-VolumesGetTest-901652034 None] <== create_volume: return (1757ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'} {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 19:52:01 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-640b75b2-b149-498c-9ce2-d6db24b3737f tempest-VolumesGetTest-901652034 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.761s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:52:01 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-e07a0c1f-b5d2-458d-94a0-2afb569ba268 tempest-VolumesActionsTest-1228615496 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.667s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:52:01 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-e07a0c1f-b5d2-458d-94a0-2afb569ba268 tempest-VolumesActionsTest-1228615496 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce906cb830>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T17:52:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1899068437',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0721af0e-458d-443f-bdbb-221295da8fb0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2f0573874b94459818ba0ae6982b9a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T17:52:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T17:52:00Z,use_quota=True,user_id='b348b993dc1042c0ad54fb21d75aca2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)}" {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 19:52:01 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-e07a0c1f-b5d2-458d-94a0-2afb569ba268 tempest-VolumesActionsTest-1228615496 None] Creating volume 0721af0e-458d-443f-bdbb-221295da8fb0 {{(pid=86639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 19:52:01 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-e07a0c1f-b5d2-458d-94a0-2afb569ba268 tempest-VolumesActionsTest-1228615496 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:52:01 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-e07a0c1f-b5d2-458d-94a0-2afb569ba268 tempest-VolumesActionsTest-1228615496 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:52:01 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-e07a0c1f-b5d2-458d-94a0-2afb569ba268 tempest-VolumesActionsTest-1228615496 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 19:52:01 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-e07a0c1f-b5d2-458d-94a0-2afb569ba268 tempest-VolumesActionsTest-1228615496 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 19:52:01 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-e07a0c1f-b5d2-458d-94a0-2afb569ba268 tempest-VolumesActionsTest-1228615496 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:52:01 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-e07a0c1f-b5d2-458d-94a0-2afb569ba268 tempest-VolumesActionsTest-1228615496 None] Selected osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92 as target Quobyte volume. {{(pid=86639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 19:52:01 devstack cinder-volume[86639]: INFO cinder.volume.drivers.remotefs [None req-e07a0c1f-b5d2-458d-94a0-2afb569ba268 tempest-VolumesActionsTest-1228615496 None] casted to osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92
Jul 02 19:52:01 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-e07a0c1f-b5d2-458d-94a0-2afb569ba268 tempest-VolumesActionsTest-1228615496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-0721af0e-458d-443f-bdbb-221295da8fb0 1073741824 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:52:01 devstack sudo[97345]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-0721af0e-458d-443f-bdbb-221295da8fb0 1073741824
Jul 02 19:52:01 devstack sudo[97345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:52:01 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-640b75b2-b149-498c-9ce2-d6db24b3737f tempest-VolumesGetTest-901652034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c782d90a-b70c-4b39-939f-10247d7796f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63ab0fdb-1014-4a84-9921-9e3e4482d948', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:52:01 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-640b75b2-b149-498c-9ce2-d6db24b3737f tempest-VolumesGetTest-901652034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9909b3eb-5f87-4f6a-9375-511139b2953f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:52:01 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-640b75b2-b149-498c-9ce2-d6db24b3737f tempest-VolumesGetTest-901652034 None] Volume volume-63ab0fdb-1014-4a84-9921-9e3e4482d948 (63ab0fdb-1014-4a84-9921-9e3e4482d948): created successfully
Jul 02 19:52:01 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-640b75b2-b149-498c-9ce2-d6db24b3737f tempest-VolumesGetTest-901652034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9909b3eb-5f87-4f6a-9375-511139b2953f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:52:01 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-640b75b2-b149-498c-9ce2-d6db24b3737f tempest-VolumesGetTest-901652034 None] Flow 'volume_create_manager' (297ebbf7-7b91-42a6-a4e8-e576cfa58304) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 19:52:01 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-640b75b2-b149-498c-9ce2-d6db24b3737f tempest-VolumesGetTest-901652034 None] Created volume successfully.
Jul 02 19:52:01 devstack cinder-volume[86639]: DEBUG cinder.volume.flows.manager.create_volume [None req-2969ddbe-ae8c-4a9c-a014-a556ee6ddefa tempest-VolumesGetTest-901652034 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 19:52:01 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-2969ddbe-ae8c-4a9c-a014-a556ee6ddefa tempest-VolumesGetTest-901652034 None] Flow 'volume_create_manager' (dfe24bc8-6f19-4355-9d8d-d8a44b0ad6a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 19:52:01 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-2969ddbe-ae8c-4a9c-a014-a556ee6ddefa tempest-VolumesGetTest-901652034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e59108e0-d4a6-45e6-b201-84b4b383b5c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:52:01 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-2969ddbe-ae8c-4a9c-a014-a556ee6ddefa tempest-VolumesGetTest-901652034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e59108e0-d4a6-45e6-b201-84b4b383b5c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T17:52:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-282239593',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ceeed93-cccb-4b67-9135-9b7ee53c5492,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='d2427e68dfc641f3844a8667f3020ea8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T17:52:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=63ab0fdb-1014-4a84-9921-9e3e4482d948,status='creating',terminated_at=None,updated_at=2026-07-02T17:52:02Z,use_quota=True,user_id='faeb231eb6a04c5bbd7ba1e8049b6120',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:52:01 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-2969ddbe-ae8c-4a9c-a014-a556ee6ddefa tempest-VolumesGetTest-901652034 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24dd747d-9fc7-4353-b259-592956b25fa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:52:01 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-2969ddbe-ae8c-4a9c-a014-a556ee6ddefa tempest-VolumesGetTest-901652034 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24dd747d-9fc7-4353-b259-592956b25fa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:52:01 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-2969ddbe-ae8c-4a9c-a014-a556ee6ddefa tempest-VolumesGetTest-901652034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d6b33df-1f58-46e0-b8c0-ae821eb301fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:52:01 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-2969ddbe-ae8c-4a9c-a014-a556ee6ddefa tempest-VolumesGetTest-901652034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d6b33df-1f58-46e0-b8c0-ae821eb301fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '9ceeed93-cccb-4b67-9135-9b7ee53c5492', 'volume_name': 'volume-9ceeed93-cccb-4b67-9135-9b7ee53c5492', 'volume_size': 1, 'source_volid': '63ab0fdb-1014-4a84-9921-9e3e4482d948', 'source_volstatus': 'available'}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:52:01 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-2969ddbe-ae8c-4a9c-a014-a556ee6ddefa tempest-VolumesGetTest-901652034 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2b40d72-fdd3-454d-8a07-e7e60c251158) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:52:02 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-2969ddbe-ae8c-4a9c-a014-a556ee6ddefa tempest-VolumesGetTest-901652034 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2b40d72-fdd3-454d-8a07-e7e60c251158) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:52:02 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-2969ddbe-ae8c-4a9c-a014-a556ee6ddefa tempest-VolumesGetTest-901652034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a9276e4-9da9-4670-adaa-e3daaba5eb48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:52:02 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-2969ddbe-ae8c-4a9c-a014-a556ee6ddefa tempest-VolumesGetTest-901652034 None] Volume 9ceeed93-cccb-4b67-9135-9b7ee53c5492: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-9ceeed93-cccb-4b67-9135-9b7ee53c5492', 'volume_size': 1, 'source_volid': '63ab0fdb-1014-4a84-9921-9e3e4482d948', 'source_volstatus': 'available'}
Jul 02 19:52:02 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-2969ddbe-ae8c-4a9c-a014-a556ee6ddefa tempest-VolumesGetTest-901652034 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:52:02 devstack sudo[97345]: pam_unix(sudo:session): session closed for user root
Jul 02 19:52:02 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-e07a0c1f-b5d2-458d-94a0-2afb569ba268 tempest-VolumesActionsTest-1228615496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-0721af0e-458d-443f-bdbb-221295da8fb0 1073741824" returned: 0 in 1.184s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:52:02 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-e07a0c1f-b5d2-458d-94a0-2afb569ba268 tempest-VolumesActionsTest-1228615496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-0721af0e-458d-443f-bdbb-221295da8fb0 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:52:02 devstack sudo[97351]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-0721af0e-458d-443f-bdbb-221295da8fb0
Jul 02 19:52:02 devstack sudo[97351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:52:03 devstack sudo[97351]: pam_unix(sudo:session): session closed for user root
Jul 02 19:52:03 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-e07a0c1f-b5d2-458d-94a0-2afb569ba268 tempest-VolumesActionsTest-1228615496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-0721af0e-458d-443f-bdbb-221295da8fb0" returned: 0 in 0.784s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:52:03 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-e07a0c1f-b5d2-458d-94a0-2afb569ba268 tempest-VolumesActionsTest-1228615496 None] <== create_volume: return (2021ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'} {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 19:52:03 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-e07a0c1f-b5d2-458d-94a0-2afb569ba268 tempest-VolumesActionsTest-1228615496 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.025s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:52:03 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-2969ddbe-ae8c-4a9c-a014-a556ee6ddefa tempest-VolumesGetTest-901652034 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 1.061s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:52:03 devstack cinder-volume[86639]: INFO cinder.volume.drivers.remotefs [None req-2969ddbe-ae8c-4a9c-a014-a556ee6ddefa tempest-VolumesGetTest-901652034 None] Cloning volume 63ab0fdb-1014-4a84-9921-9e3e4482d948 to volume 9ceeed93-cccb-4b67-9135-9b7ee53c5492
Jul 02 19:52:03 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-e07a0c1f-b5d2-458d-94a0-2afb569ba268 tempest-VolumesActionsTest-1228615496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9cd8ca43-70fd-4127-bc8b-d96f57b0ab5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0721af0e-458d-443f-bdbb-221295da8fb0', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:52:03 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-e07a0c1f-b5d2-458d-94a0-2afb569ba268 tempest-VolumesActionsTest-1228615496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c10bd9a-dd88-4b23-b86e-e34e92dcf60a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:52:03 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-e07a0c1f-b5d2-458d-94a0-2afb569ba268 tempest-VolumesActionsTest-1228615496 None] Volume volume-0721af0e-458d-443f-bdbb-221295da8fb0 (0721af0e-458d-443f-bdbb-221295da8fb0): created successfully
Jul 02 19:52:03 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-e07a0c1f-b5d2-458d-94a0-2afb569ba268 tempest-VolumesActionsTest-1228615496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c10bd9a-dd88-4b23-b86e-e34e92dcf60a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:52:03 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-e07a0c1f-b5d2-458d-94a0-2afb569ba268 tempest-VolumesActionsTest-1228615496 None] Flow 'volume_create_manager' (17f99ec9-a529-46b9-8450-15024df96d8c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 19:52:03 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-2969ddbe-ae8c-4a9c-a014-a556ee6ddefa tempest-VolumesGetTest-901652034 None] Creating offline snapshot 0ec67c4e-15bf-416b-86b1-175fedb47292 of volume 63ab0fdb-1014-4a84-9921-9e3e4482d948 {{(pid=86639) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 02 19:52:03 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-e07a0c1f-b5d2-458d-94a0-2afb569ba268 tempest-VolumesActionsTest-1228615496 None] Created volume successfully.
Jul 02 19:52:03 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[680edd1d-4a89-4c86-9927-d34189d39074]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 19:52:03 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-2969ddbe-ae8c-4a9c-a014-a556ee6ddefa tempest-VolumesGetTest-901652034 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-63ab0fdb-1014-4a84-9921-9e3e4482d948 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:52:03 devstack sudo[97359]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-63ab0fdb-1014-4a84-9921-9e3e4482d948
Jul 02 19:52:03 devstack sudo[97359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:52:04 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-841ba045-b1b3-41f0-88d9-e64006112b09 tempest-VolumesActionsTest-210282356 None] Acquiring lock "cinder-0721af0e-458d-443f-bdbb-221295da8fb0-delete_volume" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:52:04 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-841ba045-b1b3-41f0-88d9-e64006112b09 tempest-VolumesActionsTest-210282356 None] Lock "cinder-0721af0e-458d-443f-bdbb-221295da8fb0-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:52:04 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-841ba045-b1b3-41f0-88d9-e64006112b09 tempest-VolumesActionsTest-210282356 None] Acquiring lock "cinder-quobyte-0721af0e-458d-443f-bdbb-221295da8fb0" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:52:04 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-841ba045-b1b3-41f0-88d9-e64006112b09 tempest-VolumesActionsTest-210282356 None] Lock "cinder-quobyte-0721af0e-458d-443f-bdbb-221295da8fb0" acquired by "delete_volume" :: waited 0.024s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:52:04 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a76aa05-7a59-471a-8926-1d2894f12409]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 19:52:04 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-841ba045-b1b3-41f0-88d9-e64006112b09 tempest-VolumesActionsTest-210282356 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-0721af0e-458d-443f-bdbb-221295da8fb0 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:52:04 devstack sudo[97359]: pam_unix(sudo:session): session closed for user root
Jul 02 19:52:04 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-2969ddbe-ae8c-4a9c-a014-a556ee6ddefa tempest-VolumesGetTest-901652034 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-63ab0fdb-1014-4a84-9921-9e3e4482d948" returned: 0 in 1.145s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:52:04 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-2969ddbe-ae8c-4a9c-a014-a556ee6ddefa tempest-VolumesGetTest-901652034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-63ab0fdb-1014-4a84-9921-9e3e4482d948,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-63ab0fdb-1014-4a84-9921-9e3e4482d948.0ec67c4e-15bf-416b-86b1-175fedb47292 1G {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:52:04 devstack sudo[97366]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-63ab0fdb-1014-4a84-9921-9e3e4482d948,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-63ab0fdb-1014-4a84-9921-9e3e4482d948.0ec67c4e-15bf-416b-86b1-175fedb47292 1G
Jul 02 19:52:04 devstack sudo[97366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:52:04 devstack sudo[97365]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-0721af0e-458d-443f-bdbb-221295da8fb0
Jul 02 19:52:04 devstack sudo[97365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:52:05 devstack sudo[97365]: pam_unix(sudo:session): session closed for user root
Jul 02 19:52:05 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-841ba045-b1b3-41f0-88d9-e64006112b09 tempest-VolumesActionsTest-210282356 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-0721af0e-458d-443f-bdbb-221295da8fb0" returned: 0 in 0.960s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:52:05 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-841ba045-b1b3-41f0-88d9-e64006112b09 tempest-VolumesActionsTest-210282356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-0721af0e-458d-443f-bdbb-221295da8fb0 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:52:05 devstack sudo[97376]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-0721af0e-458d-443f-bdbb-221295da8fb0
Jul 02 19:52:05 devstack sudo[97376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:52:05 devstack sudo[97366]: pam_unix(sudo:session): session closed for user root
Jul 02 19:52:05 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-2969ddbe-ae8c-4a9c-a014-a556ee6ddefa tempest-VolumesGetTest-901652034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-63ab0fdb-1014-4a84-9921-9e3e4482d948,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-63ab0fdb-1014-4a84-9921-9e3e4482d948.0ec67c4e-15bf-416b-86b1-175fedb47292 1G" returned: 0 in 1.118s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:52:05 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-2969ddbe-ae8c-4a9c-a014-a556ee6ddefa tempest-VolumesGetTest-901652034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-63ab0fdb-1014-4a84-9921-9e3e4482d948 -F qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-63ab0fdb-1014-4a84-9921-9e3e4482d948.0ec67c4e-15bf-416b-86b1-175fedb47292 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:52:05 devstack sudo[97379]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-63ab0fdb-1014-4a84-9921-9e3e4482d948 -F qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-63ab0fdb-1014-4a84-9921-9e3e4482d948.0ec67c4e-15bf-416b-86b1-175fedb47292
Jul 02 19:52:05 devstack sudo[97379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:52:06 devstack sudo[97376]: pam_unix(sudo:session): session closed for user root
Jul 02 19:52:06 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-841ba045-b1b3-41f0-88d9-e64006112b09 tempest-VolumesActionsTest-210282356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-0721af0e-458d-443f-bdbb-221295da8fb0" returned: 0 in 0.820s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:52:06 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-841ba045-b1b3-41f0-88d9-e64006112b09 tempest-VolumesActionsTest-210282356 None] Lock "cinder-quobyte-0721af0e-458d-443f-bdbb-221295da8fb0" released by "delete_volume" :: held 1.858s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:52:06 devstack cinder-volume[86639]: DEBUG cinder.quota [None req-841ba045-b1b3-41f0-88d9-e64006112b09 tempest-VolumesActionsTest-210282356 None] Created reservations ['24a22652-7196-431e-926e-91b12fcc35cc', '041c3523-8df9-4693-bd40-4c798d3e9ecf', '67292c1b-c30f-49a5-b997-4922f7fddd5d', '41a16dc4-d997-4eb2-b7b4-c733b97fde3f'] {{(pid=86639) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 19:52:06 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-841ba045-b1b3-41f0-88d9-e64006112b09 tempest-VolumesActionsTest-210282356 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:52:06 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-841ba045-b1b3-41f0-88d9-e64006112b09 tempest-VolumesActionsTest-210282356 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:52:06 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-841ba045-b1b3-41f0-88d9-e64006112b09 tempest-VolumesActionsTest-210282356 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 19:52:06 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-841ba045-b1b3-41f0-88d9-e64006112b09 tempest-VolumesActionsTest-210282356 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 19:52:06 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-841ba045-b1b3-41f0-88d9-e64006112b09 tempest-VolumesActionsTest-210282356 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:52:06 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-841ba045-b1b3-41f0-88d9-e64006112b09 tempest-VolumesActionsTest-210282356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:52:06 devstack sudo[97385]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e
Jul 02 19:52:06 devstack sudo[97385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:52:06 devstack sudo[97379]: pam_unix(sudo:session): session closed for user root
Jul 02 19:52:06 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-2969ddbe-ae8c-4a9c-a014-a556ee6ddefa tempest-VolumesGetTest-901652034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-63ab0fdb-1014-4a84-9921-9e3e4482d948 -F qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-63ab0fdb-1014-4a84-9921-9e3e4482d948.0ec67c4e-15bf-416b-86b1-175fedb47292" returned: 0 in 0.956s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:52:06 devstack cinder-volume[86639]: WARNING cinder.volume.drivers.remotefs [None req-2969ddbe-ae8c-4a9c-a014-a556ee6ddefa tempest-VolumesGetTest-901652034 None] /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-63ab0fdb-1014-4a84-9921-9e3e4482d948.0ec67c4e-15bf-416b-86b1-175fedb47292 is being set with open permissions: ugo+rw
Jul 02 19:52:06 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-2969ddbe-ae8c-4a9c-a014-a556ee6ddefa tempest-VolumesGetTest-901652034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-63ab0fdb-1014-4a84-9921-9e3e4482d948.0ec67c4e-15bf-416b-86b1-175fedb47292 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:52:06 devstack sudo[97387]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-63ab0fdb-1014-4a84-9921-9e3e4482d948.0ec67c4e-15bf-416b-86b1-175fedb47292
Jul 02 19:52:06 devstack sudo[97387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:52:07 devstack sudo[97385]: pam_unix(sudo:session): session closed for user root
Jul 02 19:52:07 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-841ba045-b1b3-41f0-88d9-e64006112b09 tempest-VolumesActionsTest-210282356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e" returned: 0 in 1.276s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:52:07 devstack cinder-volume[86639]: DEBUG cinder.manager [None req-841ba045-b1b3-41f0-88d9-e64006112b09 tempest-VolumesActionsTest-210282356 None] Notifying Schedulers of capabilities ... {{(pid=86639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 19:52:07 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-841ba045-b1b3-41f0-88d9-e64006112b09 tempest-VolumesActionsTest-210282356 None] Deleted volume successfully.
Jul 02 19:52:07 devstack cinder-volume[86639]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2e36af2-8f67-4e32-954d-549d351701d5 tempest-VolumesActionsTest-1228615496 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 19:52:07 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-c2e36af2-8f67-4e32-954d-549d351701d5 tempest-VolumesActionsTest-1228615496 None] Flow 'volume_create_manager' (23e1c76e-79ac-46f0-b807-c83e4b7095ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 19:52:07 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-c2e36af2-8f67-4e32-954d-549d351701d5 tempest-VolumesActionsTest-1228615496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ce8175e-d042-4fee-a29a-861cb50f92e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:52:07 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-c2e36af2-8f67-4e32-954d-549d351701d5 tempest-VolumesActionsTest-1228615496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ce8175e-d042-4fee-a29a-861cb50f92e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T17:52:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1361361035',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e048daaa-1799-4418-94cc-80e07708cca0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2f0573874b94459818ba0ae6982b9a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T17:52:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T17:52:07Z,use_quota=True,user_id='b348b993dc1042c0ad54fb21d75aca2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:52:07 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-c2e36af2-8f67-4e32-954d-549d351701d5 tempest-VolumesActionsTest-1228615496 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5a0879f-4620-4b88-85e1-72caca14a076) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:52:07 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-c2e36af2-8f67-4e32-954d-549d351701d5 tempest-VolumesActionsTest-1228615496 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5a0879f-4620-4b88-85e1-72caca14a076) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:52:07 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-c2e36af2-8f67-4e32-954d-549d351701d5 tempest-VolumesActionsTest-1228615496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a83909c-32e9-4cb3-9e1e-fe1ed2872b07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:52:07 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-c2e36af2-8f67-4e32-954d-549d351701d5 tempest-VolumesActionsTest-1228615496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a83909c-32e9-4cb3-9e1e-fe1ed2872b07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e048daaa-1799-4418-94cc-80e07708cca0', 'volume_name': 'volume-e048daaa-1799-4418-94cc-80e07708cca0', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:52:07 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-c2e36af2-8f67-4e32-954d-549d351701d5 tempest-VolumesActionsTest-1228615496 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23163aaf-8e84-4978-a480-8155525b477a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:52:07 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-c2e36af2-8f67-4e32-954d-549d351701d5 tempest-VolumesActionsTest-1228615496 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23163aaf-8e84-4978-a480-8155525b477a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:52:07 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-c2e36af2-8f67-4e32-954d-549d351701d5 tempest-VolumesActionsTest-1228615496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b7f25e9-98d1-4b65-9bd5-3031078ac5a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:52:07 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-c2e36af2-8f67-4e32-954d-549d351701d5 tempest-VolumesActionsTest-1228615496 None] Volume e048daaa-1799-4418-94cc-80e07708cca0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e048daaa-1799-4418-94cc-80e07708cca0', 'volume_size': 1}
Jul 02 19:52:07 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-c2e36af2-8f67-4e32-954d-549d351701d5 tempest-VolumesActionsTest-1228615496 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:52:07 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-841ba045-b1b3-41f0-88d9-e64006112b09 tempest-VolumesActionsTest-210282356 None] Lock "cinder-0721af0e-458d-443f-bdbb-221295da8fb0-delete_volume" released by "delete_volume" :: held 3.563s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:52:07 devstack sudo[97387]: pam_unix(sudo:session): session closed for user root
Jul 02 19:52:07 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-2969ddbe-ae8c-4a9c-a014-a556ee6ddefa tempest-VolumesGetTest-901652034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-63ab0fdb-1014-4a84-9921-9e3e4482d948.0ec67c4e-15bf-416b-86b1-175fedb47292" returned: 0 in 1.349s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:52:07 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-2969ddbe-ae8c-4a9c-a014-a556ee6ddefa tempest-VolumesGetTest-901652034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-63ab0fdb-1014-4a84-9921-9e3e4482d948.info {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:52:07 devstack sudo[97396]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-63ab0fdb-1014-4a84-9921-9e3e4482d948.info
Jul 02 19:52:07 devstack sudo[97396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:52:08 devstack cinder-volume[86639]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5e97088-4858-49cc-9e24-6b2e130c986d tempest-AttachVolumeNegativeTest-732301193 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 19:52:08 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-d5e97088-4858-49cc-9e24-6b2e130c986d tempest-AttachVolumeNegativeTest-732301193 None] Flow 'volume_create_manager' (5f743d48-692a-4cc6-acda-2b74bdec26e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 19:52:08 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-d5e97088-4858-49cc-9e24-6b2e130c986d tempest-AttachVolumeNegativeTest-732301193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e0d64de-74c3-4397-a3e1-87d8ff104d10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:52:08 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-d5e97088-4858-49cc-9e24-6b2e130c986d tempest-AttachVolumeNegativeTest-732301193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e0d64de-74c3-4397-a3e1-87d8ff104d10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T17:52:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1286341924',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a90521ee-e5e0-4288-accb-aee9ce00ad45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07c1a061c5c147f690026cea928da2e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T17:52:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T17:52:08Z,use_quota=True,user_id='3be7789436f643fe94460f153a717254',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:52:08 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-d5e97088-4858-49cc-9e24-6b2e130c986d tempest-AttachVolumeNegativeTest-732301193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4862e9b-a285-401a-87c0-0d55f31963a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:52:08 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-d5e97088-4858-49cc-9e24-6b2e130c986d tempest-AttachVolumeNegativeTest-732301193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4862e9b-a285-401a-87c0-0d55f31963a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:52:08 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-d5e97088-4858-49cc-9e24-6b2e130c986d tempest-AttachVolumeNegativeTest-732301193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb9ffa9f-340a-424e-a2ec-0322aca03f12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:52:08 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-d5e97088-4858-49cc-9e24-6b2e130c986d tempest-AttachVolumeNegativeTest-732301193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb9ffa9f-340a-424e-a2ec-0322aca03f12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a90521ee-e5e0-4288-accb-aee9ce00ad45', 'volume_name': 'volume-a90521ee-e5e0-4288-accb-aee9ce00ad45', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:52:08 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-d5e97088-4858-49cc-9e24-6b2e130c986d tempest-AttachVolumeNegativeTest-732301193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7eece824-2620-45a4-a6fc-bf94d29b20dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:52:08 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-d5e97088-4858-49cc-9e24-6b2e130c986d tempest-AttachVolumeNegativeTest-732301193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7eece824-2620-45a4-a6fc-bf94d29b20dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:52:08 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-d5e97088-4858-49cc-9e24-6b2e130c986d tempest-AttachVolumeNegativeTest-732301193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e13a4e79-8424-4da3-ae20-1ecff9d6fa21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:52:08 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-d5e97088-4858-49cc-9e24-6b2e130c986d tempest-AttachVolumeNegativeTest-732301193 None] Volume a90521ee-e5e0-4288-accb-aee9ce00ad45: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a90521ee-e5e0-4288-accb-aee9ce00ad45', 'volume_size': 1}
Jul 02 19:52:08 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-d5e97088-4858-49cc-9e24-6b2e130c986d tempest-AttachVolumeNegativeTest-732301193 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:52:08 devstack sudo[97396]: pam_unix(sudo:session): session closed for user root
Jul 02 19:52:08 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-2969ddbe-ae8c-4a9c-a014-a556ee6ddefa tempest-VolumesGetTest-901652034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-63ab0fdb-1014-4a84-9921-9e3e4482d948.info" returned: 0 in 0.928s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:52:08 devstack cinder-volume[86639]: WARNING cinder.volume.drivers.remotefs [None req-2969ddbe-ae8c-4a9c-a014-a556ee6ddefa tempest-VolumesGetTest-901652034 None] /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-63ab0fdb-1014-4a84-9921-9e3e4482d948.info is being set with open permissions: ugo+rw
Jul 02 19:52:08 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-2969ddbe-ae8c-4a9c-a014-a556ee6ddefa tempest-VolumesGetTest-901652034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-63ab0fdb-1014-4a84-9921-9e3e4482d948.info {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:52:08 devstack sudo[97399]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-63ab0fdb-1014-4a84-9921-9e3e4482d948.info
Jul 02 19:52:08 devstack sudo[97399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:52:09 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-2969ddbe-ae8c-4a9c-a014-a556ee6ddefa tempest-VolumesGetTest-901652034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-63ab0fdb-1014-4a84-9921-9e3e4482d948.info" returned: 0 in 0.753s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:52:09 devstack sudo[97399]: pam_unix(sudo:session): session closed for user root
Jul 02 19:52:09 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-2969ddbe-ae8c-4a9c-a014-a556ee6ddefa tempest-VolumesGetTest-901652034 None] Acquiring lock "cinder-quobyte-9ceeed93-cccb-4b67-9135-9b7ee53c5492" by "_copy_volume_from_snapshot" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:52:09 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-2969ddbe-ae8c-4a9c-a014-a556ee6ddefa tempest-VolumesGetTest-901652034 None] Lock "cinder-quobyte-9ceeed93-cccb-4b67-9135-9b7ee53c5492" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:52:09 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-2969ddbe-ae8c-4a9c-a014-a556ee6ddefa tempest-VolumesGetTest-901652034 None] snapshot: 0ec67c4e-15bf-416b-86b1-175fedb47292, volume: 9ceeed93-cccb-4b67-9135-9b7ee53c5492,  {{(pid=86639) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jul 02 19:52:09 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-2969ddbe-ae8c-4a9c-a014-a556ee6ddefa tempest-VolumesGetTest-901652034 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:52:09 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-2969ddbe-ae8c-4a9c-a014-a556ee6ddefa tempest-VolumesGetTest-901652034 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:52:09 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-2969ddbe-ae8c-4a9c-a014-a556ee6ddefa tempest-VolumesGetTest-901652034 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 19:52:09 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-2969ddbe-ae8c-4a9c-a014-a556ee6ddefa tempest-VolumesGetTest-901652034 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 19:52:09 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-2969ddbe-ae8c-4a9c-a014-a556ee6ddefa tempest-VolumesGetTest-901652034 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:52:09 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8188eec-bb43-4320-b8af-295ee89935e6]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 19:52:09 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-2969ddbe-ae8c-4a9c-a014-a556ee6ddefa tempest-VolumesGetTest-901652034 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-63ab0fdb-1014-4a84-9921-9e3e4482d948.0ec67c4e-15bf-416b-86b1-175fedb47292 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:52:09 devstack sudo[97402]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-63ab0fdb-1014-4a84-9921-9e3e4482d948.0ec67c4e-15bf-416b-86b1-175fedb47292
Jul 02 19:52:09 devstack sudo[97402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:52:10 devstack sudo[97402]: pam_unix(sudo:session): session closed for user root
Jul 02 19:52:10 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-2969ddbe-ae8c-4a9c-a014-a556ee6ddefa tempest-VolumesGetTest-901652034 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-63ab0fdb-1014-4a84-9921-9e3e4482d948.0ec67c4e-15bf-416b-86b1-175fedb47292" returned: 0 in 0.840s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:52:10 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-2969ddbe-ae8c-4a9c-a014-a556ee6ddefa tempest-VolumesGetTest-901652034 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-63ab0fdb-1014-4a84-9921-9e3e4482d948(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86639) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 02 19:52:10 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-2969ddbe-ae8c-4a9c-a014-a556ee6ddefa tempest-VolumesGetTest-901652034 None] will copy from snapshot at /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-63ab0fdb-1014-4a84-9921-9e3e4482d948 {{(pid=86639) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jul 02 19:52:10 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-2969ddbe-ae8c-4a9c-a014-a556ee6ddefa tempest-VolumesGetTest-901652034 None] Creating direct copy from snapshot {{(pid=86639) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jul 02 19:52:10 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[50872a29-0235-4cd8-be62-d77f23c560a8]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 19:52:10 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-2969ddbe-ae8c-4a9c-a014-a556ee6ddefa tempest-VolumesGetTest-901652034 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-63ab0fdb-1014-4a84-9921-9e3e4482d948 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:52:10 devstack sudo[97407]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-63ab0fdb-1014-4a84-9921-9e3e4482d948
Jul 02 19:52:10 devstack sudo[97407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:52:11 devstack sudo[97407]: pam_unix(sudo:session): session closed for user root
Jul 02 19:52:11 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-2969ddbe-ae8c-4a9c-a014-a556ee6ddefa tempest-VolumesGetTest-901652034 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-63ab0fdb-1014-4a84-9921-9e3e4482d948" returned: 0 in 0.836s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:52:11 devstack cinder-volume[86639]: DEBUG cinder.utils [None req-2969ddbe-ae8c-4a9c-a014-a556ee6ddefa tempest-VolumesGetTest-901652034 None] Path /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-9ceeed93-cccb-4b67-9135-9b7ee53c5492 not found in is_blk_device check {{(pid=86639) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 02 19:52:11 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-2969ddbe-ae8c-4a9c-a014-a556ee6ddefa tempest-VolumesGetTest-901652034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-63ab0fdb-1014-4a84-9921-9e3e4482d948 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-9ceeed93-cccb-4b67-9135-9b7ee53c5492 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:52:11 devstack sudo[97415]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-63ab0fdb-1014-4a84-9921-9e3e4482d948 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-9ceeed93-cccb-4b67-9135-9b7ee53c5492
Jul 02 19:52:11 devstack sudo[97415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:52:17 devstack sudo[97415]: pam_unix(sudo:session): session closed for user root
Jul 02 19:52:17 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-2969ddbe-ae8c-4a9c-a014-a556ee6ddefa tempest-VolumesGetTest-901652034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-63ab0fdb-1014-4a84-9921-9e3e4482d948 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-9ceeed93-cccb-4b67-9135-9b7ee53c5492" returned: 0 in 6.016s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:52:17 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[69acb1fa-fb6f-4f1f-a972-7266fe03e542]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 19:52:17 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-2969ddbe-ae8c-4a9c-a014-a556ee6ddefa tempest-VolumesGetTest-901652034 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-63ab0fdb-1014-4a84-9921-9e3e4482d948 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:52:17 devstack sudo[97428]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-63ab0fdb-1014-4a84-9921-9e3e4482d948
Jul 02 19:52:17 devstack sudo[97428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:52:18 devstack cinder-volume[86639]: DEBUG dbcounter [-] [86639] Writing DB stats cinder:SELECT=63,cinder:UPDATE=81,cinder:INSERT=23,cinder:DELETE=10 {{(pid=86639) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 02 19:52:18 devstack sudo[97428]: pam_unix(sudo:session): session closed for user root
Jul 02 19:52:18 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-2969ddbe-ae8c-4a9c-a014-a556ee6ddefa tempest-VolumesGetTest-901652034 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-63ab0fdb-1014-4a84-9921-9e3e4482d948" returned: 0 in 1.049s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:52:18 devstack cinder-volume[86639]: DEBUG cinder.image.image_utils [None req-2969ddbe-ae8c-4a9c-a014-a556ee6ddefa tempest-VolumesGetTest-901652034 None] Image conversion details: src /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-63ab0fdb-1014-4a84-9921-9e3e4482d948, size 1024.00 MB, duration 6.02 sec, destination /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-9ceeed93-cccb-4b67-9135-9b7ee53c5492 {{(pid=86639) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 02 19:52:18 devstack cinder-volume[86639]: INFO cinder.image.image_utils [None req-2969ddbe-ae8c-4a9c-a014-a556ee6ddefa tempest-VolumesGetTest-901652034 None] Converted 1024.00 MB image at 170.17 MB/s
Jul 02 19:52:18 devstack cinder-volume[86639]: WARNING cinder.volume.drivers.remotefs [None req-2969ddbe-ae8c-4a9c-a014-a556ee6ddefa tempest-VolumesGetTest-901652034 None] /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-9ceeed93-cccb-4b67-9135-9b7ee53c5492 is being set with open permissions: ugo+rw
Jul 02 19:52:18 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-2969ddbe-ae8c-4a9c-a014-a556ee6ddefa tempest-VolumesGetTest-901652034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-9ceeed93-cccb-4b67-9135-9b7ee53c5492 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:52:18 devstack sudo[97458]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-9ceeed93-cccb-4b67-9135-9b7ee53c5492
Jul 02 19:52:18 devstack sudo[97458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:52:18 devstack cinder-volume[86639]: DEBUG dbcounter [-] [86639] Writing DB stats cinder:SELECT=74,cinder:INSERT=19,cinder:UPDATE=102,cinder:DELETE=5 {{(pid=86639) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 02 19:52:19 devstack sudo[97458]: pam_unix(sudo:session): session closed for user root
Jul 02 19:52:19 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-2969ddbe-ae8c-4a9c-a014-a556ee6ddefa tempest-VolumesGetTest-901652034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-9ceeed93-cccb-4b67-9135-9b7ee53c5492" returned: 0 in 0.753s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:52:19 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-2969ddbe-ae8c-4a9c-a014-a556ee6ddefa tempest-VolumesGetTest-901652034 None] Lock "cinder-quobyte-9ceeed93-cccb-4b67-9135-9b7ee53c5492" released by "_copy_volume_from_snapshot" :: held 9.589s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:52:19 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-2969ddbe-ae8c-4a9c-a014-a556ee6ddefa tempest-VolumesGetTest-901652034 None] Acquiring lock "cinder-quobyte-0ec67c4e-15bf-416b-86b1-175fedb47292" by "_delete_snapshot" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:52:19 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-2969ddbe-ae8c-4a9c-a014-a556ee6ddefa tempest-VolumesGetTest-901652034 None] Lock "cinder-quobyte-0ec67c4e-15bf-416b-86b1-175fedb47292" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:52:19 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-2969ddbe-ae8c-4a9c-a014-a556ee6ddefa tempest-VolumesGetTest-901652034 None] Deleting offline snapshot 0ec67c4e-15bf-416b-86b1-175fedb47292 of volume 63ab0fdb-1014-4a84-9921-9e3e4482d948 {{(pid=86639) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 02 19:52:19 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-2969ddbe-ae8c-4a9c-a014-a556ee6ddefa tempest-VolumesGetTest-901652034 None] snapshot_file for this snap is: volume-63ab0fdb-1014-4a84-9921-9e3e4482d948.0ec67c4e-15bf-416b-86b1-175fedb47292 {{(pid=86639) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 02 19:52:19 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[3766f364-bcd3-4440-884e-657fb434c7fe]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 19:52:19 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-2969ddbe-ae8c-4a9c-a014-a556ee6ddefa tempest-VolumesGetTest-901652034 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-63ab0fdb-1014-4a84-9921-9e3e4482d948.0ec67c4e-15bf-416b-86b1-175fedb47292 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:52:19 devstack sudo[97461]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-63ab0fdb-1014-4a84-9921-9e3e4482d948.0ec67c4e-15bf-416b-86b1-175fedb47292
Jul 02 19:52:19 devstack sudo[97461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:52:19 devstack sudo[97461]: pam_unix(sudo:session): session closed for user root
Jul 02 19:52:19 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-2969ddbe-ae8c-4a9c-a014-a556ee6ddefa tempest-VolumesGetTest-901652034 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-63ab0fdb-1014-4a84-9921-9e3e4482d948.0ec67c4e-15bf-416b-86b1-175fedb47292" returned: 0 in 0.830s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:52:19 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-2969ddbe-ae8c-4a9c-a014-a556ee6ddefa tempest-VolumesGetTest-901652034 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-63ab0fdb-1014-4a84-9921-9e3e4482d948(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86639) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 02 19:52:20 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[25e715e9-9977-4a05-8b5f-801d45c087d0]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 19:52:20 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-2969ddbe-ae8c-4a9c-a014-a556ee6ddefa tempest-VolumesGetTest-901652034 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-63ab0fdb-1014-4a84-9921-9e3e4482d948 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:52:20 devstack sudo[97466]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-63ab0fdb-1014-4a84-9921-9e3e4482d948
Jul 02 19:52:20 devstack sudo[97466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:52:20 devstack sudo[97466]: pam_unix(sudo:session): session closed for user root
Jul 02 19:52:20 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-2969ddbe-ae8c-4a9c-a014-a556ee6ddefa tempest-VolumesGetTest-901652034 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-63ab0fdb-1014-4a84-9921-9e3e4482d948" returned: 0 in 0.840s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:52:20 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-2969ddbe-ae8c-4a9c-a014-a556ee6ddefa tempest-VolumesGetTest-901652034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-63ab0fdb-1014-4a84-9921-9e3e4482d948.0ec67c4e-15bf-416b-86b1-175fedb47292 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:52:20 devstack sudo[97471]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-63ab0fdb-1014-4a84-9921-9e3e4482d948.0ec67c4e-15bf-416b-86b1-175fedb47292
Jul 02 19:52:20 devstack sudo[97471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:52:21 devstack sudo[97471]: pam_unix(sudo:session): session closed for user root
Jul 02 19:52:21 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-2969ddbe-ae8c-4a9c-a014-a556ee6ddefa tempest-VolumesGetTest-901652034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-63ab0fdb-1014-4a84-9921-9e3e4482d948.0ec67c4e-15bf-416b-86b1-175fedb47292" returned: 0 in 0.783s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:52:21 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-2969ddbe-ae8c-4a9c-a014-a556ee6ddefa tempest-VolumesGetTest-901652034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-63ab0fdb-1014-4a84-9921-9e3e4482d948.0ec67c4e-15bf-416b-86b1-175fedb47292 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:52:21 devstack sudo[97476]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-63ab0fdb-1014-4a84-9921-9e3e4482d948.0ec67c4e-15bf-416b-86b1-175fedb47292
Jul 02 19:52:21 devstack sudo[97476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:52:22 devstack sudo[97476]: pam_unix(sudo:session): session closed for user root
Jul 02 19:52:22 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-2969ddbe-ae8c-4a9c-a014-a556ee6ddefa tempest-VolumesGetTest-901652034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-63ab0fdb-1014-4a84-9921-9e3e4482d948.0ec67c4e-15bf-416b-86b1-175fedb47292" returned: 0 in 0.656s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:52:22 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-2969ddbe-ae8c-4a9c-a014-a556ee6ddefa tempest-VolumesGetTest-901652034 None] Lock "cinder-quobyte-0ec67c4e-15bf-416b-86b1-175fedb47292" released by "_delete_snapshot" :: held 3.209s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:52:22 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-2969ddbe-ae8c-4a9c-a014-a556ee6ddefa tempest-VolumesGetTest-901652034 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 19.293s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:52:22 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-c2e36af2-8f67-4e32-954d-549d351701d5 tempest-VolumesActionsTest-1228615496 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.703s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:52:22 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-c2e36af2-8f67-4e32-954d-549d351701d5 tempest-VolumesActionsTest-1228615496 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce906cb830>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T17:52:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1361361035',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e048daaa-1799-4418-94cc-80e07708cca0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2f0573874b94459818ba0ae6982b9a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T17:52:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T17:52:07Z,use_quota=True,user_id='b348b993dc1042c0ad54fb21d75aca2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)}" {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 19:52:22 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-c2e36af2-8f67-4e32-954d-549d351701d5 tempest-VolumesActionsTest-1228615496 None] Creating volume e048daaa-1799-4418-94cc-80e07708cca0 {{(pid=86639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 19:52:22 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-c2e36af2-8f67-4e32-954d-549d351701d5 tempest-VolumesActionsTest-1228615496 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:52:22 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-c2e36af2-8f67-4e32-954d-549d351701d5 tempest-VolumesActionsTest-1228615496 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:52:22 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-c2e36af2-8f67-4e32-954d-549d351701d5 tempest-VolumesActionsTest-1228615496 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 19:52:22 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-c2e36af2-8f67-4e32-954d-549d351701d5 tempest-VolumesActionsTest-1228615496 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 19:52:22 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-c2e36af2-8f67-4e32-954d-549d351701d5 tempest-VolumesActionsTest-1228615496 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:52:22 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-c2e36af2-8f67-4e32-954d-549d351701d5 tempest-VolumesActionsTest-1228615496 None] Selected osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92 as target Quobyte volume. {{(pid=86639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 19:52:22 devstack cinder-volume[86639]: INFO cinder.volume.drivers.remotefs [None req-c2e36af2-8f67-4e32-954d-549d351701d5 tempest-VolumesActionsTest-1228615496 None] casted to osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92
Jul 02 19:52:22 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-c2e36af2-8f67-4e32-954d-549d351701d5 tempest-VolumesActionsTest-1228615496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-e048daaa-1799-4418-94cc-80e07708cca0 1073741824 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:52:22 devstack sudo[97479]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-e048daaa-1799-4418-94cc-80e07708cca0 1073741824
Jul 02 19:52:22 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-2969ddbe-ae8c-4a9c-a014-a556ee6ddefa tempest-VolumesGetTest-901652034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a9276e4-9da9-4670-adaa-e3daaba5eb48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ceeed93-cccb-4b67-9135-9b7ee53c5492', 'volume_size': 1, 'source_volid': '63ab0fdb-1014-4a84-9921-9e3e4482d948', 'source_volstatus': 'available'}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:52:22 devstack sudo[97479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:52:22 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-2969ddbe-ae8c-4a9c-a014-a556ee6ddefa tempest-VolumesGetTest-901652034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2dbc1de3-9345-45a6-bbee-a37fb1ff95d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:52:22 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-2969ddbe-ae8c-4a9c-a014-a556ee6ddefa tempest-VolumesGetTest-901652034 None] Volume volume-9ceeed93-cccb-4b67-9135-9b7ee53c5492 (9ceeed93-cccb-4b67-9135-9b7ee53c5492): created successfully
Jul 02 19:52:22 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-2969ddbe-ae8c-4a9c-a014-a556ee6ddefa tempest-VolumesGetTest-901652034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2dbc1de3-9345-45a6-bbee-a37fb1ff95d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:52:22 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-2969ddbe-ae8c-4a9c-a014-a556ee6ddefa tempest-VolumesGetTest-901652034 None] Flow 'volume_create_manager' (dfe24bc8-6f19-4355-9d8d-d8a44b0ad6a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 19:52:22 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-2969ddbe-ae8c-4a9c-a014-a556ee6ddefa tempest-VolumesGetTest-901652034 None] Created volume successfully.
Jul 02 19:52:23 devstack sudo[97479]: pam_unix(sudo:session): session closed for user root
Jul 02 19:52:23 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-c2e36af2-8f67-4e32-954d-549d351701d5 tempest-VolumesActionsTest-1228615496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-e048daaa-1799-4418-94cc-80e07708cca0 1073741824" returned: 0 in 0.894s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:52:23 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-c2e36af2-8f67-4e32-954d-549d351701d5 tempest-VolumesActionsTest-1228615496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-e048daaa-1799-4418-94cc-80e07708cca0 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:52:23 devstack sudo[97485]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-e048daaa-1799-4418-94cc-80e07708cca0
Jul 02 19:52:23 devstack sudo[97485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:52:23 devstack cinder-volume[86639]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ff0b9ef-6648-4173-a742-81f77b7468ff tempest-VolumesGetTest-901652034 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 19:52:23 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-4ff0b9ef-6648-4173-a742-81f77b7468ff tempest-VolumesGetTest-901652034 None] Flow 'volume_create_manager' (93eae02b-387c-417a-870a-e1afa77fa75a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 19:52:23 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-4ff0b9ef-6648-4173-a742-81f77b7468ff tempest-VolumesGetTest-901652034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d824ed1-9148-4fd5-a8a1-52e17ed147fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:52:23 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-4ff0b9ef-6648-4173-a742-81f77b7468ff tempest-VolumesGetTest-901652034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d824ed1-9148-4fd5-a8a1-52e17ed147fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T17:52:23Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-884181195',display_name='tempest-VolumesGetTest-Volume-1824863402',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ad6351d-2ee9-4b17-a684-c7716b05598d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2427e68dfc641f3844a8667f3020ea8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T17:52:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T17:52:24Z,use_quota=True,user_id='faeb231eb6a04c5bbd7ba1e8049b6120',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:52:23 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-4ff0b9ef-6648-4173-a742-81f77b7468ff tempest-VolumesGetTest-901652034 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d541da68-b62a-4820-bbae-58f032458371) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:52:23 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-4ff0b9ef-6648-4173-a742-81f77b7468ff tempest-VolumesGetTest-901652034 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d541da68-b62a-4820-bbae-58f032458371) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:52:23 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-4ff0b9ef-6648-4173-a742-81f77b7468ff tempest-VolumesGetTest-901652034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aae66de0-9fb9-4185-9aec-46e078ca6411) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:52:23 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-4ff0b9ef-6648-4173-a742-81f77b7468ff tempest-VolumesGetTest-901652034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aae66de0-9fb9-4185-9aec-46e078ca6411) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8ad6351d-2ee9-4b17-a684-c7716b05598d', 'volume_name': 'volume-8ad6351d-2ee9-4b17-a684-c7716b05598d', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:52:23 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-4ff0b9ef-6648-4173-a742-81f77b7468ff tempest-VolumesGetTest-901652034 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c46e4aae-7442-4bcf-866d-433dbff2cce1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:52:23 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-4ff0b9ef-6648-4173-a742-81f77b7468ff tempest-VolumesGetTest-901652034 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c46e4aae-7442-4bcf-866d-433dbff2cce1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:52:23 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-4ff0b9ef-6648-4173-a742-81f77b7468ff tempest-VolumesGetTest-901652034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (503709d9-71b8-4500-bb69-cee14e22741a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:52:23 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-4ff0b9ef-6648-4173-a742-81f77b7468ff tempest-VolumesGetTest-901652034 None] Volume 8ad6351d-2ee9-4b17-a684-c7716b05598d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8ad6351d-2ee9-4b17-a684-c7716b05598d', 'volume_size': 1}
Jul 02 19:52:23 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-4ff0b9ef-6648-4173-a742-81f77b7468ff tempest-VolumesGetTest-901652034 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:52:24 devstack sudo[97485]: pam_unix(sudo:session): session closed for user root
Jul 02 19:52:24 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-c2e36af2-8f67-4e32-954d-549d351701d5 tempest-VolumesActionsTest-1228615496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-e048daaa-1799-4418-94cc-80e07708cca0" returned: 0 in 0.692s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:52:24 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-c2e36af2-8f67-4e32-954d-549d351701d5 tempest-VolumesActionsTest-1228615496 None] <== create_volume: return (1628ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'} {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 19:52:24 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-c2e36af2-8f67-4e32-954d-549d351701d5 tempest-VolumesActionsTest-1228615496 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.631s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:52:24 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-d5e97088-4858-49cc-9e24-6b2e130c986d tempest-AttachVolumeNegativeTest-732301193 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 15.554s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:52:24 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-d5e97088-4858-49cc-9e24-6b2e130c986d tempest-AttachVolumeNegativeTest-732301193 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce906cb830>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T17:52:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1286341924',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a90521ee-e5e0-4288-accb-aee9ce00ad45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07c1a061c5c147f690026cea928da2e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T17:52:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T17:52:08Z,use_quota=True,user_id='3be7789436f643fe94460f153a717254',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)}" {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 19:52:24 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-d5e97088-4858-49cc-9e24-6b2e130c986d tempest-AttachVolumeNegativeTest-732301193 None] Creating volume a90521ee-e5e0-4288-accb-aee9ce00ad45 {{(pid=86639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 19:52:24 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-d5e97088-4858-49cc-9e24-6b2e130c986d tempest-AttachVolumeNegativeTest-732301193 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:52:24 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-d5e97088-4858-49cc-9e24-6b2e130c986d tempest-AttachVolumeNegativeTest-732301193 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:52:24 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-d5e97088-4858-49cc-9e24-6b2e130c986d tempest-AttachVolumeNegativeTest-732301193 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 19:52:24 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-d5e97088-4858-49cc-9e24-6b2e130c986d tempest-AttachVolumeNegativeTest-732301193 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 19:52:24 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-d5e97088-4858-49cc-9e24-6b2e130c986d tempest-AttachVolumeNegativeTest-732301193 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:52:24 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-d5e97088-4858-49cc-9e24-6b2e130c986d tempest-AttachVolumeNegativeTest-732301193 None] Selected osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92 as target Quobyte volume. {{(pid=86639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 19:52:24 devstack cinder-volume[86639]: INFO cinder.volume.drivers.remotefs [None req-d5e97088-4858-49cc-9e24-6b2e130c986d tempest-AttachVolumeNegativeTest-732301193 None] casted to osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92
Jul 02 19:52:24 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-d5e97088-4858-49cc-9e24-6b2e130c986d tempest-AttachVolumeNegativeTest-732301193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-a90521ee-e5e0-4288-accb-aee9ce00ad45 1073741824 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:52:24 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-c2e36af2-8f67-4e32-954d-549d351701d5 tempest-VolumesActionsTest-1228615496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b7f25e9-98d1-4b65-9bd5-3031078ac5a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e048daaa-1799-4418-94cc-80e07708cca0', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:52:24 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-c2e36af2-8f67-4e32-954d-549d351701d5 tempest-VolumesActionsTest-1228615496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9654cca4-c092-4331-a6f9-609d8950f2ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:52:24 devstack sudo[97489]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-a90521ee-e5e0-4288-accb-aee9ce00ad45 1073741824
Jul 02 19:52:24 devstack sudo[97489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:52:24 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-c2e36af2-8f67-4e32-954d-549d351701d5 tempest-VolumesActionsTest-1228615496 None] Volume volume-e048daaa-1799-4418-94cc-80e07708cca0 (e048daaa-1799-4418-94cc-80e07708cca0): created successfully
Jul 02 19:52:24 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-c2e36af2-8f67-4e32-954d-549d351701d5 tempest-VolumesActionsTest-1228615496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9654cca4-c092-4331-a6f9-609d8950f2ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:52:24 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-c2e36af2-8f67-4e32-954d-549d351701d5 tempest-VolumesActionsTest-1228615496 None] Flow 'volume_create_manager' (23e1c76e-79ac-46f0-b807-c83e4b7095ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 19:52:24 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-c2e36af2-8f67-4e32-954d-549d351701d5 tempest-VolumesActionsTest-1228615496 None] Created volume successfully.
Jul 02 19:52:24 devstack sudo[97489]: pam_unix(sudo:session): session closed for user root
Jul 02 19:52:24 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-d5e97088-4858-49cc-9e24-6b2e130c986d tempest-AttachVolumeNegativeTest-732301193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-a90521ee-e5e0-4288-accb-aee9ce00ad45 1073741824" returned: 0 in 0.828s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:52:24 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-d5e97088-4858-49cc-9e24-6b2e130c986d tempest-AttachVolumeNegativeTest-732301193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-a90521ee-e5e0-4288-accb-aee9ce00ad45 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:52:24 devstack sudo[97494]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-a90521ee-e5e0-4288-accb-aee9ce00ad45
Jul 02 19:52:24 devstack sudo[97494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:52:25 devstack sudo[97494]: pam_unix(sudo:session): session closed for user root
Jul 02 19:52:25 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-d5e97088-4858-49cc-9e24-6b2e130c986d tempest-AttachVolumeNegativeTest-732301193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-a90521ee-e5e0-4288-accb-aee9ce00ad45" returned: 0 in 0.657s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:52:25 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-d5e97088-4858-49cc-9e24-6b2e130c986d tempest-AttachVolumeNegativeTest-732301193 None] <== create_volume: return (1524ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'} {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 19:52:25 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-d5e97088-4858-49cc-9e24-6b2e130c986d tempest-AttachVolumeNegativeTest-732301193 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.528s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:52:25 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-4ff0b9ef-6648-4173-a742-81f77b7468ff tempest-VolumesGetTest-901652034 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.838s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:52:25 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-4ff0b9ef-6648-4173-a742-81f77b7468ff tempest-VolumesGetTest-901652034 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce906cb830>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T17:52:23Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-884181195',display_name='tempest-VolumesGetTest-Volume-1824863402',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ad6351d-2ee9-4b17-a684-c7716b05598d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2427e68dfc641f3844a8667f3020ea8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T17:52:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T17:52:24Z,use_quota=True,user_id='faeb231eb6a04c5bbd7ba1e8049b6120',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)}" {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 19:52:25 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-4ff0b9ef-6648-4173-a742-81f77b7468ff tempest-VolumesGetTest-901652034 None] Creating volume 8ad6351d-2ee9-4b17-a684-c7716b05598d {{(pid=86639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 19:52:25 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-4ff0b9ef-6648-4173-a742-81f77b7468ff tempest-VolumesGetTest-901652034 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:52:25 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-4ff0b9ef-6648-4173-a742-81f77b7468ff tempest-VolumesGetTest-901652034 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:52:25 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-4ff0b9ef-6648-4173-a742-81f77b7468ff tempest-VolumesGetTest-901652034 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 19:52:25 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-4ff0b9ef-6648-4173-a742-81f77b7468ff tempest-VolumesGetTest-901652034 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 19:52:25 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-4ff0b9ef-6648-4173-a742-81f77b7468ff tempest-VolumesGetTest-901652034 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:52:25 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-4ff0b9ef-6648-4173-a742-81f77b7468ff tempest-VolumesGetTest-901652034 None] Selected osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92 as target Quobyte volume. {{(pid=86639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 19:52:25 devstack cinder-volume[86639]: INFO cinder.volume.drivers.remotefs [None req-4ff0b9ef-6648-4173-a742-81f77b7468ff tempest-VolumesGetTest-901652034 None] casted to osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92
Jul 02 19:52:25 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-4ff0b9ef-6648-4173-a742-81f77b7468ff tempest-VolumesGetTest-901652034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8ad6351d-2ee9-4b17-a684-c7716b05598d 1073741824 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:52:25 devstack sudo[97497]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8ad6351d-2ee9-4b17-a684-c7716b05598d 1073741824
Jul 02 19:52:25 devstack sudo[97497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:52:25 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-d5e97088-4858-49cc-9e24-6b2e130c986d tempest-AttachVolumeNegativeTest-732301193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e13a4e79-8424-4da3-ae20-1ecff9d6fa21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a90521ee-e5e0-4288-accb-aee9ce00ad45', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:52:25 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-d5e97088-4858-49cc-9e24-6b2e130c986d tempest-AttachVolumeNegativeTest-732301193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96224531-3aa0-43fc-a026-1db808c3f447) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:52:25 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-d5e97088-4858-49cc-9e24-6b2e130c986d tempest-AttachVolumeNegativeTest-732301193 None] Volume volume-a90521ee-e5e0-4288-accb-aee9ce00ad45 (a90521ee-e5e0-4288-accb-aee9ce00ad45): created successfully
Jul 02 19:52:25 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-d5e97088-4858-49cc-9e24-6b2e130c986d tempest-AttachVolumeNegativeTest-732301193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96224531-3aa0-43fc-a026-1db808c3f447) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:52:25 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-d5e97088-4858-49cc-9e24-6b2e130c986d tempest-AttachVolumeNegativeTest-732301193 None] Flow 'volume_create_manager' (5f743d48-692a-4cc6-acda-2b74bdec26e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 19:52:25 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-d5e97088-4858-49cc-9e24-6b2e130c986d tempest-AttachVolumeNegativeTest-732301193 None] Created volume successfully.
Jul 02 19:52:25 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-da87576c-7cdc-4bcb-a2b1-a0e76dcc993d tempest-VolumesActionsTest-1228615496 None] Acquiring lock "cinder-e048daaa-1799-4418-94cc-80e07708cca0-delete_volume" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:52:25 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-da87576c-7cdc-4bcb-a2b1-a0e76dcc993d tempest-VolumesActionsTest-1228615496 None] Lock "cinder-e048daaa-1799-4418-94cc-80e07708cca0-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:52:25 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-da87576c-7cdc-4bcb-a2b1-a0e76dcc993d tempest-VolumesActionsTest-1228615496 None] Acquiring lock "cinder-quobyte-e048daaa-1799-4418-94cc-80e07708cca0" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:52:25 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-da87576c-7cdc-4bcb-a2b1-a0e76dcc993d tempest-VolumesActionsTest-1228615496 None] Lock "cinder-quobyte-e048daaa-1799-4418-94cc-80e07708cca0" acquired by "delete_volume" :: waited 0.021s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:52:25 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[cedfaf8b-4ea6-4e46-9964-638d8ab07480]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 19:52:25 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-da87576c-7cdc-4bcb-a2b1-a0e76dcc993d tempest-VolumesActionsTest-1228615496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-e048daaa-1799-4418-94cc-80e07708cca0 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:52:26 devstack sudo[97501]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-e048daaa-1799-4418-94cc-80e07708cca0
Jul 02 19:52:26 devstack sudo[97501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:52:26 devstack sudo[97497]: pam_unix(sudo:session): session closed for user root
Jul 02 19:52:26 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-4ff0b9ef-6648-4173-a742-81f77b7468ff tempest-VolumesGetTest-901652034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8ad6351d-2ee9-4b17-a684-c7716b05598d 1073741824" returned: 0 in 1.023s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:52:26 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-4ff0b9ef-6648-4173-a742-81f77b7468ff tempest-VolumesGetTest-901652034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8ad6351d-2ee9-4b17-a684-c7716b05598d {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:52:26 devstack sudo[97508]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8ad6351d-2ee9-4b17-a684-c7716b05598d
Jul 02 19:52:26 devstack sudo[97508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:52:26 devstack sudo[97501]: pam_unix(sudo:session): session closed for user root
Jul 02 19:52:26 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-da87576c-7cdc-4bcb-a2b1-a0e76dcc993d tempest-VolumesActionsTest-1228615496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-e048daaa-1799-4418-94cc-80e07708cca0" returned: 0 in 0.815s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:52:26 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-da87576c-7cdc-4bcb-a2b1-a0e76dcc993d tempest-VolumesActionsTest-1228615496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-e048daaa-1799-4418-94cc-80e07708cca0 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:52:26 devstack sudo[97514]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-e048daaa-1799-4418-94cc-80e07708cca0
Jul 02 19:52:26 devstack sudo[97514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:52:27 devstack sudo[97508]: pam_unix(sudo:session): session closed for user root
Jul 02 19:52:27 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-4ff0b9ef-6648-4173-a742-81f77b7468ff tempest-VolumesGetTest-901652034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8ad6351d-2ee9-4b17-a684-c7716b05598d" returned: 0 in 0.754s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:52:27 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-4ff0b9ef-6648-4173-a742-81f77b7468ff tempest-VolumesGetTest-901652034 None] <== create_volume: return (1827ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'} {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 19:52:27 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-4ff0b9ef-6648-4173-a742-81f77b7468ff tempest-VolumesGetTest-901652034 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.830s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:52:27 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-4ff0b9ef-6648-4173-a742-81f77b7468ff tempest-VolumesGetTest-901652034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (503709d9-71b8-4500-bb69-cee14e22741a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ad6351d-2ee9-4b17-a684-c7716b05598d', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:52:27 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-4ff0b9ef-6648-4173-a742-81f77b7468ff tempest-VolumesGetTest-901652034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b4db367-7ecc-4edc-9b8e-6a2d26d26e70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:52:27 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-4ff0b9ef-6648-4173-a742-81f77b7468ff tempest-VolumesGetTest-901652034 None] Volume volume-8ad6351d-2ee9-4b17-a684-c7716b05598d (8ad6351d-2ee9-4b17-a684-c7716b05598d): created successfully
Jul 02 19:52:27 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-4ff0b9ef-6648-4173-a742-81f77b7468ff tempest-VolumesGetTest-901652034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b4db367-7ecc-4edc-9b8e-6a2d26d26e70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:52:27 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-4ff0b9ef-6648-4173-a742-81f77b7468ff tempest-VolumesGetTest-901652034 None] Flow 'volume_create_manager' (93eae02b-387c-417a-870a-e1afa77fa75a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 19:52:27 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-4ff0b9ef-6648-4173-a742-81f77b7468ff tempest-VolumesGetTest-901652034 None] Created volume successfully.
Jul 02 19:52:27 devstack sudo[97514]: pam_unix(sudo:session): session closed for user root
Jul 02 19:52:27 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-da87576c-7cdc-4bcb-a2b1-a0e76dcc993d tempest-VolumesActionsTest-1228615496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-e048daaa-1799-4418-94cc-80e07708cca0" returned: 0 in 0.730s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:52:27 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-da87576c-7cdc-4bcb-a2b1-a0e76dcc993d tempest-VolumesActionsTest-1228615496 None] Lock "cinder-quobyte-e048daaa-1799-4418-94cc-80e07708cca0" released by "delete_volume" :: held 1.594s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:52:27 devstack cinder-volume[86639]: DEBUG cinder.quota [None req-da87576c-7cdc-4bcb-a2b1-a0e76dcc993d tempest-VolumesActionsTest-1228615496 None] Created reservations ['2e7287ef-88ae-48e2-9985-2d4755e4b059', 'fdcbe9ab-42d1-4c01-9c64-cf06d369af93', '3b29aef2-7960-413c-a9c1-8305e4cd5c67', 'c5766d66-8ed7-4953-ba46-4fb1efb6ed25'] {{(pid=86639) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 19:52:27 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-da87576c-7cdc-4bcb-a2b1-a0e76dcc993d tempest-VolumesActionsTest-1228615496 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:52:27 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-da87576c-7cdc-4bcb-a2b1-a0e76dcc993d tempest-VolumesActionsTest-1228615496 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:52:27 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-da87576c-7cdc-4bcb-a2b1-a0e76dcc993d tempest-VolumesActionsTest-1228615496 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 19:52:27 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-da87576c-7cdc-4bcb-a2b1-a0e76dcc993d tempest-VolumesActionsTest-1228615496 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 19:52:27 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-da87576c-7cdc-4bcb-a2b1-a0e76dcc993d tempest-VolumesActionsTest-1228615496 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:52:27 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-da87576c-7cdc-4bcb-a2b1-a0e76dcc993d tempest-VolumesActionsTest-1228615496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:52:27 devstack sudo[97554]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e
Jul 02 19:52:27 devstack sudo[97554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:52:27 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-c0a3e4ba-6f6a-4447-a58c-6e49b80f2373 tempest-VolumesGetTest-901652034 None] Acquiring lock "cinder-8ad6351d-2ee9-4b17-a684-c7716b05598d-delete_volume" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:52:28 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-c0a3e4ba-6f6a-4447-a58c-6e49b80f2373 tempest-VolumesGetTest-901652034 None] Lock "cinder-8ad6351d-2ee9-4b17-a684-c7716b05598d-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:52:28 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-c0a3e4ba-6f6a-4447-a58c-6e49b80f2373 tempest-VolumesGetTest-901652034 None] Acquiring lock "cinder-quobyte-8ad6351d-2ee9-4b17-a684-c7716b05598d" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:52:28 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-c0a3e4ba-6f6a-4447-a58c-6e49b80f2373 tempest-VolumesGetTest-901652034 None] Lock "cinder-quobyte-8ad6351d-2ee9-4b17-a684-c7716b05598d" acquired by "delete_volume" :: waited 0.021s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:52:28 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[6470fb99-d16d-4c49-a4a4-09ca805d32ac]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 19:52:28 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-c0a3e4ba-6f6a-4447-a58c-6e49b80f2373 tempest-VolumesGetTest-901652034 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8ad6351d-2ee9-4b17-a684-c7716b05598d {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:52:28 devstack sudo[97556]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8ad6351d-2ee9-4b17-a684-c7716b05598d
Jul 02 19:52:28 devstack sudo[97556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:52:28 devstack sudo[97554]: pam_unix(sudo:session): session closed for user root
Jul 02 19:52:28 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-da87576c-7cdc-4bcb-a2b1-a0e76dcc993d tempest-VolumesActionsTest-1228615496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e" returned: 0 in 0.947s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:52:28 devstack cinder-volume[86639]: DEBUG cinder.manager [None req-da87576c-7cdc-4bcb-a2b1-a0e76dcc993d tempest-VolumesActionsTest-1228615496 None] Notifying Schedulers of capabilities ... {{(pid=86639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 19:52:28 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-da87576c-7cdc-4bcb-a2b1-a0e76dcc993d tempest-VolumesActionsTest-1228615496 None] Deleted volume successfully.
Jul 02 19:52:28 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-da87576c-7cdc-4bcb-a2b1-a0e76dcc993d tempest-VolumesActionsTest-1228615496 None] Lock "cinder-e048daaa-1799-4418-94cc-80e07708cca0-delete_volume" released by "delete_volume" :: held 2.860s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:52:29 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [req-2f95fd5f-6ccf-4714-bff2-599649c14054 req-cff21764-d9d5-416c-bff4-da6d36556a66 tempest-AttachVolumeNegativeTest-732301193 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:52:29 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [req-2f95fd5f-6ccf-4714-bff2-599649c14054 req-cff21764-d9d5-416c-bff4-da6d36556a66 tempest-AttachVolumeNegativeTest-732301193 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:52:29 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b91e310-805c-4d06-98d9-8b45e59a81de]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 19:52:29 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [req-2f95fd5f-6ccf-4714-bff2-599649c14054 req-cff21764-d9d5-416c-bff4-da6d36556a66 tempest-AttachVolumeNegativeTest-732301193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-a90521ee-e5e0-4288-accb-aee9ce00ad45 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:52:29 devstack sudo[97556]: pam_unix(sudo:session): session closed for user root
Jul 02 19:52:29 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-c0a3e4ba-6f6a-4447-a58c-6e49b80f2373 tempest-VolumesGetTest-901652034 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8ad6351d-2ee9-4b17-a684-c7716b05598d" returned: 0 in 1.582s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:52:29 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-c0a3e4ba-6f6a-4447-a58c-6e49b80f2373 tempest-VolumesGetTest-901652034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8ad6351d-2ee9-4b17-a684-c7716b05598d {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:52:29 devstack sudo[97661]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8ad6351d-2ee9-4b17-a684-c7716b05598d
Jul 02 19:52:29 devstack sudo[97661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:52:29 devstack sudo[97658]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-a90521ee-e5e0-4288-accb-aee9ce00ad45
Jul 02 19:52:29 devstack sudo[97658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:52:30 devstack sudo[97661]: pam_unix(sudo:session): session closed for user root
Jul 02 19:52:30 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-c0a3e4ba-6f6a-4447-a58c-6e49b80f2373 tempest-VolumesGetTest-901652034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8ad6351d-2ee9-4b17-a684-c7716b05598d" returned: 0 in 1.017s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:52:30 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-c0a3e4ba-6f6a-4447-a58c-6e49b80f2373 tempest-VolumesGetTest-901652034 None] Lock "cinder-quobyte-8ad6351d-2ee9-4b17-a684-c7716b05598d" released by "delete_volume" :: held 2.677s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:52:30 devstack cinder-volume[86639]: DEBUG cinder.quota [None req-c0a3e4ba-6f6a-4447-a58c-6e49b80f2373 tempest-VolumesGetTest-901652034 None] Created reservations ['8ec13239-9db2-4a7f-a077-7fda14b36c99', '0a8709e2-0272-4d5b-b941-fa4d68fa6eb2', '6f9e70ef-5734-4d4e-a83c-bf7a4c571798', 'b7405872-9829-4129-88d4-185b812c2be5'] {{(pid=86639) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 19:52:30 devstack sudo[97658]: pam_unix(sudo:session): session closed for user root
Jul 02 19:52:30 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [req-2f95fd5f-6ccf-4714-bff2-599649c14054 req-cff21764-d9d5-416c-bff4-da6d36556a66 tempest-AttachVolumeNegativeTest-732301193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-a90521ee-e5e0-4288-accb-aee9ce00ad45" returned: 0 in 1.386s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:52:30 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [req-2f95fd5f-6ccf-4714-bff2-599649c14054 req-cff21764-d9d5-416c-bff4-da6d36556a66 tempest-AttachVolumeNegativeTest-732301193 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.426s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:52:31 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-c0a3e4ba-6f6a-4447-a58c-6e49b80f2373 tempest-VolumesGetTest-901652034 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:52:31 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-c0a3e4ba-6f6a-4447-a58c-6e49b80f2373 tempest-VolumesGetTest-901652034 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:52:31 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-c0a3e4ba-6f6a-4447-a58c-6e49b80f2373 tempest-VolumesGetTest-901652034 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 19:52:31 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-c0a3e4ba-6f6a-4447-a58c-6e49b80f2373 tempest-VolumesGetTest-901652034 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 19:52:31 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-c0a3e4ba-6f6a-4447-a58c-6e49b80f2373 tempest-VolumesGetTest-901652034 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:52:31 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-c0a3e4ba-6f6a-4447-a58c-6e49b80f2373 tempest-VolumesGetTest-901652034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:52:31 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [req-2f95fd5f-6ccf-4714-bff2-599649c14054 req-cff21764-d9d5-416c-bff4-da6d36556a66 tempest-AttachVolumeNegativeTest-732301193 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92', 'name': 'volume-a90521ee-e5e0-4288-accb-aee9ce00ad45', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '374a7749-790c-406c-acfa-1c2b3627b56e', 'enforce_multipath': True} {{(pid=86639) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 02 19:52:31 devstack sudo[97680]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e
Jul 02 19:52:31 devstack sudo[97680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:52:31 devstack cinder-volume[86639]: INFO cinder.volume.manager [req-2f95fd5f-6ccf-4714-bff2-599649c14054 req-cff21764-d9d5-416c-bff4-da6d36556a66 tempest-AttachVolumeNegativeTest-732301193 None] attachment_update completed successfully.
Jul 02 19:52:31 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-c7d04b52-2862-42ef-897a-a5c38e33a33f tempest-VolumesGetTest-901652034 None] Acquiring lock "cinder-9ceeed93-cccb-4b67-9135-9b7ee53c5492-delete_volume" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:52:31 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-c7d04b52-2862-42ef-897a-a5c38e33a33f tempest-VolumesGetTest-901652034 None] Lock "cinder-9ceeed93-cccb-4b67-9135-9b7ee53c5492-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:52:31 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-c7d04b52-2862-42ef-897a-a5c38e33a33f tempest-VolumesGetTest-901652034 None] Acquiring lock "cinder-quobyte-9ceeed93-cccb-4b67-9135-9b7ee53c5492" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:52:31 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-c7d04b52-2862-42ef-897a-a5c38e33a33f tempest-VolumesGetTest-901652034 None] Lock "cinder-quobyte-9ceeed93-cccb-4b67-9135-9b7ee53c5492" acquired by "delete_volume" :: waited 0.026s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:52:31 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ff122b8-e6a3-4e3c-80e7-0246c3371975]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 19:52:31 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-c7d04b52-2862-42ef-897a-a5c38e33a33f tempest-VolumesGetTest-901652034 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-9ceeed93-cccb-4b67-9135-9b7ee53c5492 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:52:31 devstack sudo[97684]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-9ceeed93-cccb-4b67-9135-9b7ee53c5492
Jul 02 19:52:31 devstack sudo[97684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:52:32 devstack sudo[97680]: pam_unix(sudo:session): session closed for user root
Jul 02 19:52:32 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-c0a3e4ba-6f6a-4447-a58c-6e49b80f2373 tempest-VolumesGetTest-901652034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e" returned: 0 in 1.012s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:52:32 devstack cinder-volume[86639]: DEBUG cinder.manager [None req-c0a3e4ba-6f6a-4447-a58c-6e49b80f2373 tempest-VolumesGetTest-901652034 None] Notifying Schedulers of capabilities ... {{(pid=86639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 19:52:32 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-c0a3e4ba-6f6a-4447-a58c-6e49b80f2373 tempest-VolumesGetTest-901652034 None] Deleted volume successfully.
Jul 02 19:52:32 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-c0a3e4ba-6f6a-4447-a58c-6e49b80f2373 tempest-VolumesGetTest-901652034 None] Lock "cinder-8ad6351d-2ee9-4b17-a684-c7716b05598d-delete_volume" released by "delete_volume" :: held 4.111s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:52:32 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-c7d04b52-2862-42ef-897a-a5c38e33a33f tempest-VolumesGetTest-901652034 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-9ceeed93-cccb-4b67-9135-9b7ee53c5492" returned: 0 in 1.087s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:52:32 devstack sudo[97684]: pam_unix(sudo:session): session closed for user root
Jul 02 19:52:32 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-c7d04b52-2862-42ef-897a-a5c38e33a33f tempest-VolumesGetTest-901652034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-9ceeed93-cccb-4b67-9135-9b7ee53c5492 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:52:32 devstack sudo[97702]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-9ceeed93-cccb-4b67-9135-9b7ee53c5492
Jul 02 19:52:32 devstack sudo[97702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:52:33 devstack sudo[97702]: pam_unix(sudo:session): session closed for user root
Jul 02 19:52:33 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-c7d04b52-2862-42ef-897a-a5c38e33a33f tempest-VolumesGetTest-901652034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-9ceeed93-cccb-4b67-9135-9b7ee53c5492" returned: 0 in 1.020s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:52:33 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-c7d04b52-2862-42ef-897a-a5c38e33a33f tempest-VolumesGetTest-901652034 None] Lock "cinder-quobyte-9ceeed93-cccb-4b67-9135-9b7ee53c5492" released by "delete_volume" :: held 2.193s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:52:34 devstack cinder-volume[86639]: DEBUG cinder.quota [None req-c7d04b52-2862-42ef-897a-a5c38e33a33f tempest-VolumesGetTest-901652034 None] Created reservations ['d68fe784-01c6-4b29-9abc-3d68cb0366a5', '1d56ea34-10cc-4313-a785-6aee4ad45f2c', '533ad775-5002-4e0a-ba08-74dd3dd38012', 'ca9a07cc-e47b-4e7a-95d8-456d0bb4a870'] {{(pid=86639) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 19:52:34 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-c7d04b52-2862-42ef-897a-a5c38e33a33f tempest-VolumesGetTest-901652034 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:52:34 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-c7d04b52-2862-42ef-897a-a5c38e33a33f tempest-VolumesGetTest-901652034 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:52:34 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-c7d04b52-2862-42ef-897a-a5c38e33a33f tempest-VolumesGetTest-901652034 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 19:52:34 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-c7d04b52-2862-42ef-897a-a5c38e33a33f tempest-VolumesGetTest-901652034 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 19:52:34 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-c7d04b52-2862-42ef-897a-a5c38e33a33f tempest-VolumesGetTest-901652034 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:52:34 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-c7d04b52-2862-42ef-897a-a5c38e33a33f tempest-VolumesGetTest-901652034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:52:34 devstack sudo[97716]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e
Jul 02 19:52:34 devstack sudo[97716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:52:35 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-462ed42c-6aa8-4f7a-b9df-36515defff87 tempest-VolumesGetTest-901652034 None] Acquiring lock "cinder-63ab0fdb-1014-4a84-9921-9e3e4482d948-delete_volume" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:52:35 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-462ed42c-6aa8-4f7a-b9df-36515defff87 tempest-VolumesGetTest-901652034 None] Lock "cinder-63ab0fdb-1014-4a84-9921-9e3e4482d948-delete_volume" acquired by "delete_volume" :: waited 0.116s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:52:35 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-462ed42c-6aa8-4f7a-b9df-36515defff87 tempest-VolumesGetTest-901652034 None] Acquiring lock "cinder-quobyte-63ab0fdb-1014-4a84-9921-9e3e4482d948" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:52:35 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-462ed42c-6aa8-4f7a-b9df-36515defff87 tempest-VolumesGetTest-901652034 None] Lock "cinder-quobyte-63ab0fdb-1014-4a84-9921-9e3e4482d948" acquired by "delete_volume" :: waited 0.022s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:52:35 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4371078-208e-48de-9522-b41fe74ad575]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 19:52:35 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-462ed42c-6aa8-4f7a-b9df-36515defff87 tempest-VolumesGetTest-901652034 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-63ab0fdb-1014-4a84-9921-9e3e4482d948 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:52:35 devstack sudo[97721]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-63ab0fdb-1014-4a84-9921-9e3e4482d948
Jul 02 19:52:35 devstack sudo[97721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:52:35 devstack sudo[97716]: pam_unix(sudo:session): session closed for user root
Jul 02 19:52:35 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-c7d04b52-2862-42ef-897a-a5c38e33a33f tempest-VolumesGetTest-901652034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e" returned: 0 in 1.699s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:52:35 devstack cinder-volume[86639]: DEBUG cinder.manager [None req-c7d04b52-2862-42ef-897a-a5c38e33a33f tempest-VolumesGetTest-901652034 None] Notifying Schedulers of capabilities ... {{(pid=86639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 19:52:35 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-c7d04b52-2862-42ef-897a-a5c38e33a33f tempest-VolumesGetTest-901652034 None] Deleted volume successfully.
Jul 02 19:52:36 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-c7d04b52-2862-42ef-897a-a5c38e33a33f tempest-VolumesGetTest-901652034 None] Lock "cinder-9ceeed93-cccb-4b67-9135-9b7ee53c5492-delete_volume" released by "delete_volume" :: held 4.386s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:52:37 devstack sudo[97721]: pam_unix(sudo:session): session closed for user root
Jul 02 19:52:37 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-462ed42c-6aa8-4f7a-b9df-36515defff87 tempest-VolumesGetTest-901652034 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-63ab0fdb-1014-4a84-9921-9e3e4482d948" returned: 0 in 1.600s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:52:37 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-462ed42c-6aa8-4f7a-b9df-36515defff87 tempest-VolumesGetTest-901652034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-63ab0fdb-1014-4a84-9921-9e3e4482d948 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:52:37 devstack sudo[97728]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-63ab0fdb-1014-4a84-9921-9e3e4482d948
Jul 02 19:52:37 devstack sudo[97728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:52:38 devstack cinder-volume[86639]: INFO cinder.volume.manager [req-f3119be1-6d77-416d-8b2c-778e795b6f52 req-1d0b6086-78d0-4577-bf3c-4aba69c1b0f5 tempest-AttachVolumeNegativeTest-732301193 None] Terminate volume connection completed successfully.
Jul 02 19:52:38 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [req-f3119be1-6d77-416d-8b2c-778e795b6f52 req-1d0b6086-78d0-4577-bf3c-4aba69c1b0f5 tempest-AttachVolumeNegativeTest-732301193 None] Deleting attachment 374a7749-790c-406c-acfa-1c2b3627b56e. {{(pid=86639) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 02 19:52:38 devstack sudo[97728]: pam_unix(sudo:session): session closed for user root
Jul 02 19:52:38 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-462ed42c-6aa8-4f7a-b9df-36515defff87 tempest-VolumesGetTest-901652034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-63ab0fdb-1014-4a84-9921-9e3e4482d948" returned: 0 in 0.973s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:52:38 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-462ed42c-6aa8-4f7a-b9df-36515defff87 tempest-VolumesGetTest-901652034 None] Lock "cinder-quobyte-63ab0fdb-1014-4a84-9921-9e3e4482d948" released by "delete_volume" :: held 2.668s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:52:38 devstack cinder-volume[86639]: DEBUG cinder.quota [None req-462ed42c-6aa8-4f7a-b9df-36515defff87 tempest-VolumesGetTest-901652034 None] Created reservations ['326c6957-8f2c-4c9f-b0f7-42251bebafb9', '69766fb2-bea7-4593-8606-fb37ffcec685', '750ab4c2-5804-4aa5-ab49-1b5a1335ba93', '131f0062-0763-4ff9-9dea-ebc756efb6a7'] {{(pid=86639) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 19:52:38 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-462ed42c-6aa8-4f7a-b9df-36515defff87 tempest-VolumesGetTest-901652034 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:52:38 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-462ed42c-6aa8-4f7a-b9df-36515defff87 tempest-VolumesGetTest-901652034 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:52:38 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-462ed42c-6aa8-4f7a-b9df-36515defff87 tempest-VolumesGetTest-901652034 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 19:52:38 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-462ed42c-6aa8-4f7a-b9df-36515defff87 tempest-VolumesGetTest-901652034 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 19:52:38 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-462ed42c-6aa8-4f7a-b9df-36515defff87 tempest-VolumesGetTest-901652034 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:52:38 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-462ed42c-6aa8-4f7a-b9df-36515defff87 tempest-VolumesGetTest-901652034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:52:38 devstack sudo[97734]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e
Jul 02 19:52:38 devstack sudo[97734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:52:39 devstack sudo[97734]: pam_unix(sudo:session): session closed for user root
Jul 02 19:52:39 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-462ed42c-6aa8-4f7a-b9df-36515defff87 tempest-VolumesGetTest-901652034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e" returned: 0 in 1.269s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:52:39 devstack cinder-volume[86639]: DEBUG cinder.manager [None req-462ed42c-6aa8-4f7a-b9df-36515defff87 tempest-VolumesGetTest-901652034 None] Notifying Schedulers of capabilities ... {{(pid=86639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 19:52:39 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-462ed42c-6aa8-4f7a-b9df-36515defff87 tempest-VolumesGetTest-901652034 None] Deleted volume successfully.
Jul 02 19:52:39 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-462ed42c-6aa8-4f7a-b9df-36515defff87 tempest-VolumesGetTest-901652034 None] Lock "cinder-63ab0fdb-1014-4a84-9921-9e3e4482d948-delete_volume" released by "delete_volume" :: held 4.386s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:52:40 devstack cinder-volume[86639]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7f83cdd-11d7-4a69-9105-f251c10ebc10 tempest-VolumesGetTest-901652034 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 19:52:40 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-a7f83cdd-11d7-4a69-9105-f251c10ebc10 tempest-VolumesGetTest-901652034 None] Flow 'volume_create_manager' (7de4dfe3-a2f2-4924-80f0-e2283b9e8012) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 19:52:40 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-a7f83cdd-11d7-4a69-9105-f251c10ebc10 tempest-VolumesGetTest-901652034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08f07428-4c29-4fea-ad88-a849bc5abbbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:52:40 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-a7f83cdd-11d7-4a69-9105-f251c10ebc10 tempest-VolumesGetTest-901652034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08f07428-4c29-4fea-ad88-a849bc5abbbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T17:52:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1883610931',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad87a1fd-3bff-4e59-a9d1-b1157213cdc7,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='d2427e68dfc641f3844a8667f3020ea8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T17:52:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T17:52:40Z,use_quota=True,user_id='faeb231eb6a04c5bbd7ba1e8049b6120',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:52:40 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-a7f83cdd-11d7-4a69-9105-f251c10ebc10 tempest-VolumesGetTest-901652034 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (369d14da-3163-4262-bc42-01bb344d512b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:52:40 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-a7f83cdd-11d7-4a69-9105-f251c10ebc10 tempest-VolumesGetTest-901652034 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (369d14da-3163-4262-bc42-01bb344d512b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:52:40 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-a7f83cdd-11d7-4a69-9105-f251c10ebc10 tempest-VolumesGetTest-901652034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bf38665-8af9-4876-a291-0d4c4e4ac03d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:52:40 devstack cinder-volume[86639]: DEBUG cinder.image.glance [None req-a7f83cdd-11d7-4a69-9105-f251c10ebc10 tempest-VolumesGetTest-901652034 None] Creating Keystone auth plugin from conf {{(pid=86639) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jul 02 19:52:40 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-a7f83cdd-11d7-4a69-9105-f251c10ebc10 tempest-VolumesGetTest-901652034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bf38665-8af9-4876-a291-0d4c4e4ac03d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ad87a1fd-3bff-4e59-a9d1-b1157213cdc7', 'volume_name': 'volume-ad87a1fd-3bff-4e59-a9d1-b1157213cdc7', 'volume_size': 1, 'image_id': 'a2dc855a-b708-430d-973d-a136c6e54873', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a2dc855a-b708-430d-973d-a136c6e54873', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b6fd8f5b5bb142078118935d5734f463', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a2dc855a-b708-430d-973d-a136c6e54873', 'created_at': datetime.datetime(2026, 7, 2, 17, 34, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 2, 17, 34, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a2dc855a-b708-430d-973d-a136c6e54873/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fce8eff7020>}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:52:40 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-a7f83cdd-11d7-4a69-9105-f251c10ebc10 tempest-VolumesGetTest-901652034 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8bb22243-f817-4b87-b80a-372f6b0c2816) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:52:40 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-a7f83cdd-11d7-4a69-9105-f251c10ebc10 tempest-VolumesGetTest-901652034 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8bb22243-f817-4b87-b80a-372f6b0c2816) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:52:40 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-a7f83cdd-11d7-4a69-9105-f251c10ebc10 tempest-VolumesGetTest-901652034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6dbf25fe-6b5a-4840-ab72-a0e585108da4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:52:40 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-a7f83cdd-11d7-4a69-9105-f251c10ebc10 tempest-VolumesGetTest-901652034 None] Volume ad87a1fd-3bff-4e59-a9d1-b1157213cdc7: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ad87a1fd-3bff-4e59-a9d1-b1157213cdc7', 'volume_size': 1, 'image_id': 'a2dc855a-b708-430d-973d-a136c6e54873', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a2dc855a-b708-430d-973d-a136c6e54873', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b6fd8f5b5bb142078118935d5734f463', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a2dc855a-b708-430d-973d-a136c6e54873', 'created_at': datetime.datetime(2026, 7, 2, 17, 34, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 2, 17, 34, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a2dc855a-b708-430d-973d-a136c6e54873/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fce8eff7020>}
Jul 02 19:52:40 devstack cinder-volume[86639]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7f83cdd-11d7-4a69-9105-f251c10ebc10 tempest-VolumesGetTest-901652034 None] Trying to clone ad87a1fd-3bff-4e59-a9d1-b1157213cdc7 from image a2dc855a-b708-430d-973d-a136c6e54873 at location (None, [{'url': 'file:///opt/stack/data/glance/images/a2dc855a-b708-430d-973d-a136c6e54873', 'metadata': {}}]). {{(pid=86639) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jul 02 19:52:41 devstack cinder-volume[86639]: DEBUG cinder.image.image_utils [None req-a7f83cdd-11d7-4a69-9105-f251c10ebc10 tempest-VolumesGetTest-901652034 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_a2dc855a-b708-430d-973d-a136c6e54873_0_hrh4y8devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86639) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jul 02 19:52:41 devstack cinder-volume[86639]: INFO cinder.image.image_utils [None req-a7f83cdd-11d7-4a69-9105-f251c10ebc10 tempest-VolumesGetTest-901652034 None] Image download 20.69 MB at 20.69 MB/s
Jul 02 19:52:41 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[7db837b9-0f10-4a76-aaab-ed17c6a8d9a6]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 19:52:41 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-a7f83cdd-11d7-4a69-9105-f251c10ebc10 tempest-VolumesGetTest-901652034 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a2dc855a-b708-430d-973d-a136c6e54873_0_hrh4y8devstack@QuobyteHD {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:52:41 devstack sudo[97739]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a2dc855a-b708-430d-973d-a136c6e54873_0_hrh4y8devstack@QuobyteHD
Jul 02 19:52:41 devstack sudo[97739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:52:41 devstack cinder-volume[86639]: DEBUG oslo_service.periodic_task [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86639) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 02 19:52:41 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:52:41 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:52:41 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 19:52:41 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 19:52:41 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.042s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:52:41 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:52:41 devstack sudo[97747]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e
Jul 02 19:52:41 devstack sudo[97747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:52:43 devstack sudo[97739]: pam_unix(sudo:session): session closed for user root
Jul 02 19:52:43 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-a7f83cdd-11d7-4a69-9105-f251c10ebc10 tempest-VolumesGetTest-901652034 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a2dc855a-b708-430d-973d-a136c6e54873_0_hrh4y8devstack@QuobyteHD" returned: 0 in 1.828s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:52:43 devstack cinder-volume[86639]: DEBUG cinder.image.image_utils [None req-a7f83cdd-11d7-4a69-9105-f251c10ebc10 tempest-VolumesGetTest-901652034 None] Temporary image a2dc855a-b708-430d-973d-a136c6e54873 is fetched for user faeb231eb6a04c5bbd7ba1e8049b6120. {{(pid=86639) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jul 02 19:52:43 devstack sudo[97747]: pam_unix(sudo:session): session closed for user root
Jul 02 19:52:43 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e" returned: 0 in 1.565s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:52:43 devstack cinder-volume[86639]: DEBUG cinder.manager [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] Notifying Schedulers of capabilities ... {{(pid=86639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 19:52:43 devstack cinder-volume[86639]: DEBUG oslo_service.periodic_task [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] Running periodic task VolumeManager._thread_info {{(pid=86639) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 02 19:52:43 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] thread count: 28 {{(pid=86639) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 02 19:52:43 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] thread info: [<_MainThread(MainThread, started 140525261275264)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 140525150678016)>, <Thread(Thread-3 (stat_writer), started daemon 140525150025920)>, <Thread(Rabbit-heartbeat, started daemon 140525150500864)>, <Thread(Thread-5 (_runner), started daemon 140525149847296)>, <Thread(Thread-7 (_runner), started daemon 140525149863424)>, <Thread(fd_logger, started daemon 140525146589376)>, <Thread(privsep_reader, started daemon 140525144562432)>, <Thread(tpool_thread_0, started daemon 140525137151680)>, <Thread(tpool_thread_1, started daemon 140525128758976)>, <Thread(tpool_thread_2, started daemon 140525120349888)>, <Thread(tpool_thread_3, started daemon 140525111940800)>, <Thread(tpool_thread_4, started daemon 140525103531712)>, <Thread(tpool_thread_5, started daemon 140525095122624)>, <Thread(tpool_thread_6, started daemon 140525086713536)>, <Thread(tpool_thread_7, started daemon 140525078304448)>, <Thread(tpool_thread_8, started daemon 140525069895360)>, <Thread(tpool_thread_9, started daemon 140525061486272)>, <Thread(tpool_thread_10, started daemon 140525053077184)>, <Thread(tpool_thread_11, started daemon 140525044668096)>, <Thread(tpool_thread_12, started daemon 140525036259008)>, <Thread(tpool_thread_13, started daemon 140525027849920)>, <Thread(tpool_thread_14, started daemon 140525019440832)>, <Thread(tpool_thread_15, started daemon 140525011031744)>, <Thread(tpool_thread_16, started daemon 140525002622656)>, <Thread(tpool_thread_17, started daemon 140524994213568)>, <Thread(tpool_thread_18, started daemon 140524985804480)>, <Thread(tpool_thread_19, started daemon 140524977395392)>] {{(pid=86639) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 02 19:52:43 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[47f31a06-5408-4dd6-bf8c-91e2d00ca3a8]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 19:52:43 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-a7f83cdd-11d7-4a69-9105-f251c10ebc10 tempest-VolumesGetTest-901652034 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a2dc855a-b708-430d-973d-a136c6e54873_0_hrh4y8devstack@QuobyteHD {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:52:43 devstack sudo[97783]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a2dc855a-b708-430d-973d-a136c6e54873_0_hrh4y8devstack@QuobyteHD
Jul 02 19:52:43 devstack sudo[97783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:52:44 devstack sudo[97783]: pam_unix(sudo:session): session closed for user root
Jul 02 19:52:44 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-a7f83cdd-11d7-4a69-9105-f251c10ebc10 tempest-VolumesGetTest-901652034 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a2dc855a-b708-430d-973d-a136c6e54873_0_hrh4y8devstack@QuobyteHD" returned: 0 in 1.058s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:52:44 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-a7f83cdd-11d7-4a69-9105-f251c10ebc10 tempest-VolumesGetTest-901652034 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:52:44 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-a7f83cdd-11d7-4a69-9105-f251c10ebc10 tempest-VolumesGetTest-901652034 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:52:44 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-a7f83cdd-11d7-4a69-9105-f251c10ebc10 tempest-VolumesGetTest-901652034 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce906cb830>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T17:52:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1883610931',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad87a1fd-3bff-4e59-a9d1-b1157213cdc7,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='d2427e68dfc641f3844a8667f3020ea8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T17:52:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T17:52:40Z,use_quota=True,user_id='faeb231eb6a04c5bbd7ba1e8049b6120',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)}" {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 19:52:44 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-a7f83cdd-11d7-4a69-9105-f251c10ebc10 tempest-VolumesGetTest-901652034 None] Creating volume ad87a1fd-3bff-4e59-a9d1-b1157213cdc7 {{(pid=86639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 19:52:44 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-a7f83cdd-11d7-4a69-9105-f251c10ebc10 tempest-VolumesGetTest-901652034 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:52:44 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-a7f83cdd-11d7-4a69-9105-f251c10ebc10 tempest-VolumesGetTest-901652034 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:52:44 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-a7f83cdd-11d7-4a69-9105-f251c10ebc10 tempest-VolumesGetTest-901652034 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 19:52:44 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-a7f83cdd-11d7-4a69-9105-f251c10ebc10 tempest-VolumesGetTest-901652034 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 19:52:44 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-a7f83cdd-11d7-4a69-9105-f251c10ebc10 tempest-VolumesGetTest-901652034 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:52:44 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-a7f83cdd-11d7-4a69-9105-f251c10ebc10 tempest-VolumesGetTest-901652034 None] Selected osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92 as target Quobyte volume. {{(pid=86639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 19:52:44 devstack cinder-volume[86639]: INFO cinder.volume.drivers.remotefs [None req-a7f83cdd-11d7-4a69-9105-f251c10ebc10 tempest-VolumesGetTest-901652034 None] casted to osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92
Jul 02 19:52:44 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-a7f83cdd-11d7-4a69-9105-f251c10ebc10 tempest-VolumesGetTest-901652034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-ad87a1fd-3bff-4e59-a9d1-b1157213cdc7 1073741824 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:52:44 devstack sudo[97799]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-ad87a1fd-3bff-4e59-a9d1-b1157213cdc7 1073741824
Jul 02 19:52:44 devstack sudo[97799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:52:45 devstack sudo[97799]: pam_unix(sudo:session): session closed for user root
Jul 02 19:52:45 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-a7f83cdd-11d7-4a69-9105-f251c10ebc10 tempest-VolumesGetTest-901652034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-ad87a1fd-3bff-4e59-a9d1-b1157213cdc7 1073741824" returned: 0 in 1.155s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:52:45 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-a7f83cdd-11d7-4a69-9105-f251c10ebc10 tempest-VolumesGetTest-901652034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-ad87a1fd-3bff-4e59-a9d1-b1157213cdc7 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:52:45 devstack sudo[97807]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-ad87a1fd-3bff-4e59-a9d1-b1157213cdc7
Jul 02 19:52:45 devstack sudo[97807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:52:46 devstack sudo[97807]: pam_unix(sudo:session): session closed for user root
Jul 02 19:52:46 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-a7f83cdd-11d7-4a69-9105-f251c10ebc10 tempest-VolumesGetTest-901652034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-ad87a1fd-3bff-4e59-a9d1-b1157213cdc7" returned: 0 in 0.722s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:52:46 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-a7f83cdd-11d7-4a69-9105-f251c10ebc10 tempest-VolumesGetTest-901652034 None] <== create_volume: return (1924ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'} {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 19:52:46 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-a7f83cdd-11d7-4a69-9105-f251c10ebc10 tempest-VolumesGetTest-901652034 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.928s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:52:46 devstack cinder-volume[86639]: DEBUG cinder.volume.volume_utils [None req-a7f83cdd-11d7-4a69-9105-f251c10ebc10 tempest-VolumesGetTest-901652034 None] Attempting download of a2dc855a-b708-430d-973d-a136c6e54873 ((None, [{'url': 'file:///opt/stack/data/glance/images/a2dc855a-b708-430d-973d-a136c6e54873', 'metadata': {}}])) to volume ad87a1fd-3bff-4e59-a9d1-b1157213cdc7. {{(pid=86639) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jul 02 19:52:46 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5e1766c-9942-4b7a-9f4b-0b182f9a1c5c]: (4, 'raw') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 19:52:46 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-a7f83cdd-11d7-4a69-9105-f251c10ebc10 tempest-VolumesGetTest-901652034 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a2dc855a-b708-430d-973d-a136c6e54873_1z4fs8ky {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:52:46 devstack sudo[97810]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a2dc855a-b708-430d-973d-a136c6e54873_1z4fs8ky
Jul 02 19:52:46 devstack sudo[97810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:52:47 devstack sudo[97810]: pam_unix(sudo:session): session closed for user root
Jul 02 19:52:47 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-a7f83cdd-11d7-4a69-9105-f251c10ebc10 tempest-VolumesGetTest-901652034 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a2dc855a-b708-430d-973d-a136c6e54873_1z4fs8ky" returned: 0 in 0.821s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:52:47 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-a7f83cdd-11d7-4a69-9105-f251c10ebc10 tempest-VolumesGetTest-901652034 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a2dc855a-b708-430d-973d-a136c6e54873_1z4fs8ky {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:52:47 devstack sudo[97814]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a2dc855a-b708-430d-973d-a136c6e54873_1z4fs8ky
Jul 02 19:52:47 devstack sudo[97814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:52:47 devstack sudo[97814]: pam_unix(sudo:session): session closed for user root
Jul 02 19:52:47 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-a7f83cdd-11d7-4a69-9105-f251c10ebc10 tempest-VolumesGetTest-901652034 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a2dc855a-b708-430d-973d-a136c6e54873_1z4fs8ky" returned: 1 in 0.756s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:52:47 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-a7f83cdd-11d7-4a69-9105-f251c10ebc10 tempest-VolumesGetTest-901652034 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a2dc855a-b708-430d-973d-a136c6e54873_1z4fs8ky' failed. Not Retrying. {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 02 19:52:47 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[95419d0d-9534-47fc-81b4-6318026a15e8]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 19:52:47 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-a7f83cdd-11d7-4a69-9105-f251c10ebc10 tempest-VolumesGetTest-901652034 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a2dc855a-b708-430d-973d-a136c6e54873_0_hrh4y8devstack@QuobyteHD {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:52:48 devstack sudo[97818]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a2dc855a-b708-430d-973d-a136c6e54873_0_hrh4y8devstack@QuobyteHD
Jul 02 19:52:48 devstack sudo[97818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:52:48 devstack sudo[97818]: pam_unix(sudo:session): session closed for user root
Jul 02 19:52:48 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-a7f83cdd-11d7-4a69-9105-f251c10ebc10 tempest-VolumesGetTest-901652034 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a2dc855a-b708-430d-973d-a136c6e54873_0_hrh4y8devstack@QuobyteHD" returned: 0 in 0.819s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:52:48 devstack cinder-volume[86639]: DEBUG cinder.image.image_utils [None req-a7f83cdd-11d7-4a69-9105-f251c10ebc10 tempest-VolumesGetTest-901652034 None] a2dc855a-b708-430d-973d-a136c6e54873 was qcow2, converting to raw {{(pid=86639) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jul 02 19:52:48 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-a7f83cdd-11d7-4a69-9105-f251c10ebc10 tempest-VolumesGetTest-901652034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a2dc855a-b708-430d-973d-a136c6e54873_0_hrh4y8devstack@QuobyteHD /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-ad87a1fd-3bff-4e59-a9d1-b1157213cdc7 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:52:48 devstack sudo[97824]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a2dc855a-b708-430d-973d-a136c6e54873_0_hrh4y8devstack@QuobyteHD /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-ad87a1fd-3bff-4e59-a9d1-b1157213cdc7
Jul 02 19:52:48 devstack sudo[97824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:52:49 devstack cinder-volume[86639]: DEBUG cinder.volume.flows.manager.create_volume [None req-af8115f2-4b32-415f-a8e6-4ac5e59c4879 tempest-VolumesListAdminTestJSON-59337829 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 19:52:49 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-af8115f2-4b32-415f-a8e6-4ac5e59c4879 tempest-VolumesListAdminTestJSON-59337829 None] Flow 'volume_create_manager' (d2d9018c-c767-47b1-ad78-123e20aa38ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 19:52:49 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-af8115f2-4b32-415f-a8e6-4ac5e59c4879 tempest-VolumesListAdminTestJSON-59337829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a96c2db3-4d19-4641-b0a0-8a68b963e01d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:52:49 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-af8115f2-4b32-415f-a8e6-4ac5e59c4879 tempest-VolumesListAdminTestJSON-59337829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a96c2db3-4d19-4641-b0a0-8a68b963e01d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T17:52:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-697316586',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68d301be-8518-4773-a387-2657f4f0e274,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0147fbdd88aa4f87beee5bccc88a15c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T17:52:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T17:52:49Z,use_quota=True,user_id='d4dee1c2ccf64c968961079556c182b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:52:49 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-af8115f2-4b32-415f-a8e6-4ac5e59c4879 tempest-VolumesListAdminTestJSON-59337829 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4999603e-1d43-43ee-9a10-e8abc87f7588) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:52:49 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-af8115f2-4b32-415f-a8e6-4ac5e59c4879 tempest-VolumesListAdminTestJSON-59337829 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4999603e-1d43-43ee-9a10-e8abc87f7588) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:52:49 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-af8115f2-4b32-415f-a8e6-4ac5e59c4879 tempest-VolumesListAdminTestJSON-59337829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f42ca17d-c3e4-4974-809c-be6e302d6abe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:52:49 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-af8115f2-4b32-415f-a8e6-4ac5e59c4879 tempest-VolumesListAdminTestJSON-59337829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f42ca17d-c3e4-4974-809c-be6e302d6abe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '68d301be-8518-4773-a387-2657f4f0e274', 'volume_name': 'volume-68d301be-8518-4773-a387-2657f4f0e274', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:52:49 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-af8115f2-4b32-415f-a8e6-4ac5e59c4879 tempest-VolumesListAdminTestJSON-59337829 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (757ee9c8-2349-4559-8fff-2478363c0c16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:52:49 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-af8115f2-4b32-415f-a8e6-4ac5e59c4879 tempest-VolumesListAdminTestJSON-59337829 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (757ee9c8-2349-4559-8fff-2478363c0c16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:52:49 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-af8115f2-4b32-415f-a8e6-4ac5e59c4879 tempest-VolumesListAdminTestJSON-59337829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bcef0f0e-6312-47b9-8ed6-d205f356d73d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:52:49 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-af8115f2-4b32-415f-a8e6-4ac5e59c4879 tempest-VolumesListAdminTestJSON-59337829 None] Volume 68d301be-8518-4773-a387-2657f4f0e274: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-68d301be-8518-4773-a387-2657f4f0e274', 'volume_size': 1}
Jul 02 19:52:49 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-af8115f2-4b32-415f-a8e6-4ac5e59c4879 tempest-VolumesListAdminTestJSON-59337829 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:52:49 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-af8115f2-4b32-415f-a8e6-4ac5e59c4879 tempest-VolumesListAdminTestJSON-59337829 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:52:49 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-af8115f2-4b32-415f-a8e6-4ac5e59c4879 tempest-VolumesListAdminTestJSON-59337829 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce906cb830>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T17:52:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-697316586',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68d301be-8518-4773-a387-2657f4f0e274,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0147fbdd88aa4f87beee5bccc88a15c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T17:52:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T17:52:49Z,use_quota=True,user_id='d4dee1c2ccf64c968961079556c182b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)}" {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 19:52:49 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-af8115f2-4b32-415f-a8e6-4ac5e59c4879 tempest-VolumesListAdminTestJSON-59337829 None] Creating volume 68d301be-8518-4773-a387-2657f4f0e274 {{(pid=86639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 19:52:49 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-af8115f2-4b32-415f-a8e6-4ac5e59c4879 tempest-VolumesListAdminTestJSON-59337829 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:52:49 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-af8115f2-4b32-415f-a8e6-4ac5e59c4879 tempest-VolumesListAdminTestJSON-59337829 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:52:49 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-af8115f2-4b32-415f-a8e6-4ac5e59c4879 tempest-VolumesListAdminTestJSON-59337829 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 19:52:49 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-af8115f2-4b32-415f-a8e6-4ac5e59c4879 tempest-VolumesListAdminTestJSON-59337829 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 19:52:49 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-af8115f2-4b32-415f-a8e6-4ac5e59c4879 tempest-VolumesListAdminTestJSON-59337829 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:52:49 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-af8115f2-4b32-415f-a8e6-4ac5e59c4879 tempest-VolumesListAdminTestJSON-59337829 None] Selected osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92 as target Quobyte volume. {{(pid=86639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 19:52:49 devstack cinder-volume[86639]: INFO cinder.volume.drivers.remotefs [None req-af8115f2-4b32-415f-a8e6-4ac5e59c4879 tempest-VolumesListAdminTestJSON-59337829 None] casted to osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92
Jul 02 19:52:49 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-af8115f2-4b32-415f-a8e6-4ac5e59c4879 tempest-VolumesListAdminTestJSON-59337829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-68d301be-8518-4773-a387-2657f4f0e274 1073741824 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:52:49 devstack sudo[97832]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-68d301be-8518-4773-a387-2657f4f0e274 1073741824
Jul 02 19:52:49 devstack sudo[97832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:52:50 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-a629bf65-45f3-4ccb-a497-a7513cadb973 tempest-AttachVolumeNegativeTest-732301193 None] Acquiring lock "cinder-a90521ee-e5e0-4288-accb-aee9ce00ad45-delete_volume" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:52:50 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-a629bf65-45f3-4ccb-a497-a7513cadb973 tempest-AttachVolumeNegativeTest-732301193 None] Lock "cinder-a90521ee-e5e0-4288-accb-aee9ce00ad45-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:52:50 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-a629bf65-45f3-4ccb-a497-a7513cadb973 tempest-AttachVolumeNegativeTest-732301193 None] Acquiring lock "cinder-quobyte-a90521ee-e5e0-4288-accb-aee9ce00ad45" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:52:50 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-a629bf65-45f3-4ccb-a497-a7513cadb973 tempest-AttachVolumeNegativeTest-732301193 None] Lock "cinder-quobyte-a90521ee-e5e0-4288-accb-aee9ce00ad45" acquired by "delete_volume" :: waited 0.029s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:52:50 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[e42af052-0a4c-41e6-af87-cafbe36fdc1b]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 19:52:50 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-a629bf65-45f3-4ccb-a497-a7513cadb973 tempest-AttachVolumeNegativeTest-732301193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-a90521ee-e5e0-4288-accb-aee9ce00ad45 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:52:50 devstack sudo[97834]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-a90521ee-e5e0-4288-accb-aee9ce00ad45
Jul 02 19:52:50 devstack sudo[97834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:52:51 devstack sudo[97832]: pam_unix(sudo:session): session closed for user root
Jul 02 19:52:51 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-af8115f2-4b32-415f-a8e6-4ac5e59c4879 tempest-VolumesListAdminTestJSON-59337829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-68d301be-8518-4773-a387-2657f4f0e274 1073741824" returned: 0 in 1.481s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:52:51 devstack sudo[97834]: pam_unix(sudo:session): session closed for user root
Jul 02 19:52:51 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-a629bf65-45f3-4ccb-a497-a7513cadb973 tempest-AttachVolumeNegativeTest-732301193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-a90521ee-e5e0-4288-accb-aee9ce00ad45" returned: 0 in 0.931s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:52:51 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-a629bf65-45f3-4ccb-a497-a7513cadb973 tempest-AttachVolumeNegativeTest-732301193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-a90521ee-e5e0-4288-accb-aee9ce00ad45 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:52:51 devstack sudo[97843]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-a90521ee-e5e0-4288-accb-aee9ce00ad45
Jul 02 19:52:51 devstack sudo[97843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:52:51 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-af8115f2-4b32-415f-a8e6-4ac5e59c4879 tempest-VolumesListAdminTestJSON-59337829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-68d301be-8518-4773-a387-2657f4f0e274 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:52:51 devstack sudo[97845]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-68d301be-8518-4773-a387-2657f4f0e274
Jul 02 19:52:51 devstack sudo[97845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:52:51 devstack sudo[97824]: pam_unix(sudo:session): session closed for user root
Jul 02 19:52:51 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-a7f83cdd-11d7-4a69-9105-f251c10ebc10 tempest-VolumesGetTest-901652034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a2dc855a-b708-430d-973d-a136c6e54873_0_hrh4y8devstack@QuobyteHD /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-ad87a1fd-3bff-4e59-a9d1-b1157213cdc7" returned: 0 in 2.688s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:52:51 devstack cinder-volume[86639]: DEBUG cinder.image.image_utils [None req-a7f83cdd-11d7-4a69-9105-f251c10ebc10 tempest-VolumesGetTest-901652034 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_a2dc855a-b708-430d-973d-a136c6e54873_0_hrh4y8devstack@QuobyteHD, size 112.00 MB, duration 2.69 sec, destination /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-ad87a1fd-3bff-4e59-a9d1-b1157213cdc7 {{(pid=86639) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 02 19:52:51 devstack cinder-volume[86639]: INFO cinder.image.image_utils [None req-a7f83cdd-11d7-4a69-9105-f251c10ebc10 tempest-VolumesGetTest-901652034 None] Converted 112.00 MB image at 41.64 MB/s
Jul 02 19:52:51 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-a7f83cdd-11d7-4a69-9105-f251c10ebc10 tempest-VolumesGetTest-901652034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-ad87a1fd-3bff-4e59-a9d1-b1157213cdc7 1G {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:52:51 devstack sudo[97847]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-ad87a1fd-3bff-4e59-a9d1-b1157213cdc7 1G
Jul 02 19:52:51 devstack sudo[97847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:52:52 devstack sudo[97843]: pam_unix(sudo:session): session closed for user root
Jul 02 19:52:52 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-a629bf65-45f3-4ccb-a497-a7513cadb973 tempest-AttachVolumeNegativeTest-732301193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-a90521ee-e5e0-4288-accb-aee9ce00ad45" returned: 0 in 0.752s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:52:52 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-a629bf65-45f3-4ccb-a497-a7513cadb973 tempest-AttachVolumeNegativeTest-732301193 None] Lock "cinder-quobyte-a90521ee-e5e0-4288-accb-aee9ce00ad45" released by "delete_volume" :: held 1.752s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:52:52 devstack cinder-volume[86639]: DEBUG cinder.quota [None req-a629bf65-45f3-4ccb-a497-a7513cadb973 tempest-AttachVolumeNegativeTest-732301193 None] Created reservations ['0fd6a918-5746-4c42-ad01-9a7fe124a1d3', 'f7dba199-d80c-4a45-b014-1629dcffb0a8', 'a7b7046a-1bda-44b4-9a60-552c4a3cbcd9', '74697353-b064-4fff-954b-faf7e8b3c22b'] {{(pid=86639) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 19:52:52 devstack sudo[97845]: pam_unix(sudo:session): session closed for user root
Jul 02 19:52:52 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-af8115f2-4b32-415f-a8e6-4ac5e59c4879 tempest-VolumesListAdminTestJSON-59337829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-68d301be-8518-4773-a387-2657f4f0e274" returned: 0 in 0.837s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:52:52 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-af8115f2-4b32-415f-a8e6-4ac5e59c4879 tempest-VolumesListAdminTestJSON-59337829 None] <== create_volume: return (2419ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'} {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 19:52:52 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-af8115f2-4b32-415f-a8e6-4ac5e59c4879 tempest-VolumesListAdminTestJSON-59337829 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.421s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:52:52 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-af8115f2-4b32-415f-a8e6-4ac5e59c4879 tempest-VolumesListAdminTestJSON-59337829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bcef0f0e-6312-47b9-8ed6-d205f356d73d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-68d301be-8518-4773-a387-2657f4f0e274', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:52:52 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-af8115f2-4b32-415f-a8e6-4ac5e59c4879 tempest-VolumesListAdminTestJSON-59337829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bff3f3e-91de-4244-b0b1-e91c9f305439) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:52:52 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-a629bf65-45f3-4ccb-a497-a7513cadb973 tempest-AttachVolumeNegativeTest-732301193 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:52:52 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-a629bf65-45f3-4ccb-a497-a7513cadb973 tempest-AttachVolumeNegativeTest-732301193 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:52:52 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-a629bf65-45f3-4ccb-a497-a7513cadb973 tempest-AttachVolumeNegativeTest-732301193 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 19:52:52 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-a629bf65-45f3-4ccb-a497-a7513cadb973 tempest-AttachVolumeNegativeTest-732301193 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 19:52:52 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-a629bf65-45f3-4ccb-a497-a7513cadb973 tempest-AttachVolumeNegativeTest-732301193 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:52:52 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-a629bf65-45f3-4ccb-a497-a7513cadb973 tempest-AttachVolumeNegativeTest-732301193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:52:52 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-af8115f2-4b32-415f-a8e6-4ac5e59c4879 tempest-VolumesListAdminTestJSON-59337829 None] Volume volume-68d301be-8518-4773-a387-2657f4f0e274 (68d301be-8518-4773-a387-2657f4f0e274): created successfully
Jul 02 19:52:52 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-af8115f2-4b32-415f-a8e6-4ac5e59c4879 tempest-VolumesListAdminTestJSON-59337829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bff3f3e-91de-4244-b0b1-e91c9f305439) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:52:52 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-af8115f2-4b32-415f-a8e6-4ac5e59c4879 tempest-VolumesListAdminTestJSON-59337829 None] Flow 'volume_create_manager' (d2d9018c-c767-47b1-ad78-123e20aa38ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 19:52:52 devstack sudo[97859]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e
Jul 02 19:52:52 devstack sudo[97859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:52:52 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-af8115f2-4b32-415f-a8e6-4ac5e59c4879 tempest-VolumesListAdminTestJSON-59337829 None] Created volume successfully.
Jul 02 19:52:52 devstack sudo[97847]: pam_unix(sudo:session): session closed for user root
Jul 02 19:52:52 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-a7f83cdd-11d7-4a69-9105-f251c10ebc10 tempest-VolumesGetTest-901652034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-ad87a1fd-3bff-4e59-a9d1-b1157213cdc7 1G" returned: 0 in 1.002s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:52:52 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[65c2ea6c-db8a-4ba8-ac7d-1a797a008a17]: (4, 'raw') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 19:52:52 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-a7f83cdd-11d7-4a69-9105-f251c10ebc10 tempest-VolumesGetTest-901652034 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-ad87a1fd-3bff-4e59-a9d1-b1157213cdc7 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:52:52 devstack sudo[97862]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-ad87a1fd-3bff-4e59-a9d1-b1157213cdc7
Jul 02 19:52:52 devstack sudo[97862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:52:52 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-e2917746-94fa-456e-8261-e2168387eae4 tempest-AttachVolumeNegativeTest-732301193 None] Acquiring lock "cinder-685e72a6-174e-4aeb-b099-dec20f9da2f1-delete_volume" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:52:52 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-e2917746-94fa-456e-8261-e2168387eae4 tempest-AttachVolumeNegativeTest-732301193 None] Lock "cinder-685e72a6-174e-4aeb-b099-dec20f9da2f1-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:52:52 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-e2917746-94fa-456e-8261-e2168387eae4 tempest-AttachVolumeNegativeTest-732301193 None] Acquiring lock "cinder-quobyte-685e72a6-174e-4aeb-b099-dec20f9da2f1" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:52:52 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-e2917746-94fa-456e-8261-e2168387eae4 tempest-AttachVolumeNegativeTest-732301193 None] Lock "cinder-quobyte-685e72a6-174e-4aeb-b099-dec20f9da2f1" acquired by "delete_volume" :: waited 0.023s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:52:52 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[87ca8bcd-828d-48a9-beff-5a356c7c981c]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 19:52:52 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-e2917746-94fa-456e-8261-e2168387eae4 tempest-AttachVolumeNegativeTest-732301193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-685e72a6-174e-4aeb-b099-dec20f9da2f1 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:52:53 devstack sudo[97864]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-685e72a6-174e-4aeb-b099-dec20f9da2f1
Jul 02 19:52:53 devstack sudo[97864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:52:53 devstack sudo[97859]: pam_unix(sudo:session): session closed for user root
Jul 02 19:52:53 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-a629bf65-45f3-4ccb-a497-a7513cadb973 tempest-AttachVolumeNegativeTest-732301193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e" returned: 0 in 0.977s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:52:53 devstack cinder-volume[86639]: DEBUG cinder.manager [None req-a629bf65-45f3-4ccb-a497-a7513cadb973 tempest-AttachVolumeNegativeTest-732301193 None] Notifying Schedulers of capabilities ... {{(pid=86639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 19:52:53 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-a629bf65-45f3-4ccb-a497-a7513cadb973 tempest-AttachVolumeNegativeTest-732301193 None] Deleted volume successfully.
Jul 02 19:52:53 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-a629bf65-45f3-4ccb-a497-a7513cadb973 tempest-AttachVolumeNegativeTest-732301193 None] Lock "cinder-a90521ee-e5e0-4288-accb-aee9ce00ad45-delete_volume" released by "delete_volume" :: held 3.080s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:52:53 devstack sudo[97862]: pam_unix(sudo:session): session closed for user root
Jul 02 19:52:53 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-a7f83cdd-11d7-4a69-9105-f251c10ebc10 tempest-VolumesGetTest-901652034 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-ad87a1fd-3bff-4e59-a9d1-b1157213cdc7" returned: 0 in 1.190s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:52:53 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-a7f83cdd-11d7-4a69-9105-f251c10ebc10 tempest-VolumesGetTest-901652034 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-ad87a1fd-3bff-4e59-a9d1-b1157213cdc7 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:52:53 devstack cinder-volume[86639]: DEBUG cinder.volume.flows.manager.create_volume [None req-56dcba57-f5d8-4962-988d-76484b9cbd6f tempest-VolumesListAdminTestJSON-59337829 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 19:52:53 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-56dcba57-f5d8-4962-988d-76484b9cbd6f tempest-VolumesListAdminTestJSON-59337829 None] Flow 'volume_create_manager' (b7e7cd72-bb4e-48b5-8ed5-db3035c34d16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 19:52:53 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-56dcba57-f5d8-4962-988d-76484b9cbd6f tempest-VolumesListAdminTestJSON-59337829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (029db103-d722-4fc8-9e64-dab8b9f9dc1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:52:53 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-56dcba57-f5d8-4962-988d-76484b9cbd6f tempest-VolumesListAdminTestJSON-59337829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (029db103-d722-4fc8-9e64-dab8b9f9dc1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T17:52:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1073747944',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a95c916c-3faa-4d5f-aeac-ff3ed7084dfd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0147fbdd88aa4f87beee5bccc88a15c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T17:52:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T17:52:54Z,use_quota=True,user_id='d4dee1c2ccf64c968961079556c182b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:52:53 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-56dcba57-f5d8-4962-988d-76484b9cbd6f tempest-VolumesListAdminTestJSON-59337829 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44004474-ef6f-488d-8c9c-3f1249b86113) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:52:53 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-56dcba57-f5d8-4962-988d-76484b9cbd6f tempest-VolumesListAdminTestJSON-59337829 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44004474-ef6f-488d-8c9c-3f1249b86113) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:52:53 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-56dcba57-f5d8-4962-988d-76484b9cbd6f tempest-VolumesListAdminTestJSON-59337829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db5161a6-6e3f-4ecb-a5b7-35061eabbcbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:52:53 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-56dcba57-f5d8-4962-988d-76484b9cbd6f tempest-VolumesListAdminTestJSON-59337829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db5161a6-6e3f-4ecb-a5b7-35061eabbcbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a95c916c-3faa-4d5f-aeac-ff3ed7084dfd', 'volume_name': 'volume-a95c916c-3faa-4d5f-aeac-ff3ed7084dfd', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:52:53 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-56dcba57-f5d8-4962-988d-76484b9cbd6f tempest-VolumesListAdminTestJSON-59337829 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91851efc-945b-4328-a1a6-fd19ac630eb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:52:53 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-56dcba57-f5d8-4962-988d-76484b9cbd6f tempest-VolumesListAdminTestJSON-59337829 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91851efc-945b-4328-a1a6-fd19ac630eb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:52:53 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-56dcba57-f5d8-4962-988d-76484b9cbd6f tempest-VolumesListAdminTestJSON-59337829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (956e01bb-e3fb-494c-9517-0ee53d504c69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:52:53 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-56dcba57-f5d8-4962-988d-76484b9cbd6f tempest-VolumesListAdminTestJSON-59337829 None] Volume a95c916c-3faa-4d5f-aeac-ff3ed7084dfd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a95c916c-3faa-4d5f-aeac-ff3ed7084dfd', 'volume_size': 1}
Jul 02 19:52:53 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-56dcba57-f5d8-4962-988d-76484b9cbd6f tempest-VolumesListAdminTestJSON-59337829 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:52:53 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-56dcba57-f5d8-4962-988d-76484b9cbd6f tempest-VolumesListAdminTestJSON-59337829 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:52:53 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-56dcba57-f5d8-4962-988d-76484b9cbd6f tempest-VolumesListAdminTestJSON-59337829 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce906cb830>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T17:52:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1073747944',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a95c916c-3faa-4d5f-aeac-ff3ed7084dfd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0147fbdd88aa4f87beee5bccc88a15c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T17:52:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T17:52:54Z,use_quota=True,user_id='d4dee1c2ccf64c968961079556c182b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)}" {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 19:52:53 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-56dcba57-f5d8-4962-988d-76484b9cbd6f tempest-VolumesListAdminTestJSON-59337829 None] Creating volume a95c916c-3faa-4d5f-aeac-ff3ed7084dfd {{(pid=86639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 19:52:53 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-56dcba57-f5d8-4962-988d-76484b9cbd6f tempest-VolumesListAdminTestJSON-59337829 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:52:53 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-56dcba57-f5d8-4962-988d-76484b9cbd6f tempest-VolumesListAdminTestJSON-59337829 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:52:53 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-56dcba57-f5d8-4962-988d-76484b9cbd6f tempest-VolumesListAdminTestJSON-59337829 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 19:52:53 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-56dcba57-f5d8-4962-988d-76484b9cbd6f tempest-VolumesListAdminTestJSON-59337829 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 19:52:53 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-56dcba57-f5d8-4962-988d-76484b9cbd6f tempest-VolumesListAdminTestJSON-59337829 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:52:53 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-56dcba57-f5d8-4962-988d-76484b9cbd6f tempest-VolumesListAdminTestJSON-59337829 None] Selected osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92 as target Quobyte volume. {{(pid=86639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 19:52:53 devstack cinder-volume[86639]: INFO cinder.volume.drivers.remotefs [None req-56dcba57-f5d8-4962-988d-76484b9cbd6f tempest-VolumesListAdminTestJSON-59337829 None] casted to osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92
Jul 02 19:52:53 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-56dcba57-f5d8-4962-988d-76484b9cbd6f tempest-VolumesListAdminTestJSON-59337829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-a95c916c-3faa-4d5f-aeac-ff3ed7084dfd 1073741824 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:52:53 devstack sudo[97871]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-ad87a1fd-3bff-4e59-a9d1-b1157213cdc7
Jul 02 19:52:53 devstack sudo[97871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:52:53 devstack sudo[97875]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-a95c916c-3faa-4d5f-aeac-ff3ed7084dfd 1073741824
Jul 02 19:52:53 devstack sudo[97875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:52:54 devstack sudo[97864]: pam_unix(sudo:session): session closed for user root
Jul 02 19:52:54 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-e2917746-94fa-456e-8261-e2168387eae4 tempest-AttachVolumeNegativeTest-732301193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-685e72a6-174e-4aeb-b099-dec20f9da2f1" returned: 0 in 1.217s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:52:54 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-e2917746-94fa-456e-8261-e2168387eae4 tempest-AttachVolumeNegativeTest-732301193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-685e72a6-174e-4aeb-b099-dec20f9da2f1 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:52:54 devstack sudo[97878]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-685e72a6-174e-4aeb-b099-dec20f9da2f1
Jul 02 19:52:54 devstack sudo[97878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:52:54 devstack sudo[97871]: pam_unix(sudo:session): session closed for user root
Jul 02 19:52:54 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-a7f83cdd-11d7-4a69-9105-f251c10ebc10 tempest-VolumesGetTest-901652034 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-ad87a1fd-3bff-4e59-a9d1-b1157213cdc7" returned: 1 in 1.093s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:52:54 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-a7f83cdd-11d7-4a69-9105-f251c10ebc10 tempest-VolumesGetTest-901652034 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-ad87a1fd-3bff-4e59-a9d1-b1157213cdc7' failed. Not Retrying. {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 02 19:52:54 devstack cinder-volume[86639]: DEBUG cinder.volume.volume_utils [None req-a7f83cdd-11d7-4a69-9105-f251c10ebc10 tempest-VolumesGetTest-901652034 None] Downloaded image a2dc855a-b708-430d-973d-a136c6e54873 ((None, [{'url': 'file:///opt/stack/data/glance/images/a2dc855a-b708-430d-973d-a136c6e54873', 'metadata': {}}])) to volume ad87a1fd-3bff-4e59-a9d1-b1157213cdc7 successfully. {{(pid=86639) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jul 02 19:52:54 devstack cinder-volume[86639]: DEBUG cinder.image.image_utils [None req-a7f83cdd-11d7-4a69-9105-f251c10ebc10 tempest-VolumesGetTest-901652034 None] Temporary image a2dc855a-b708-430d-973d-a136c6e54873 for user faeb231eb6a04c5bbd7ba1e8049b6120 is deleted. {{(pid=86639) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jul 02 19:52:54 devstack cinder-volume[86639]: DEBUG cinder.volume.volume_utils [None req-a7f83cdd-11d7-4a69-9105-f251c10ebc10 tempest-VolumesGetTest-901652034 None] Marking volume ad87a1fd-3bff-4e59-a9d1-b1157213cdc7 as bootable. {{(pid=86639) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jul 02 19:52:54 devstack cinder-volume[86639]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7f83cdd-11d7-4a69-9105-f251c10ebc10 tempest-VolumesGetTest-901652034 None] Copying metadata from image a2dc855a-b708-430d-973d-a136c6e54873 to ad87a1fd-3bff-4e59-a9d1-b1157213cdc7. {{(pid=86639) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jul 02 19:52:54 devstack cinder-volume[86639]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7f83cdd-11d7-4a69-9105-f251c10ebc10 tempest-VolumesGetTest-901652034 None] Creating volume glance metadata for volume ad87a1fd-3bff-4e59-a9d1-b1157213cdc7 backed by image a2dc855a-b708-430d-973d-a136c6e54873 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'a2dc855a-b708-430d-973d-a136c6e54873', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86639) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jul 02 19:52:55 devstack sudo[97878]: pam_unix(sudo:session): session closed for user root
Jul 02 19:52:55 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-a7f83cdd-11d7-4a69-9105-f251c10ebc10 tempest-VolumesGetTest-901652034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6dbf25fe-6b5a-4840-ab72-a0e585108da4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad87a1fd-3bff-4e59-a9d1-b1157213cdc7', 'volume_size': 1, 'image_id': 'a2dc855a-b708-430d-973d-a136c6e54873', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a2dc855a-b708-430d-973d-a136c6e54873', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b6fd8f5b5bb142078118935d5734f463', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a2dc855a-b708-430d-973d-a136c6e54873', 'created_at': datetime.datetime(2026, 7, 2, 17, 34, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 2, 17, 34, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a2dc855a-b708-430d-973d-a136c6e54873/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fce8eff7020>}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:52:55 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-a7f83cdd-11d7-4a69-9105-f251c10ebc10 tempest-VolumesGetTest-901652034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3a4de21-0c3b-4eb3-8cd9-b878a1d4584f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:52:55 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-e2917746-94fa-456e-8261-e2168387eae4 tempest-AttachVolumeNegativeTest-732301193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-685e72a6-174e-4aeb-b099-dec20f9da2f1" returned: 0 in 1.075s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:52:55 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-e2917746-94fa-456e-8261-e2168387eae4 tempest-AttachVolumeNegativeTest-732301193 None] Lock "cinder-quobyte-685e72a6-174e-4aeb-b099-dec20f9da2f1" released by "delete_volume" :: held 2.379s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:52:55 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-a7f83cdd-11d7-4a69-9105-f251c10ebc10 tempest-VolumesGetTest-901652034 None] Volume volume-ad87a1fd-3bff-4e59-a9d1-b1157213cdc7 (ad87a1fd-3bff-4e59-a9d1-b1157213cdc7): created successfully
Jul 02 19:52:55 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-a7f83cdd-11d7-4a69-9105-f251c10ebc10 tempest-VolumesGetTest-901652034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3a4de21-0c3b-4eb3-8cd9-b878a1d4584f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:52:55 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-a7f83cdd-11d7-4a69-9105-f251c10ebc10 tempest-VolumesGetTest-901652034 None] Flow 'volume_create_manager' (7de4dfe3-a2f2-4924-80f0-e2283b9e8012) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 19:52:55 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-a7f83cdd-11d7-4a69-9105-f251c10ebc10 tempest-VolumesGetTest-901652034 None] Created volume successfully.
Jul 02 19:52:55 devstack cinder-volume[86639]: DEBUG cinder.quota [None req-e2917746-94fa-456e-8261-e2168387eae4 tempest-AttachVolumeNegativeTest-732301193 None] Created reservations ['6db91f0c-14ed-4ee9-87cb-dd27ec73f6a5', 'a1e1ac72-10d3-4e1a-979d-d09cbef16b6b', '7ccaf265-e875-4f76-a3c7-4a5e6b2a41a5', '63cc918d-2783-4887-a228-1c8ecea61a42'] {{(pid=86639) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 19:52:55 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-e2917746-94fa-456e-8261-e2168387eae4 tempest-AttachVolumeNegativeTest-732301193 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:52:55 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-e2917746-94fa-456e-8261-e2168387eae4 tempest-AttachVolumeNegativeTest-732301193 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:52:55 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-e2917746-94fa-456e-8261-e2168387eae4 tempest-AttachVolumeNegativeTest-732301193 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 19:52:55 devstack sudo[97875]: pam_unix(sudo:session): session closed for user root
Jul 02 19:52:55 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-e2917746-94fa-456e-8261-e2168387eae4 tempest-AttachVolumeNegativeTest-732301193 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 19:52:55 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-e2917746-94fa-456e-8261-e2168387eae4 tempest-AttachVolumeNegativeTest-732301193 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:52:55 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-e2917746-94fa-456e-8261-e2168387eae4 tempest-AttachVolumeNegativeTest-732301193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:52:55 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-56dcba57-f5d8-4962-988d-76484b9cbd6f tempest-VolumesListAdminTestJSON-59337829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-a95c916c-3faa-4d5f-aeac-ff3ed7084dfd 1073741824" returned: 0 in 1.538s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:52:55 devstack sudo[97892]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e
Jul 02 19:52:55 devstack sudo[97892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:52:55 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-56dcba57-f5d8-4962-988d-76484b9cbd6f tempest-VolumesListAdminTestJSON-59337829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-a95c916c-3faa-4d5f-aeac-ff3ed7084dfd {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:52:55 devstack sudo[97894]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-a95c916c-3faa-4d5f-aeac-ff3ed7084dfd
Jul 02 19:52:55 devstack sudo[97894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:52:56 devstack sudo[97894]: pam_unix(sudo:session): session closed for user root
Jul 02 19:52:56 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-56dcba57-f5d8-4962-988d-76484b9cbd6f tempest-VolumesListAdminTestJSON-59337829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-a95c916c-3faa-4d5f-aeac-ff3ed7084dfd" returned: 0 in 0.806s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:52:56 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-56dcba57-f5d8-4962-988d-76484b9cbd6f tempest-VolumesListAdminTestJSON-59337829 None] <== create_volume: return (2401ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'} {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 19:52:56 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-56dcba57-f5d8-4962-988d-76484b9cbd6f tempest-VolumesListAdminTestJSON-59337829 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.408s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:52:56 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-56dcba57-f5d8-4962-988d-76484b9cbd6f tempest-VolumesListAdminTestJSON-59337829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (956e01bb-e3fb-494c-9517-0ee53d504c69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a95c916c-3faa-4d5f-aeac-ff3ed7084dfd', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:52:56 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-56dcba57-f5d8-4962-988d-76484b9cbd6f tempest-VolumesListAdminTestJSON-59337829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2472da9-ee43-4e74-9689-e68a0af0ef1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:52:56 devstack sudo[97892]: pam_unix(sudo:session): session closed for user root
Jul 02 19:52:56 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-e2917746-94fa-456e-8261-e2168387eae4 tempest-AttachVolumeNegativeTest-732301193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e" returned: 0 in 0.963s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:52:56 devstack cinder-volume[86639]: DEBUG cinder.manager [None req-e2917746-94fa-456e-8261-e2168387eae4 tempest-AttachVolumeNegativeTest-732301193 None] Notifying Schedulers of capabilities ... {{(pid=86639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 19:52:56 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-e2917746-94fa-456e-8261-e2168387eae4 tempest-AttachVolumeNegativeTest-732301193 None] Deleted volume successfully.
Jul 02 19:52:56 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-56dcba57-f5d8-4962-988d-76484b9cbd6f tempest-VolumesListAdminTestJSON-59337829 None] Volume volume-a95c916c-3faa-4d5f-aeac-ff3ed7084dfd (a95c916c-3faa-4d5f-aeac-ff3ed7084dfd): created successfully
Jul 02 19:52:56 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-56dcba57-f5d8-4962-988d-76484b9cbd6f tempest-VolumesListAdminTestJSON-59337829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2472da9-ee43-4e74-9689-e68a0af0ef1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:52:56 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-56dcba57-f5d8-4962-988d-76484b9cbd6f tempest-VolumesListAdminTestJSON-59337829 None] Flow 'volume_create_manager' (b7e7cd72-bb4e-48b5-8ed5-db3035c34d16) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 19:52:56 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-e2917746-94fa-456e-8261-e2168387eae4 tempest-AttachVolumeNegativeTest-732301193 None] Lock "cinder-685e72a6-174e-4aeb-b099-dec20f9da2f1-delete_volume" released by "delete_volume" :: held 3.739s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:52:56 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-56dcba57-f5d8-4962-988d-76484b9cbd6f tempest-VolumesListAdminTestJSON-59337829 None] Created volume successfully.
Jul 02 19:52:56 devstack cinder-volume[86639]: DEBUG cinder.volume.flows.manager.create_volume [None req-2312fa16-9d84-492f-9a89-36febf955006 tempest-VolumesGetTest-901652034 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 19:52:56 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-2312fa16-9d84-492f-9a89-36febf955006 tempest-VolumesGetTest-901652034 None] Flow 'volume_create_manager' (72320fe4-249a-48f4-bfb4-ec38aeafc59a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 19:52:56 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-2312fa16-9d84-492f-9a89-36febf955006 tempest-VolumesGetTest-901652034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a05c037-1515-44ec-9938-b802c880ec90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:52:56 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-2312fa16-9d84-492f-9a89-36febf955006 tempest-VolumesGetTest-901652034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a05c037-1515-44ec-9938-b802c880ec90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T17:52:56Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1535619954',display_name='tempest-VolumesGetTest-Volume-1674363643',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8645b574-180f-4291-984a-416542b40c48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2427e68dfc641f3844a8667f3020ea8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T17:52:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T17:52:56Z,use_quota=True,user_id='faeb231eb6a04c5bbd7ba1e8049b6120',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:52:56 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-2312fa16-9d84-492f-9a89-36febf955006 tempest-VolumesGetTest-901652034 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (706e6ba7-ec88-4e0c-8e5e-9929c3c309b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:52:56 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-2312fa16-9d84-492f-9a89-36febf955006 tempest-VolumesGetTest-901652034 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (706e6ba7-ec88-4e0c-8e5e-9929c3c309b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:52:56 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-2312fa16-9d84-492f-9a89-36febf955006 tempest-VolumesGetTest-901652034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b7d1daa-4838-44a9-a924-38670053c553) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:52:56 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-2312fa16-9d84-492f-9a89-36febf955006 tempest-VolumesGetTest-901652034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b7d1daa-4838-44a9-a924-38670053c553) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8645b574-180f-4291-984a-416542b40c48', 'volume_name': 'volume-8645b574-180f-4291-984a-416542b40c48', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:52:56 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-2312fa16-9d84-492f-9a89-36febf955006 tempest-VolumesGetTest-901652034 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88b821b9-5a55-4319-9bee-35dfeb094a7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:52:56 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-2312fa16-9d84-492f-9a89-36febf955006 tempest-VolumesGetTest-901652034 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88b821b9-5a55-4319-9bee-35dfeb094a7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:52:56 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-2312fa16-9d84-492f-9a89-36febf955006 tempest-VolumesGetTest-901652034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1450328a-52c6-46f7-a550-573cf9c90ae9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:52:56 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-2312fa16-9d84-492f-9a89-36febf955006 tempest-VolumesGetTest-901652034 None] Volume 8645b574-180f-4291-984a-416542b40c48: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8645b574-180f-4291-984a-416542b40c48', 'volume_size': 1}
Jul 02 19:52:56 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-2312fa16-9d84-492f-9a89-36febf955006 tempest-VolumesGetTest-901652034 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:52:56 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-2312fa16-9d84-492f-9a89-36febf955006 tempest-VolumesGetTest-901652034 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:52:56 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-2312fa16-9d84-492f-9a89-36febf955006 tempest-VolumesGetTest-901652034 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce906cb830>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T17:52:56Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1535619954',display_name='tempest-VolumesGetTest-Volume-1674363643',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8645b574-180f-4291-984a-416542b40c48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2427e68dfc641f3844a8667f3020ea8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T17:52:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T17:52:56Z,use_quota=True,user_id='faeb231eb6a04c5bbd7ba1e8049b6120',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)}" {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 19:52:56 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-2312fa16-9d84-492f-9a89-36febf955006 tempest-VolumesGetTest-901652034 None] Creating volume 8645b574-180f-4291-984a-416542b40c48 {{(pid=86639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 19:52:56 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-2312fa16-9d84-492f-9a89-36febf955006 tempest-VolumesGetTest-901652034 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:52:56 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-2312fa16-9d84-492f-9a89-36febf955006 tempest-VolumesGetTest-901652034 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:52:56 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-2312fa16-9d84-492f-9a89-36febf955006 tempest-VolumesGetTest-901652034 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 19:52:56 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-2312fa16-9d84-492f-9a89-36febf955006 tempest-VolumesGetTest-901652034 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 19:52:56 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-2312fa16-9d84-492f-9a89-36febf955006 tempest-VolumesGetTest-901652034 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:52:56 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-2312fa16-9d84-492f-9a89-36febf955006 tempest-VolumesGetTest-901652034 None] Selected osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92 as target Quobyte volume. {{(pid=86639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 19:52:56 devstack cinder-volume[86639]: INFO cinder.volume.drivers.remotefs [None req-2312fa16-9d84-492f-9a89-36febf955006 tempest-VolumesGetTest-901652034 None] casted to osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92
Jul 02 19:52:56 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-2312fa16-9d84-492f-9a89-36febf955006 tempest-VolumesGetTest-901652034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8645b574-180f-4291-984a-416542b40c48 1073741824 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:52:56 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-a1e4afb6-172f-4cb4-8e14-6492f45c2e71 tempest-AttachVolumeNegativeTest-732301193 None] Acquiring lock "cinder-f0d8d55a-8d45-43e2-9cfe-74c280ab466f-delete_volume" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:52:56 devstack sudo[97898]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8645b574-180f-4291-984a-416542b40c48 1073741824
Jul 02 19:52:56 devstack sudo[97898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:52:56 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-a1e4afb6-172f-4cb4-8e14-6492f45c2e71 tempest-AttachVolumeNegativeTest-732301193 None] Lock "cinder-f0d8d55a-8d45-43e2-9cfe-74c280ab466f-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:52:56 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-a1e4afb6-172f-4cb4-8e14-6492f45c2e71 tempest-AttachVolumeNegativeTest-732301193 None] Acquiring lock "cinder-quobyte-f0d8d55a-8d45-43e2-9cfe-74c280ab466f" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:52:56 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-a1e4afb6-172f-4cb4-8e14-6492f45c2e71 tempest-AttachVolumeNegativeTest-732301193 None] Lock "cinder-quobyte-f0d8d55a-8d45-43e2-9cfe-74c280ab466f" acquired by "delete_volume" :: waited 0.027s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:52:56 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[08a66459-8b18-4d8e-9c64-8c691228792d]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 19:52:56 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-a1e4afb6-172f-4cb4-8e14-6492f45c2e71 tempest-AttachVolumeNegativeTest-732301193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-f0d8d55a-8d45-43e2-9cfe-74c280ab466f {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:52:56 devstack cinder-volume[86639]: INFO cinder.volume.manager [req-34306344-c30b-4106-a796-9015e7e8b607 req-652e0245-95f0-490d-95df-d1404bfa9e23 tempest-TestMinimumBasicScenario-118664991 None] Terminate volume connection completed successfully.
Jul 02 19:52:56 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [req-34306344-c30b-4106-a796-9015e7e8b607 req-652e0245-95f0-490d-95df-d1404bfa9e23 tempest-TestMinimumBasicScenario-118664991 None] Deleting attachment 06a4de29-3065-4356-9d7c-029b3168f27b. {{(pid=86639) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 02 19:52:57 devstack sudo[97902]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-f0d8d55a-8d45-43e2-9cfe-74c280ab466f
Jul 02 19:52:57 devstack sudo[97902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:52:57 devstack cinder-volume[86639]: DEBUG cinder.volume.flows.manager.create_volume [None req-070349cd-bd3f-43cc-bdfc-bfc287aacbb6 tempest-VolumesListAdminTestJSON-59337829 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 19:52:57 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-070349cd-bd3f-43cc-bdfc-bfc287aacbb6 tempest-VolumesListAdminTestJSON-59337829 None] Flow 'volume_create_manager' (b23d2207-977d-4303-ab6a-72046a0362e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 19:52:57 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-070349cd-bd3f-43cc-bdfc-bfc287aacbb6 tempest-VolumesListAdminTestJSON-59337829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b770c23b-baaf-4f71-826f-a71e9867bac3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:52:57 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-070349cd-bd3f-43cc-bdfc-bfc287aacbb6 tempest-VolumesListAdminTestJSON-59337829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b770c23b-baaf-4f71-826f-a71e9867bac3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T17:52:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-771191450',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d4b1148-2b2c-4c70-9dbd-bb459b3cd8f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0147fbdd88aa4f87beee5bccc88a15c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T17:52:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T17:52:58Z,use_quota=True,user_id='d4dee1c2ccf64c968961079556c182b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:52:57 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-070349cd-bd3f-43cc-bdfc-bfc287aacbb6 tempest-VolumesListAdminTestJSON-59337829 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (216c44d1-f722-4780-8c30-935d5731ad90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:52:57 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-070349cd-bd3f-43cc-bdfc-bfc287aacbb6 tempest-VolumesListAdminTestJSON-59337829 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (216c44d1-f722-4780-8c30-935d5731ad90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:52:57 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-070349cd-bd3f-43cc-bdfc-bfc287aacbb6 tempest-VolumesListAdminTestJSON-59337829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (880d72e8-e778-4dce-8f95-64ae339094e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:52:57 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-070349cd-bd3f-43cc-bdfc-bfc287aacbb6 tempest-VolumesListAdminTestJSON-59337829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (880d72e8-e778-4dce-8f95-64ae339094e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d4b1148-2b2c-4c70-9dbd-bb459b3cd8f3', 'volume_name': 'volume-6d4b1148-2b2c-4c70-9dbd-bb459b3cd8f3', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:52:57 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-070349cd-bd3f-43cc-bdfc-bfc287aacbb6 tempest-VolumesListAdminTestJSON-59337829 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (954cbf36-8b5e-4b0e-8f81-01d279fb5eff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:52:57 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-070349cd-bd3f-43cc-bdfc-bfc287aacbb6 tempest-VolumesListAdminTestJSON-59337829 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (954cbf36-8b5e-4b0e-8f81-01d279fb5eff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:52:57 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-070349cd-bd3f-43cc-bdfc-bfc287aacbb6 tempest-VolumesListAdminTestJSON-59337829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f750bdd3-3a34-472f-9743-2f08a232843d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:52:57 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-070349cd-bd3f-43cc-bdfc-bfc287aacbb6 tempest-VolumesListAdminTestJSON-59337829 None] Volume 6d4b1148-2b2c-4c70-9dbd-bb459b3cd8f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d4b1148-2b2c-4c70-9dbd-bb459b3cd8f3', 'volume_size': 1}
Jul 02 19:52:57 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-070349cd-bd3f-43cc-bdfc-bfc287aacbb6 tempest-VolumesListAdminTestJSON-59337829 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:52:57 devstack sudo[97898]: pam_unix(sudo:session): session closed for user root
Jul 02 19:52:57 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-2312fa16-9d84-492f-9a89-36febf955006 tempest-VolumesGetTest-901652034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8645b574-180f-4291-984a-416542b40c48 1073741824" returned: 0 in 1.093s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:52:57 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-2312fa16-9d84-492f-9a89-36febf955006 tempest-VolumesGetTest-901652034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8645b574-180f-4291-984a-416542b40c48 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:52:57 devstack sudo[97910]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8645b574-180f-4291-984a-416542b40c48
Jul 02 19:52:57 devstack sudo[97910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:52:57 devstack sudo[97902]: pam_unix(sudo:session): session closed for user root
Jul 02 19:52:57 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-a1e4afb6-172f-4cb4-8e14-6492f45c2e71 tempest-AttachVolumeNegativeTest-732301193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-f0d8d55a-8d45-43e2-9cfe-74c280ab466f" returned: 0 in 1.056s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:52:57 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-a1e4afb6-172f-4cb4-8e14-6492f45c2e71 tempest-AttachVolumeNegativeTest-732301193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-f0d8d55a-8d45-43e2-9cfe-74c280ab466f {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:52:57 devstack sudo[97913]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-f0d8d55a-8d45-43e2-9cfe-74c280ab466f
Jul 02 19:52:57 devstack sudo[97913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:52:58 devstack sudo[97910]: pam_unix(sudo:session): session closed for user root
Jul 02 19:52:58 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-2312fa16-9d84-492f-9a89-36febf955006 tempest-VolumesGetTest-901652034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8645b574-180f-4291-984a-416542b40c48" returned: 0 in 0.655s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:52:58 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-2312fa16-9d84-492f-9a89-36febf955006 tempest-VolumesGetTest-901652034 None] <== create_volume: return (1799ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'} {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 19:52:58 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-2312fa16-9d84-492f-9a89-36febf955006 tempest-VolumesGetTest-901652034 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.802s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:52:58 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-070349cd-bd3f-43cc-bdfc-bfc287aacbb6 tempest-VolumesListAdminTestJSON-59337829 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.742s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:52:58 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-070349cd-bd3f-43cc-bdfc-bfc287aacbb6 tempest-VolumesListAdminTestJSON-59337829 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce906cb830>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T17:52:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-771191450',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d4b1148-2b2c-4c70-9dbd-bb459b3cd8f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0147fbdd88aa4f87beee5bccc88a15c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T17:52:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T17:52:58Z,use_quota=True,user_id='d4dee1c2ccf64c968961079556c182b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)}" {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 19:52:58 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-070349cd-bd3f-43cc-bdfc-bfc287aacbb6 tempest-VolumesListAdminTestJSON-59337829 None] Creating volume 6d4b1148-2b2c-4c70-9dbd-bb459b3cd8f3 {{(pid=86639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 19:52:58 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-070349cd-bd3f-43cc-bdfc-bfc287aacbb6 tempest-VolumesListAdminTestJSON-59337829 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:52:58 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-070349cd-bd3f-43cc-bdfc-bfc287aacbb6 tempest-VolumesListAdminTestJSON-59337829 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:52:58 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-070349cd-bd3f-43cc-bdfc-bfc287aacbb6 tempest-VolumesListAdminTestJSON-59337829 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 19:52:58 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-070349cd-bd3f-43cc-bdfc-bfc287aacbb6 tempest-VolumesListAdminTestJSON-59337829 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 19:52:58 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-070349cd-bd3f-43cc-bdfc-bfc287aacbb6 tempest-VolumesListAdminTestJSON-59337829 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:52:58 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-070349cd-bd3f-43cc-bdfc-bfc287aacbb6 tempest-VolumesListAdminTestJSON-59337829 None] Selected osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92 as target Quobyte volume. {{(pid=86639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 19:52:58 devstack cinder-volume[86639]: INFO cinder.volume.drivers.remotefs [None req-070349cd-bd3f-43cc-bdfc-bfc287aacbb6 tempest-VolumesListAdminTestJSON-59337829 None] casted to osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92
Jul 02 19:52:58 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-070349cd-bd3f-43cc-bdfc-bfc287aacbb6 tempest-VolumesListAdminTestJSON-59337829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-6d4b1148-2b2c-4c70-9dbd-bb459b3cd8f3 1073741824 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:52:58 devstack sudo[97916]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-6d4b1148-2b2c-4c70-9dbd-bb459b3cd8f3 1073741824
Jul 02 19:52:58 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-2312fa16-9d84-492f-9a89-36febf955006 tempest-VolumesGetTest-901652034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1450328a-52c6-46f7-a550-573cf9c90ae9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8645b574-180f-4291-984a-416542b40c48', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:52:58 devstack sudo[97916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:52:58 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-2312fa16-9d84-492f-9a89-36febf955006 tempest-VolumesGetTest-901652034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea102b0d-4c2a-430b-992b-eff562c63e13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:52:58 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-2312fa16-9d84-492f-9a89-36febf955006 tempest-VolumesGetTest-901652034 None] Volume volume-8645b574-180f-4291-984a-416542b40c48 (8645b574-180f-4291-984a-416542b40c48): created successfully
Jul 02 19:52:58 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-2312fa16-9d84-492f-9a89-36febf955006 tempest-VolumesGetTest-901652034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea102b0d-4c2a-430b-992b-eff562c63e13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:52:58 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-2312fa16-9d84-492f-9a89-36febf955006 tempest-VolumesGetTest-901652034 None] Flow 'volume_create_manager' (72320fe4-249a-48f4-bfb4-ec38aeafc59a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 19:52:58 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-2312fa16-9d84-492f-9a89-36febf955006 tempest-VolumesGetTest-901652034 None] Created volume successfully.
Jul 02 19:52:58 devstack sudo[97913]: pam_unix(sudo:session): session closed for user root
Jul 02 19:52:58 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-a1e4afb6-172f-4cb4-8e14-6492f45c2e71 tempest-AttachVolumeNegativeTest-732301193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-f0d8d55a-8d45-43e2-9cfe-74c280ab466f" returned: 0 in 0.697s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:52:58 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-a1e4afb6-172f-4cb4-8e14-6492f45c2e71 tempest-AttachVolumeNegativeTest-732301193 None] Lock "cinder-quobyte-f0d8d55a-8d45-43e2-9cfe-74c280ab466f" released by "delete_volume" :: held 1.830s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:52:58 devstack cinder-volume[86639]: DEBUG cinder.quota [None req-a1e4afb6-172f-4cb4-8e14-6492f45c2e71 tempest-AttachVolumeNegativeTest-732301193 None] Created reservations ['9628cd5e-c860-48a9-aaea-0707111703f7', '41e6bdb6-056f-4ad4-906b-ce767f155a0a', '04502a5e-0a2f-454a-8743-e7db7734ae24', '6adb8aab-65eb-4eed-ac8c-7d4c65db1ea6'] {{(pid=86639) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 19:52:58 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-a1e4afb6-172f-4cb4-8e14-6492f45c2e71 tempest-AttachVolumeNegativeTest-732301193 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:52:58 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-a1e4afb6-172f-4cb4-8e14-6492f45c2e71 tempest-AttachVolumeNegativeTest-732301193 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:52:58 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-a1e4afb6-172f-4cb4-8e14-6492f45c2e71 tempest-AttachVolumeNegativeTest-732301193 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 19:52:58 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-a1e4afb6-172f-4cb4-8e14-6492f45c2e71 tempest-AttachVolumeNegativeTest-732301193 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 19:52:58 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-a1e4afb6-172f-4cb4-8e14-6492f45c2e71 tempest-AttachVolumeNegativeTest-732301193 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:52:58 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-a1e4afb6-172f-4cb4-8e14-6492f45c2e71 tempest-AttachVolumeNegativeTest-732301193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:52:58 devstack sudo[97919]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e
Jul 02 19:52:58 devstack sudo[97919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:52:59 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-65057e8d-d225-4e1e-a09a-e92abcde7c85 tempest-TestMinimumBasicScenario-118664991 None] Acquiring lock "cinder-535e3510-b25a-4143-9eb7-369c450ffce6-delete_volume" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:52:59 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-65057e8d-d225-4e1e-a09a-e92abcde7c85 tempest-TestMinimumBasicScenario-118664991 None] Lock "cinder-535e3510-b25a-4143-9eb7-369c450ffce6-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:52:59 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-65057e8d-d225-4e1e-a09a-e92abcde7c85 tempest-TestMinimumBasicScenario-118664991 None] Acquiring lock "cinder-quobyte-535e3510-b25a-4143-9eb7-369c450ffce6" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:52:59 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-65057e8d-d225-4e1e-a09a-e92abcde7c85 tempest-TestMinimumBasicScenario-118664991 None] Lock "cinder-quobyte-535e3510-b25a-4143-9eb7-369c450ffce6" acquired by "delete_volume" :: waited 0.018s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:52:59 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bdbdca8-37e7-4b3a-84df-f3fac2c4f7c0]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 19:52:59 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-65057e8d-d225-4e1e-a09a-e92abcde7c85 tempest-TestMinimumBasicScenario-118664991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-535e3510-b25a-4143-9eb7-369c450ffce6 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:52:59 devstack sudo[97921]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-535e3510-b25a-4143-9eb7-369c450ffce6
Jul 02 19:52:59 devstack sudo[97921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:52:59 devstack sudo[97919]: pam_unix(sudo:session): session closed for user root
Jul 02 19:52:59 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-a1e4afb6-172f-4cb4-8e14-6492f45c2e71 tempest-AttachVolumeNegativeTest-732301193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e" returned: 0 in 1.011s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:52:59 devstack cinder-volume[86639]: DEBUG cinder.manager [None req-a1e4afb6-172f-4cb4-8e14-6492f45c2e71 tempest-AttachVolumeNegativeTest-732301193 None] Notifying Schedulers of capabilities ... {{(pid=86639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 19:52:59 devstack sudo[97916]: pam_unix(sudo:session): session closed for user root
Jul 02 19:52:59 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-a1e4afb6-172f-4cb4-8e14-6492f45c2e71 tempest-AttachVolumeNegativeTest-732301193 None] Deleted volume successfully.
Jul 02 19:52:59 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-070349cd-bd3f-43cc-bdfc-bfc287aacbb6 tempest-VolumesListAdminTestJSON-59337829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-6d4b1148-2b2c-4c70-9dbd-bb459b3cd8f3 1073741824" returned: 0 in 1.331s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:52:59 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-a1e4afb6-172f-4cb4-8e14-6492f45c2e71 tempest-AttachVolumeNegativeTest-732301193 None] Lock "cinder-f0d8d55a-8d45-43e2-9cfe-74c280ab466f-delete_volume" released by "delete_volume" :: held 3.119s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:52:59 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-070349cd-bd3f-43cc-bdfc-bfc287aacbb6 tempest-VolumesListAdminTestJSON-59337829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-6d4b1148-2b2c-4c70-9dbd-bb459b3cd8f3 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:52:59 devstack sudo[97928]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-6d4b1148-2b2c-4c70-9dbd-bb459b3cd8f3
Jul 02 19:52:59 devstack sudo[97928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:52:59 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-11eafd88-7832-4787-9fb4-913903e17cb5 tempest-VolumesGetTest-901652034 None] Acquiring lock "cinder-8645b574-180f-4291-984a-416542b40c48-delete_volume" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:52:59 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-11eafd88-7832-4787-9fb4-913903e17cb5 tempest-VolumesGetTest-901652034 None] Lock "cinder-8645b574-180f-4291-984a-416542b40c48-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:52:59 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-11eafd88-7832-4787-9fb4-913903e17cb5 tempest-VolumesGetTest-901652034 None] Acquiring lock "cinder-quobyte-8645b574-180f-4291-984a-416542b40c48" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:52:59 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-11eafd88-7832-4787-9fb4-913903e17cb5 tempest-VolumesGetTest-901652034 None] Lock "cinder-quobyte-8645b574-180f-4291-984a-416542b40c48" acquired by "delete_volume" :: waited 0.015s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:53:00 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[3272d9d1-b9f6-42c5-a038-6c0445db54e1]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 19:53:00 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-11eafd88-7832-4787-9fb4-913903e17cb5 tempest-VolumesGetTest-901652034 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8645b574-180f-4291-984a-416542b40c48 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:53:00 devstack sudo[97930]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8645b574-180f-4291-984a-416542b40c48
Jul 02 19:53:00 devstack sudo[97930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:53:00 devstack sudo[97921]: pam_unix(sudo:session): session closed for user root
Jul 02 19:53:00 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-65057e8d-d225-4e1e-a09a-e92abcde7c85 tempest-TestMinimumBasicScenario-118664991 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-535e3510-b25a-4143-9eb7-369c450ffce6" returned: 0 in 1.230s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:53:00 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-65057e8d-d225-4e1e-a09a-e92abcde7c85 tempest-TestMinimumBasicScenario-118664991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-535e3510-b25a-4143-9eb7-369c450ffce6 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:53:00 devstack sudo[97935]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-535e3510-b25a-4143-9eb7-369c450ffce6
Jul 02 19:53:00 devstack sudo[97935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:53:00 devstack sudo[97928]: pam_unix(sudo:session): session closed for user root
Jul 02 19:53:00 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-070349cd-bd3f-43cc-bdfc-bfc287aacbb6 tempest-VolumesListAdminTestJSON-59337829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-6d4b1148-2b2c-4c70-9dbd-bb459b3cd8f3" returned: 0 in 1.011s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:53:00 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-070349cd-bd3f-43cc-bdfc-bfc287aacbb6 tempest-VolumesListAdminTestJSON-59337829 None] <== create_volume: return (2402ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'} {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 19:53:00 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-070349cd-bd3f-43cc-bdfc-bfc287aacbb6 tempest-VolumesListAdminTestJSON-59337829 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.405s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:53:00 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-070349cd-bd3f-43cc-bdfc-bfc287aacbb6 tempest-VolumesListAdminTestJSON-59337829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f750bdd3-3a34-472f-9743-2f08a232843d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d4b1148-2b2c-4c70-9dbd-bb459b3cd8f3', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:53:00 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-070349cd-bd3f-43cc-bdfc-bfc287aacbb6 tempest-VolumesListAdminTestJSON-59337829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1c4ea7f-6a02-4d12-aa04-4619f54a2972) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:53:00 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-070349cd-bd3f-43cc-bdfc-bfc287aacbb6 tempest-VolumesListAdminTestJSON-59337829 None] Volume volume-6d4b1148-2b2c-4c70-9dbd-bb459b3cd8f3 (6d4b1148-2b2c-4c70-9dbd-bb459b3cd8f3): created successfully
Jul 02 19:53:00 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-070349cd-bd3f-43cc-bdfc-bfc287aacbb6 tempest-VolumesListAdminTestJSON-59337829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1c4ea7f-6a02-4d12-aa04-4619f54a2972) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:53:00 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-070349cd-bd3f-43cc-bdfc-bfc287aacbb6 tempest-VolumesListAdminTestJSON-59337829 None] Flow 'volume_create_manager' (b23d2207-977d-4303-ab6a-72046a0362e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 19:53:00 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-070349cd-bd3f-43cc-bdfc-bfc287aacbb6 tempest-VolumesListAdminTestJSON-59337829 None] Created volume successfully.
Jul 02 19:53:00 devstack sudo[97930]: pam_unix(sudo:session): session closed for user root
Jul 02 19:53:00 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-11eafd88-7832-4787-9fb4-913903e17cb5 tempest-VolumesGetTest-901652034 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8645b574-180f-4291-984a-416542b40c48" returned: 0 in 0.984s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:53:00 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-11eafd88-7832-4787-9fb4-913903e17cb5 tempest-VolumesGetTest-901652034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8645b574-180f-4291-984a-416542b40c48 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:53:01 devstack sudo[97943]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8645b574-180f-4291-984a-416542b40c48
Jul 02 19:53:01 devstack sudo[97943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:53:01 devstack sudo[97935]: pam_unix(sudo:session): session closed for user root
Jul 02 19:53:01 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-65057e8d-d225-4e1e-a09a-e92abcde7c85 tempest-TestMinimumBasicScenario-118664991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-535e3510-b25a-4143-9eb7-369c450ffce6" returned: 0 in 1.009s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:53:01 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-65057e8d-d225-4e1e-a09a-e92abcde7c85 tempest-TestMinimumBasicScenario-118664991 None] Lock "cinder-quobyte-535e3510-b25a-4143-9eb7-369c450ffce6" released by "delete_volume" :: held 2.314s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:53:01 devstack cinder-volume[86639]: DEBUG cinder.quota [None req-65057e8d-d225-4e1e-a09a-e92abcde7c85 tempest-TestMinimumBasicScenario-118664991 None] Created reservations ['2f6ad02e-5752-4b6c-91ab-367adb2465ff', 'e7c912c1-d3d8-46e8-8b64-5b0047236132', '7aa49f15-273b-4160-adac-1db44d07af7c', '3b7ac0b9-f342-4e75-843d-170c8c29bcf0'] {{(pid=86639) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 19:53:01 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-65057e8d-d225-4e1e-a09a-e92abcde7c85 tempest-TestMinimumBasicScenario-118664991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:53:01 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-65057e8d-d225-4e1e-a09a-e92abcde7c85 tempest-TestMinimumBasicScenario-118664991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:53:01 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-65057e8d-d225-4e1e-a09a-e92abcde7c85 tempest-TestMinimumBasicScenario-118664991 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 19:53:01 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-65057e8d-d225-4e1e-a09a-e92abcde7c85 tempest-TestMinimumBasicScenario-118664991 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 19:53:01 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-65057e8d-d225-4e1e-a09a-e92abcde7c85 tempest-TestMinimumBasicScenario-118664991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:53:01 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-65057e8d-d225-4e1e-a09a-e92abcde7c85 tempest-TestMinimumBasicScenario-118664991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:53:01 devstack sudo[97943]: pam_unix(sudo:session): session closed for user root
Jul 02 19:53:01 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-11eafd88-7832-4787-9fb4-913903e17cb5 tempest-VolumesGetTest-901652034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8645b574-180f-4291-984a-416542b40c48" returned: 0 in 0.753s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:53:01 devstack sudo[97947]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e
Jul 02 19:53:01 devstack sudo[97947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:53:01 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-11eafd88-7832-4787-9fb4-913903e17cb5 tempest-VolumesGetTest-901652034 None] Lock "cinder-quobyte-8645b574-180f-4291-984a-416542b40c48" released by "delete_volume" :: held 1.796s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:53:01 devstack cinder-volume[86639]: DEBUG cinder.quota [None req-11eafd88-7832-4787-9fb4-913903e17cb5 tempest-VolumesGetTest-901652034 None] Created reservations ['857db123-c621-489e-b50d-e41bf89f5b91', 'a77669b1-79d9-40e0-beef-a48ee7ea354d', '105fdb57-cdec-46ca-9b98-f937db8cf9a4', 'd4836982-02f1-4e2f-98df-5f7935e2f3cd'] {{(pid=86639) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 19:53:01 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-11eafd88-7832-4787-9fb4-913903e17cb5 tempest-VolumesGetTest-901652034 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:53:01 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-11eafd88-7832-4787-9fb4-913903e17cb5 tempest-VolumesGetTest-901652034 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:53:01 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-11eafd88-7832-4787-9fb4-913903e17cb5 tempest-VolumesGetTest-901652034 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 19:53:01 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-11eafd88-7832-4787-9fb4-913903e17cb5 tempest-VolumesGetTest-901652034 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 19:53:01 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-11eafd88-7832-4787-9fb4-913903e17cb5 tempest-VolumesGetTest-901652034 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:53:01 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-11eafd88-7832-4787-9fb4-913903e17cb5 tempest-VolumesGetTest-901652034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:53:01 devstack sudo[97949]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e
Jul 02 19:53:01 devstack sudo[97949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:53:02 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-b36399eb-c4cd-4221-8315-d83edc84f98a tempest-VolumesGetTest-901652034 None] Acquiring lock "cinder-ad87a1fd-3bff-4e59-a9d1-b1157213cdc7-delete_volume" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:53:02 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-b36399eb-c4cd-4221-8315-d83edc84f98a tempest-VolumesGetTest-901652034 None] Lock "cinder-ad87a1fd-3bff-4e59-a9d1-b1157213cdc7-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:53:02 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-b36399eb-c4cd-4221-8315-d83edc84f98a tempest-VolumesGetTest-901652034 None] Acquiring lock "cinder-quobyte-ad87a1fd-3bff-4e59-a9d1-b1157213cdc7" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:53:02 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-b36399eb-c4cd-4221-8315-d83edc84f98a tempest-VolumesGetTest-901652034 None] Lock "cinder-quobyte-ad87a1fd-3bff-4e59-a9d1-b1157213cdc7" acquired by "delete_volume" :: waited 0.035s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:53:02 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9856f12-df89-4220-b214-754dbe9fc195]: (4, 'raw') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 19:53:02 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-b36399eb-c4cd-4221-8315-d83edc84f98a tempest-VolumesGetTest-901652034 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-ad87a1fd-3bff-4e59-a9d1-b1157213cdc7 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:53:02 devstack sudo[97953]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-ad87a1fd-3bff-4e59-a9d1-b1157213cdc7
Jul 02 19:53:02 devstack sudo[97953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:53:02 devstack sudo[97947]: pam_unix(sudo:session): session closed for user root
Jul 02 19:53:02 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-65057e8d-d225-4e1e-a09a-e92abcde7c85 tempest-TestMinimumBasicScenario-118664991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e" returned: 0 in 1.204s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:53:02 devstack cinder-volume[86639]: DEBUG cinder.manager [None req-65057e8d-d225-4e1e-a09a-e92abcde7c85 tempest-TestMinimumBasicScenario-118664991 None] Notifying Schedulers of capabilities ... {{(pid=86639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 19:53:02 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-65057e8d-d225-4e1e-a09a-e92abcde7c85 tempest-TestMinimumBasicScenario-118664991 None] Deleted volume successfully.
Jul 02 19:53:02 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-65057e8d-d225-4e1e-a09a-e92abcde7c85 tempest-TestMinimumBasicScenario-118664991 None] Lock "cinder-535e3510-b25a-4143-9eb7-369c450ffce6-delete_volume" released by "delete_volume" :: held 3.831s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:53:03 devstack sudo[97949]: pam_unix(sudo:session): session closed for user root
Jul 02 19:53:03 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-11eafd88-7832-4787-9fb4-913903e17cb5 tempest-VolumesGetTest-901652034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e" returned: 0 in 1.310s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:53:03 devstack cinder-volume[86639]: DEBUG cinder.manager [None req-11eafd88-7832-4787-9fb4-913903e17cb5 tempest-VolumesGetTest-901652034 None] Notifying Schedulers of capabilities ... {{(pid=86639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 19:53:03 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-11eafd88-7832-4787-9fb4-913903e17cb5 tempest-VolumesGetTest-901652034 None] Deleted volume successfully.
Jul 02 19:53:03 devstack cinder-volume[86639]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9e54e6d-7e1b-4c46-a3eb-69cb6b7fb891 tempest-VolumesListAdminTestJSON-1465590778 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 19:53:03 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-f9e54e6d-7e1b-4c46-a3eb-69cb6b7fb891 tempest-VolumesListAdminTestJSON-1465590778 None] Flow 'volume_create_manager' (51317a2b-1edb-4d0e-b169-6d21477b24a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 19:53:03 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-f9e54e6d-7e1b-4c46-a3eb-69cb6b7fb891 tempest-VolumesListAdminTestJSON-1465590778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3102ff2c-7bfd-4c8b-a4c4-bb468aa83a80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:53:03 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-11eafd88-7832-4787-9fb4-913903e17cb5 tempest-VolumesGetTest-901652034 None] Lock "cinder-8645b574-180f-4291-984a-416542b40c48-delete_volume" released by "delete_volume" :: held 3.436s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:53:03 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-f9e54e6d-7e1b-4c46-a3eb-69cb6b7fb891 tempest-VolumesListAdminTestJSON-1465590778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3102ff2c-7bfd-4c8b-a4c4-bb468aa83a80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T17:53:03Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80633113-9f87-4ad9-a04c-432f5be9c716,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f30d223f6a6f4f0ea05f388faeb565dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T17:53:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T17:53:03Z,use_quota=True,user_id='bcd698be71ba4bd69b599660f28b5fd5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:53:03 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-f9e54e6d-7e1b-4c46-a3eb-69cb6b7fb891 tempest-VolumesListAdminTestJSON-1465590778 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a41f4202-39ed-4ec7-a5e3-78227ce39787) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:53:03 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-f9e54e6d-7e1b-4c46-a3eb-69cb6b7fb891 tempest-VolumesListAdminTestJSON-1465590778 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a41f4202-39ed-4ec7-a5e3-78227ce39787) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:53:03 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-f9e54e6d-7e1b-4c46-a3eb-69cb6b7fb891 tempest-VolumesListAdminTestJSON-1465590778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (618e8057-171f-4a03-a1f8-b200ffd02388) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:53:03 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-f9e54e6d-7e1b-4c46-a3eb-69cb6b7fb891 tempest-VolumesListAdminTestJSON-1465590778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (618e8057-171f-4a03-a1f8-b200ffd02388) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '80633113-9f87-4ad9-a04c-432f5be9c716', 'volume_name': 'volume-80633113-9f87-4ad9-a04c-432f5be9c716', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:53:03 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-f9e54e6d-7e1b-4c46-a3eb-69cb6b7fb891 tempest-VolumesListAdminTestJSON-1465590778 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9850502f-839e-4a84-b131-a5f6f05737f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:53:03 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-f9e54e6d-7e1b-4c46-a3eb-69cb6b7fb891 tempest-VolumesListAdminTestJSON-1465590778 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9850502f-839e-4a84-b131-a5f6f05737f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:53:03 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-f9e54e6d-7e1b-4c46-a3eb-69cb6b7fb891 tempest-VolumesListAdminTestJSON-1465590778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c6f7439-3c51-4d44-a0be-dc6743e8cd89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:53:03 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-f9e54e6d-7e1b-4c46-a3eb-69cb6b7fb891 tempest-VolumesListAdminTestJSON-1465590778 None] Volume 80633113-9f87-4ad9-a04c-432f5be9c716: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-80633113-9f87-4ad9-a04c-432f5be9c716', 'volume_size': 1}
Jul 02 19:53:03 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-f9e54e6d-7e1b-4c46-a3eb-69cb6b7fb891 tempest-VolumesListAdminTestJSON-1465590778 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:53:03 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-f9e54e6d-7e1b-4c46-a3eb-69cb6b7fb891 tempest-VolumesListAdminTestJSON-1465590778 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:53:03 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-f9e54e6d-7e1b-4c46-a3eb-69cb6b7fb891 tempest-VolumesListAdminTestJSON-1465590778 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce906cb830>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T17:53:03Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80633113-9f87-4ad9-a04c-432f5be9c716,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f30d223f6a6f4f0ea05f388faeb565dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T17:53:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T17:53:03Z,use_quota=True,user_id='bcd698be71ba4bd69b599660f28b5fd5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)}" {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 19:53:03 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-f9e54e6d-7e1b-4c46-a3eb-69cb6b7fb891 tempest-VolumesListAdminTestJSON-1465590778 None] Creating volume 80633113-9f87-4ad9-a04c-432f5be9c716 {{(pid=86639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 19:53:03 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-f9e54e6d-7e1b-4c46-a3eb-69cb6b7fb891 tempest-VolumesListAdminTestJSON-1465590778 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:53:03 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-f9e54e6d-7e1b-4c46-a3eb-69cb6b7fb891 tempest-VolumesListAdminTestJSON-1465590778 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:53:03 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-f9e54e6d-7e1b-4c46-a3eb-69cb6b7fb891 tempest-VolumesListAdminTestJSON-1465590778 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 19:53:03 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-f9e54e6d-7e1b-4c46-a3eb-69cb6b7fb891 tempest-VolumesListAdminTestJSON-1465590778 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 19:53:03 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-f9e54e6d-7e1b-4c46-a3eb-69cb6b7fb891 tempest-VolumesListAdminTestJSON-1465590778 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:53:03 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-f9e54e6d-7e1b-4c46-a3eb-69cb6b7fb891 tempest-VolumesListAdminTestJSON-1465590778 None] Selected osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92 as target Quobyte volume. {{(pid=86639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 19:53:03 devstack cinder-volume[86639]: INFO cinder.volume.drivers.remotefs [None req-f9e54e6d-7e1b-4c46-a3eb-69cb6b7fb891 tempest-VolumesListAdminTestJSON-1465590778 None] casted to osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92
Jul 02 19:53:03 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-f9e54e6d-7e1b-4c46-a3eb-69cb6b7fb891 tempest-VolumesListAdminTestJSON-1465590778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-80633113-9f87-4ad9-a04c-432f5be9c716 1073741824 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:53:03 devstack sudo[97956]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-80633113-9f87-4ad9-a04c-432f5be9c716 1073741824
Jul 02 19:53:03 devstack sudo[97956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:53:03 devstack sudo[97953]: pam_unix(sudo:session): session closed for user root
Jul 02 19:53:03 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-b36399eb-c4cd-4221-8315-d83edc84f98a tempest-VolumesGetTest-901652034 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-ad87a1fd-3bff-4e59-a9d1-b1157213cdc7" returned: 0 in 1.250s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:53:03 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-b36399eb-c4cd-4221-8315-d83edc84f98a tempest-VolumesGetTest-901652034 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-ad87a1fd-3bff-4e59-a9d1-b1157213cdc7 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:53:04 devstack sudo[97967]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-ad87a1fd-3bff-4e59-a9d1-b1157213cdc7
Jul 02 19:53:04 devstack sudo[97967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:53:04 devstack sudo[97956]: pam_unix(sudo:session): session closed for user root
Jul 02 19:53:04 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-f9e54e6d-7e1b-4c46-a3eb-69cb6b7fb891 tempest-VolumesListAdminTestJSON-1465590778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-80633113-9f87-4ad9-a04c-432f5be9c716 1073741824" returned: 0 in 1.431s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:53:05 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-f9e54e6d-7e1b-4c46-a3eb-69cb6b7fb891 tempest-VolumesListAdminTestJSON-1465590778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-80633113-9f87-4ad9-a04c-432f5be9c716 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:53:05 devstack sudo[98007]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-80633113-9f87-4ad9-a04c-432f5be9c716
Jul 02 19:53:05 devstack sudo[98007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:53:05 devstack sudo[97967]: pam_unix(sudo:session): session closed for user root
Jul 02 19:53:05 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-b36399eb-c4cd-4221-8315-d83edc84f98a tempest-VolumesGetTest-901652034 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-ad87a1fd-3bff-4e59-a9d1-b1157213cdc7" returned: 1 in 1.267s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:53:05 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-b36399eb-c4cd-4221-8315-d83edc84f98a tempest-VolumesGetTest-901652034 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-ad87a1fd-3bff-4e59-a9d1-b1157213cdc7' failed. Not Retrying. {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 02 19:53:05 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-b36399eb-c4cd-4221-8315-d83edc84f98a tempest-VolumesGetTest-901652034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-ad87a1fd-3bff-4e59-a9d1-b1157213cdc7 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:53:05 devstack sudo[98009]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-ad87a1fd-3bff-4e59-a9d1-b1157213cdc7
Jul 02 19:53:05 devstack sudo[98009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:53:06 devstack sudo[98007]: pam_unix(sudo:session): session closed for user root
Jul 02 19:53:06 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-f9e54e6d-7e1b-4c46-a3eb-69cb6b7fb891 tempest-VolumesListAdminTestJSON-1465590778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-80633113-9f87-4ad9-a04c-432f5be9c716" returned: 0 in 0.992s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:53:06 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-f9e54e6d-7e1b-4c46-a3eb-69cb6b7fb891 tempest-VolumesListAdminTestJSON-1465590778 None] <== create_volume: return (2604ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'} {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 19:53:06 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-f9e54e6d-7e1b-4c46-a3eb-69cb6b7fb891 tempest-VolumesListAdminTestJSON-1465590778 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.610s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:53:06 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-f9e54e6d-7e1b-4c46-a3eb-69cb6b7fb891 tempest-VolumesListAdminTestJSON-1465590778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c6f7439-3c51-4d44-a0be-dc6743e8cd89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80633113-9f87-4ad9-a04c-432f5be9c716', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:53:06 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-f9e54e6d-7e1b-4c46-a3eb-69cb6b7fb891 tempest-VolumesListAdminTestJSON-1465590778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2358f61-eb97-4257-9d48-b0c137e150c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:53:06 devstack sudo[98009]: pam_unix(sudo:session): session closed for user root
Jul 02 19:53:06 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-b36399eb-c4cd-4221-8315-d83edc84f98a tempest-VolumesGetTest-901652034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-ad87a1fd-3bff-4e59-a9d1-b1157213cdc7" returned: 0 in 0.954s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:53:06 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-b36399eb-c4cd-4221-8315-d83edc84f98a tempest-VolumesGetTest-901652034 None] Lock "cinder-quobyte-ad87a1fd-3bff-4e59-a9d1-b1157213cdc7" released by "delete_volume" :: held 3.598s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:53:06 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-f9e54e6d-7e1b-4c46-a3eb-69cb6b7fb891 tempest-VolumesListAdminTestJSON-1465590778 None] Volume volume-80633113-9f87-4ad9-a04c-432f5be9c716 (80633113-9f87-4ad9-a04c-432f5be9c716): created successfully
Jul 02 19:53:06 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-f9e54e6d-7e1b-4c46-a3eb-69cb6b7fb891 tempest-VolumesListAdminTestJSON-1465590778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2358f61-eb97-4257-9d48-b0c137e150c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:53:06 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-f9e54e6d-7e1b-4c46-a3eb-69cb6b7fb891 tempest-VolumesListAdminTestJSON-1465590778 None] Flow 'volume_create_manager' (51317a2b-1edb-4d0e-b169-6d21477b24a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 19:53:06 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-f9e54e6d-7e1b-4c46-a3eb-69cb6b7fb891 tempest-VolumesListAdminTestJSON-1465590778 None] Created volume successfully.
Jul 02 19:53:06 devstack cinder-volume[86639]: DEBUG cinder.quota [None req-b36399eb-c4cd-4221-8315-d83edc84f98a tempest-VolumesGetTest-901652034 None] Created reservations ['0871eb4f-37e7-4952-8b77-a3f13ad65121', '37ae4376-7431-4be8-8870-d790be173bb6', 'd79d952a-26ae-4466-bd6e-9459d2d3f74c', '7ad8871e-8d10-47f1-8127-21ba515591f0'] {{(pid=86639) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 19:53:06 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-b36399eb-c4cd-4221-8315-d83edc84f98a tempest-VolumesGetTest-901652034 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:53:06 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-b36399eb-c4cd-4221-8315-d83edc84f98a tempest-VolumesGetTest-901652034 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:53:06 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-b36399eb-c4cd-4221-8315-d83edc84f98a tempest-VolumesGetTest-901652034 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 19:53:06 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-b36399eb-c4cd-4221-8315-d83edc84f98a tempest-VolumesGetTest-901652034 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 19:53:06 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-b36399eb-c4cd-4221-8315-d83edc84f98a tempest-VolumesGetTest-901652034 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:53:06 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-b36399eb-c4cd-4221-8315-d83edc84f98a tempest-VolumesGetTest-901652034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:53:06 devstack sudo[98018]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e
Jul 02 19:53:06 devstack sudo[98018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:53:06 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-9f090adf-862e-4944-99c0-dde4c38705bf tempest-VolumesListAdminTestJSON-1465590778 None] Acquiring lock "cinder-80633113-9f87-4ad9-a04c-432f5be9c716-delete_volume" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:53:06 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-9f090adf-862e-4944-99c0-dde4c38705bf tempest-VolumesListAdminTestJSON-1465590778 None] Lock "cinder-80633113-9f87-4ad9-a04c-432f5be9c716-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:53:06 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-9f090adf-862e-4944-99c0-dde4c38705bf tempest-VolumesListAdminTestJSON-1465590778 None] Acquiring lock "cinder-quobyte-80633113-9f87-4ad9-a04c-432f5be9c716" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:53:06 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-9f090adf-862e-4944-99c0-dde4c38705bf tempest-VolumesListAdminTestJSON-1465590778 None] Lock "cinder-quobyte-80633113-9f87-4ad9-a04c-432f5be9c716" acquired by "delete_volume" :: waited 0.016s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:53:06 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[60c5e734-82a1-476c-9def-dbbabc7d4035]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 19:53:06 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-9f090adf-862e-4944-99c0-dde4c38705bf tempest-VolumesListAdminTestJSON-1465590778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-80633113-9f87-4ad9-a04c-432f5be9c716 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:53:07 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-bb43d090-e78b-436e-9cd1-d6e53a5c314f tempest-VolumesListAdminTestJSON-59337829 None] Acquiring lock "cinder-6d4b1148-2b2c-4c70-9dbd-bb459b3cd8f3-delete_volume" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:53:07 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-bb43d090-e78b-436e-9cd1-d6e53a5c314f tempest-VolumesListAdminTestJSON-59337829 None] Lock "cinder-6d4b1148-2b2c-4c70-9dbd-bb459b3cd8f3-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:53:07 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-bb43d090-e78b-436e-9cd1-d6e53a5c314f tempest-VolumesListAdminTestJSON-59337829 None] Acquiring lock "cinder-quobyte-6d4b1148-2b2c-4c70-9dbd-bb459b3cd8f3" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:53:07 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-bb43d090-e78b-436e-9cd1-d6e53a5c314f tempest-VolumesListAdminTestJSON-59337829 None] Lock "cinder-quobyte-6d4b1148-2b2c-4c70-9dbd-bb459b3cd8f3" acquired by "delete_volume" :: waited 0.023s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:53:07 devstack sudo[98023]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-80633113-9f87-4ad9-a04c-432f5be9c716
Jul 02 19:53:07 devstack sudo[98023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:53:07 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[fae5a825-81d2-4dbc-a412-43dada88f864]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 19:53:07 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-bb43d090-e78b-436e-9cd1-d6e53a5c314f tempest-VolumesListAdminTestJSON-59337829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-6d4b1148-2b2c-4c70-9dbd-bb459b3cd8f3 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:53:07 devstack sudo[98025]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-6d4b1148-2b2c-4c70-9dbd-bb459b3cd8f3
Jul 02 19:53:07 devstack sudo[98025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:53:07 devstack sudo[98018]: pam_unix(sudo:session): session closed for user root
Jul 02 19:53:07 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-b36399eb-c4cd-4221-8315-d83edc84f98a tempest-VolumesGetTest-901652034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e" returned: 0 in 1.178s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:53:07 devstack cinder-volume[86639]: DEBUG cinder.manager [None req-b36399eb-c4cd-4221-8315-d83edc84f98a tempest-VolumesGetTest-901652034 None] Notifying Schedulers of capabilities ... {{(pid=86639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 19:53:07 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-b36399eb-c4cd-4221-8315-d83edc84f98a tempest-VolumesGetTest-901652034 None] Deleted volume successfully.
Jul 02 19:53:07 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-b36399eb-c4cd-4221-8315-d83edc84f98a tempest-VolumesGetTest-901652034 None] Lock "cinder-ad87a1fd-3bff-4e59-a9d1-b1157213cdc7-delete_volume" released by "delete_volume" :: held 5.274s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:53:08 devstack sudo[98025]: pam_unix(sudo:session): session closed for user root
Jul 02 19:53:08 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-bb43d090-e78b-436e-9cd1-d6e53a5c314f tempest-VolumesListAdminTestJSON-59337829 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-6d4b1148-2b2c-4c70-9dbd-bb459b3cd8f3" returned: 0 in 1.013s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:53:08 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-bb43d090-e78b-436e-9cd1-d6e53a5c314f tempest-VolumesListAdminTestJSON-59337829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-6d4b1148-2b2c-4c70-9dbd-bb459b3cd8f3 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:53:08 devstack sudo[98035]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-6d4b1148-2b2c-4c70-9dbd-bb459b3cd8f3
Jul 02 19:53:08 devstack sudo[98035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:53:08 devstack sudo[98023]: pam_unix(sudo:session): session closed for user root
Jul 02 19:53:08 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-9f090adf-862e-4944-99c0-dde4c38705bf tempest-VolumesListAdminTestJSON-1465590778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-80633113-9f87-4ad9-a04c-432f5be9c716" returned: 0 in 1.484s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:53:08 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-9f090adf-862e-4944-99c0-dde4c38705bf tempest-VolumesListAdminTestJSON-1465590778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-80633113-9f87-4ad9-a04c-432f5be9c716 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:53:08 devstack sudo[98037]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-80633113-9f87-4ad9-a04c-432f5be9c716
Jul 02 19:53:08 devstack sudo[98037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:53:09 devstack sudo[98035]: pam_unix(sudo:session): session closed for user root
Jul 02 19:53:09 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-bb43d090-e78b-436e-9cd1-d6e53a5c314f tempest-VolumesListAdminTestJSON-59337829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-6d4b1148-2b2c-4c70-9dbd-bb459b3cd8f3" returned: 0 in 0.982s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:53:09 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-bb43d090-e78b-436e-9cd1-d6e53a5c314f tempest-VolumesListAdminTestJSON-59337829 None] Lock "cinder-quobyte-6d4b1148-2b2c-4c70-9dbd-bb459b3cd8f3" released by "delete_volume" :: held 2.071s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:53:09 devstack cinder-volume[86639]: DEBUG cinder.quota [None req-bb43d090-e78b-436e-9cd1-d6e53a5c314f tempest-VolumesListAdminTestJSON-59337829 None] Created reservations ['bb724289-49f8-46b4-8e09-a146a91e39b9', 'e34b6c6b-5ddc-4b26-9da2-7a3d6db22df0', '36e9778f-1c76-4a66-b55e-acf6ad459d6f', '06d535c1-d9d4-4131-9263-5a46c94023b0'] {{(pid=86639) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 19:53:09 devstack sudo[98037]: pam_unix(sudo:session): session closed for user root
Jul 02 19:53:09 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-bb43d090-e78b-436e-9cd1-d6e53a5c314f tempest-VolumesListAdminTestJSON-59337829 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:53:09 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-bb43d090-e78b-436e-9cd1-d6e53a5c314f tempest-VolumesListAdminTestJSON-59337829 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:53:09 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-bb43d090-e78b-436e-9cd1-d6e53a5c314f tempest-VolumesListAdminTestJSON-59337829 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 19:53:09 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-bb43d090-e78b-436e-9cd1-d6e53a5c314f tempest-VolumesListAdminTestJSON-59337829 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 19:53:09 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-bb43d090-e78b-436e-9cd1-d6e53a5c314f tempest-VolumesListAdminTestJSON-59337829 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:53:09 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-bb43d090-e78b-436e-9cd1-d6e53a5c314f tempest-VolumesListAdminTestJSON-59337829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:53:09 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-9f090adf-862e-4944-99c0-dde4c38705bf tempest-VolumesListAdminTestJSON-1465590778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-80633113-9f87-4ad9-a04c-432f5be9c716" returned: 0 in 0.969s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:53:09 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-9f090adf-862e-4944-99c0-dde4c38705bf tempest-VolumesListAdminTestJSON-1465590778 None] Lock "cinder-quobyte-80633113-9f87-4ad9-a04c-432f5be9c716" released by "delete_volume" :: held 2.535s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:53:09 devstack sudo[98041]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e
Jul 02 19:53:09 devstack sudo[98041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:53:09 devstack cinder-volume[86639]: DEBUG cinder.quota [None req-9f090adf-862e-4944-99c0-dde4c38705bf tempest-VolumesListAdminTestJSON-1465590778 None] Created reservations ['c8f3941a-41d8-48b1-ab90-79026b6145fe', 'd8b98e89-38ca-4936-832b-a4703e65d18b', 'da8d73f3-1830-40ff-aecc-fa8110df62f4', 'ee41b391-895f-415d-8a69-383751206233'] {{(pid=86639) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 19:53:09 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-751d6e91-7c5f-4094-8769-4e7b8772ad82 tempest-VolumesListAdminTestJSON-59337829 None] Acquiring lock "cinder-a95c916c-3faa-4d5f-aeac-ff3ed7084dfd-delete_volume" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:53:09 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-751d6e91-7c5f-4094-8769-4e7b8772ad82 tempest-VolumesListAdminTestJSON-59337829 None] Lock "cinder-a95c916c-3faa-4d5f-aeac-ff3ed7084dfd-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:53:09 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-9f090adf-862e-4944-99c0-dde4c38705bf tempest-VolumesListAdminTestJSON-1465590778 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:53:09 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-9f090adf-862e-4944-99c0-dde4c38705bf tempest-VolumesListAdminTestJSON-1465590778 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:53:09 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-9f090adf-862e-4944-99c0-dde4c38705bf tempest-VolumesListAdminTestJSON-1465590778 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 19:53:09 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-9f090adf-862e-4944-99c0-dde4c38705bf tempest-VolumesListAdminTestJSON-1465590778 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 19:53:09 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-9f090adf-862e-4944-99c0-dde4c38705bf tempest-VolumesListAdminTestJSON-1465590778 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:53:09 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-9f090adf-862e-4944-99c0-dde4c38705bf tempest-VolumesListAdminTestJSON-1465590778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:53:09 devstack sudo[98043]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e
Jul 02 19:53:09 devstack sudo[98043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:53:09 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-751d6e91-7c5f-4094-8769-4e7b8772ad82 tempest-VolumesListAdminTestJSON-59337829 None] Acquiring lock "cinder-quobyte-a95c916c-3faa-4d5f-aeac-ff3ed7084dfd" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:53:09 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-751d6e91-7c5f-4094-8769-4e7b8772ad82 tempest-VolumesListAdminTestJSON-59337829 None] Lock "cinder-quobyte-a95c916c-3faa-4d5f-aeac-ff3ed7084dfd" acquired by "delete_volume" :: waited 0.023s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:53:09 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[219bd2db-9df7-4880-a0a4-869b810d75c9]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 19:53:09 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-751d6e91-7c5f-4094-8769-4e7b8772ad82 tempest-VolumesListAdminTestJSON-59337829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-a95c916c-3faa-4d5f-aeac-ff3ed7084dfd {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:53:09 devstack sudo[98045]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-a95c916c-3faa-4d5f-aeac-ff3ed7084dfd
Jul 02 19:53:09 devstack sudo[98045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:53:10 devstack sudo[98043]: pam_unix(sudo:session): session closed for user root
Jul 02 19:53:10 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-9f090adf-862e-4944-99c0-dde4c38705bf tempest-VolumesListAdminTestJSON-1465590778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e" returned: 0 in 0.904s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:53:10 devstack cinder-volume[86639]: DEBUG cinder.manager [None req-9f090adf-862e-4944-99c0-dde4c38705bf tempest-VolumesListAdminTestJSON-1465590778 None] Notifying Schedulers of capabilities ... {{(pid=86639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 19:53:10 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-9f090adf-862e-4944-99c0-dde4c38705bf tempest-VolumesListAdminTestJSON-1465590778 None] Deleted volume successfully.
Jul 02 19:53:10 devstack sudo[98041]: pam_unix(sudo:session): session closed for user root
Jul 02 19:53:10 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-bb43d090-e78b-436e-9cd1-d6e53a5c314f tempest-VolumesListAdminTestJSON-59337829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e" returned: 0 in 1.199s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:53:10 devstack cinder-volume[86639]: DEBUG cinder.manager [None req-bb43d090-e78b-436e-9cd1-d6e53a5c314f tempest-VolumesListAdminTestJSON-59337829 None] Notifying Schedulers of capabilities ... {{(pid=86639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 19:53:10 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-bb43d090-e78b-436e-9cd1-d6e53a5c314f tempest-VolumesListAdminTestJSON-59337829 None] Deleted volume successfully.
Jul 02 19:53:10 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-9f090adf-862e-4944-99c0-dde4c38705bf tempest-VolumesListAdminTestJSON-1465590778 None] Lock "cinder-80633113-9f87-4ad9-a04c-432f5be9c716-delete_volume" released by "delete_volume" :: held 3.818s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:53:10 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-bb43d090-e78b-436e-9cd1-d6e53a5c314f tempest-VolumesListAdminTestJSON-59337829 None] Lock "cinder-6d4b1148-2b2c-4c70-9dbd-bb459b3cd8f3-delete_volume" released by "delete_volume" :: held 3.600s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:53:10 devstack sudo[98045]: pam_unix(sudo:session): session closed for user root
Jul 02 19:53:10 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-751d6e91-7c5f-4094-8769-4e7b8772ad82 tempest-VolumesListAdminTestJSON-59337829 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-a95c916c-3faa-4d5f-aeac-ff3ed7084dfd" returned: 0 in 1.194s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:53:10 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-751d6e91-7c5f-4094-8769-4e7b8772ad82 tempest-VolumesListAdminTestJSON-59337829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-a95c916c-3faa-4d5f-aeac-ff3ed7084dfd {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:53:10 devstack sudo[98053]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-a95c916c-3faa-4d5f-aeac-ff3ed7084dfd
Jul 02 19:53:10 devstack sudo[98053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:53:11 devstack cinder-volume[86639]: DEBUG cinder.volume.flows.manager.create_volume [None req-6844da5c-1479-48f0-aaeb-2cc3f115dc3b tempest-VolumesTestJSON-454859533 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 19:53:11 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-6844da5c-1479-48f0-aaeb-2cc3f115dc3b tempest-VolumesTestJSON-454859533 None] Flow 'volume_create_manager' (d07b291c-4efb-4e07-9ea5-eee4891652d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 19:53:11 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-6844da5c-1479-48f0-aaeb-2cc3f115dc3b tempest-VolumesTestJSON-454859533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7017a7ef-e2d5-4c27-adfd-296f7ae40e7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:53:11 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-6844da5c-1479-48f0-aaeb-2cc3f115dc3b tempest-VolumesTestJSON-454859533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7017a7ef-e2d5-4c27-adfd-296f7ae40e7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T17:53:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2063261019',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23e753c4-b709-4fa4-9601-aad491300048,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3bb46a828a9a4cf8879f77e380257fb3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T17:53:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T17:53:11Z,use_quota=True,user_id='ff779e43583548959e4a79b18a2dd237',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:53:11 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-6844da5c-1479-48f0-aaeb-2cc3f115dc3b tempest-VolumesTestJSON-454859533 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6917c9df-09f3-46bf-972c-84c5c67ac325) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:53:11 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-6844da5c-1479-48f0-aaeb-2cc3f115dc3b tempest-VolumesTestJSON-454859533 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6917c9df-09f3-46bf-972c-84c5c67ac325) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:53:11 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-6844da5c-1479-48f0-aaeb-2cc3f115dc3b tempest-VolumesTestJSON-454859533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72158a8b-d22a-4041-86f2-8d79135ecd29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:53:11 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-6844da5c-1479-48f0-aaeb-2cc3f115dc3b tempest-VolumesTestJSON-454859533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72158a8b-d22a-4041-86f2-8d79135ecd29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '23e753c4-b709-4fa4-9601-aad491300048', 'volume_name': 'volume-23e753c4-b709-4fa4-9601-aad491300048', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:53:11 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-6844da5c-1479-48f0-aaeb-2cc3f115dc3b tempest-VolumesTestJSON-454859533 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41111044-0db2-415d-a91a-9e57d5ad2e43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:53:11 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-6844da5c-1479-48f0-aaeb-2cc3f115dc3b tempest-VolumesTestJSON-454859533 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41111044-0db2-415d-a91a-9e57d5ad2e43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:53:11 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-6844da5c-1479-48f0-aaeb-2cc3f115dc3b tempest-VolumesTestJSON-454859533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcb0e237-0d2a-43ab-bfab-bee68486f49c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:53:11 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-6844da5c-1479-48f0-aaeb-2cc3f115dc3b tempest-VolumesTestJSON-454859533 None] Volume 23e753c4-b709-4fa4-9601-aad491300048: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-23e753c4-b709-4fa4-9601-aad491300048', 'volume_size': 1}
Jul 02 19:53:11 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-6844da5c-1479-48f0-aaeb-2cc3f115dc3b tempest-VolumesTestJSON-454859533 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:53:11 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-6844da5c-1479-48f0-aaeb-2cc3f115dc3b tempest-VolumesTestJSON-454859533 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:53:11 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-6844da5c-1479-48f0-aaeb-2cc3f115dc3b tempest-VolumesTestJSON-454859533 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce906cb830>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T17:53:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2063261019',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23e753c4-b709-4fa4-9601-aad491300048,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3bb46a828a9a4cf8879f77e380257fb3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T17:53:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T17:53:11Z,use_quota=True,user_id='ff779e43583548959e4a79b18a2dd237',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)}" {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 19:53:11 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-6844da5c-1479-48f0-aaeb-2cc3f115dc3b tempest-VolumesTestJSON-454859533 None] Creating volume 23e753c4-b709-4fa4-9601-aad491300048 {{(pid=86639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 19:53:11 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-6844da5c-1479-48f0-aaeb-2cc3f115dc3b tempest-VolumesTestJSON-454859533 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:53:11 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-6844da5c-1479-48f0-aaeb-2cc3f115dc3b tempest-VolumesTestJSON-454859533 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:53:11 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-6844da5c-1479-48f0-aaeb-2cc3f115dc3b tempest-VolumesTestJSON-454859533 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 19:53:11 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-6844da5c-1479-48f0-aaeb-2cc3f115dc3b tempest-VolumesTestJSON-454859533 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 19:53:11 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-6844da5c-1479-48f0-aaeb-2cc3f115dc3b tempest-VolumesTestJSON-454859533 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:53:11 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-6844da5c-1479-48f0-aaeb-2cc3f115dc3b tempest-VolumesTestJSON-454859533 None] Selected osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92 as target Quobyte volume. {{(pid=86639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 19:53:11 devstack cinder-volume[86639]: INFO cinder.volume.drivers.remotefs [None req-6844da5c-1479-48f0-aaeb-2cc3f115dc3b tempest-VolumesTestJSON-454859533 None] casted to osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92
Jul 02 19:53:11 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-6844da5c-1479-48f0-aaeb-2cc3f115dc3b tempest-VolumesTestJSON-454859533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-23e753c4-b709-4fa4-9601-aad491300048 1073741824 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:53:11 devstack sudo[98055]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-23e753c4-b709-4fa4-9601-aad491300048 1073741824
Jul 02 19:53:11 devstack sudo[98055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:53:11 devstack cinder-volume[86639]: DEBUG cinder.volume.flows.manager.create_volume [None req-40436f50-46e0-4e82-a9da-83338023e787 tempest-VolumesListTestJSON-1365139275 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 19:53:11 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-40436f50-46e0-4e82-a9da-83338023e787 tempest-VolumesListTestJSON-1365139275 None] Flow 'volume_create_manager' (128e0c62-cd25-4fea-845b-856666f3280b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 19:53:11 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-40436f50-46e0-4e82-a9da-83338023e787 tempest-VolumesListTestJSON-1365139275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98d53383-cf4e-4754-861f-c104e6131887) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:53:11 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-40436f50-46e0-4e82-a9da-83338023e787 tempest-VolumesListTestJSON-1365139275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98d53383-cf4e-4754-861f-c104e6131887) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T17:53:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-662853809',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aae422d0-fb22-43cc-8617-ab141d343b6a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='eb0c14739d3042c5aabddbc124ac4a40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T17:53:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T17:53:12Z,use_quota=True,user_id='d1fb29a0b9a44f2eb3cc6cc2fdddbf0a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:53:11 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-40436f50-46e0-4e82-a9da-83338023e787 tempest-VolumesListTestJSON-1365139275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e5f017d-b42a-47f8-920a-d01196e04585) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:53:11 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-40436f50-46e0-4e82-a9da-83338023e787 tempest-VolumesListTestJSON-1365139275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e5f017d-b42a-47f8-920a-d01196e04585) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:53:11 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-40436f50-46e0-4e82-a9da-83338023e787 tempest-VolumesListTestJSON-1365139275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3df46b19-b3c5-4e60-938e-cc31b86df201) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:53:11 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-40436f50-46e0-4e82-a9da-83338023e787 tempest-VolumesListTestJSON-1365139275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3df46b19-b3c5-4e60-938e-cc31b86df201) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aae422d0-fb22-43cc-8617-ab141d343b6a', 'volume_name': 'volume-aae422d0-fb22-43cc-8617-ab141d343b6a', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:53:11 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-40436f50-46e0-4e82-a9da-83338023e787 tempest-VolumesListTestJSON-1365139275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fca86193-65b8-4029-89e1-fb1e7bf43436) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:53:11 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-40436f50-46e0-4e82-a9da-83338023e787 tempest-VolumesListTestJSON-1365139275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fca86193-65b8-4029-89e1-fb1e7bf43436) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:53:11 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-40436f50-46e0-4e82-a9da-83338023e787 tempest-VolumesListTestJSON-1365139275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4adf7e61-a1de-4f85-a647-60b151b7a9a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:53:11 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-40436f50-46e0-4e82-a9da-83338023e787 tempest-VolumesListTestJSON-1365139275 None] Volume aae422d0-fb22-43cc-8617-ab141d343b6a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aae422d0-fb22-43cc-8617-ab141d343b6a', 'volume_size': 1}
Jul 02 19:53:11 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-40436f50-46e0-4e82-a9da-83338023e787 tempest-VolumesListTestJSON-1365139275 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:53:11 devstack sudo[98053]: pam_unix(sudo:session): session closed for user root
Jul 02 19:53:11 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-751d6e91-7c5f-4094-8769-4e7b8772ad82 tempest-VolumesListAdminTestJSON-59337829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-a95c916c-3faa-4d5f-aeac-ff3ed7084dfd" returned: 0 in 1.001s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:53:11 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-751d6e91-7c5f-4094-8769-4e7b8772ad82 tempest-VolumesListAdminTestJSON-59337829 None] Lock "cinder-quobyte-a95c916c-3faa-4d5f-aeac-ff3ed7084dfd" released by "delete_volume" :: held 2.248s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:53:12 devstack cinder-volume[86639]: DEBUG cinder.quota [None req-751d6e91-7c5f-4094-8769-4e7b8772ad82 tempest-VolumesListAdminTestJSON-59337829 None] Created reservations ['65982dd2-5f59-41d0-a8d1-be852d38d9a5', 'a6edee11-e7a4-427e-8f6e-46cf023b36eb', '5b73a18a-f514-4dcd-8119-144b2aaaf41d', 'ae87cf5c-2ac4-4e5a-ae70-bdb0fad39f6a'] {{(pid=86639) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 19:53:12 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-751d6e91-7c5f-4094-8769-4e7b8772ad82 tempest-VolumesListAdminTestJSON-59337829 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:53:12 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-751d6e91-7c5f-4094-8769-4e7b8772ad82 tempest-VolumesListAdminTestJSON-59337829 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:53:12 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-751d6e91-7c5f-4094-8769-4e7b8772ad82 tempest-VolumesListAdminTestJSON-59337829 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 19:53:12 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-751d6e91-7c5f-4094-8769-4e7b8772ad82 tempest-VolumesListAdminTestJSON-59337829 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 19:53:12 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-751d6e91-7c5f-4094-8769-4e7b8772ad82 tempest-VolumesListAdminTestJSON-59337829 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:53:12 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-751d6e91-7c5f-4094-8769-4e7b8772ad82 tempest-VolumesListAdminTestJSON-59337829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:53:12 devstack sudo[98058]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e
Jul 02 19:53:12 devstack sudo[98058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:53:12 devstack sudo[98055]: pam_unix(sudo:session): session closed for user root
Jul 02 19:53:12 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-6844da5c-1479-48f0-aaeb-2cc3f115dc3b tempest-VolumesTestJSON-454859533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-23e753c4-b709-4fa4-9601-aad491300048 1073741824" returned: 0 in 0.987s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:53:12 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-6844da5c-1479-48f0-aaeb-2cc3f115dc3b tempest-VolumesTestJSON-454859533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-23e753c4-b709-4fa4-9601-aad491300048 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:53:12 devstack sudo[98064]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-23e753c4-b709-4fa4-9601-aad491300048
Jul 02 19:53:12 devstack sudo[98064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:53:12 devstack sudo[98058]: pam_unix(sudo:session): session closed for user root
Jul 02 19:53:12 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-751d6e91-7c5f-4094-8769-4e7b8772ad82 tempest-VolumesListAdminTestJSON-59337829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e" returned: 0 in 0.782s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:53:12 devstack cinder-volume[86639]: DEBUG cinder.manager [None req-751d6e91-7c5f-4094-8769-4e7b8772ad82 tempest-VolumesListAdminTestJSON-59337829 None] Notifying Schedulers of capabilities ... {{(pid=86639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 19:53:12 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-751d6e91-7c5f-4094-8769-4e7b8772ad82 tempest-VolumesListAdminTestJSON-59337829 None] Deleted volume successfully.
Jul 02 19:53:12 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-751d6e91-7c5f-4094-8769-4e7b8772ad82 tempest-VolumesListAdminTestJSON-59337829 None] Lock "cinder-a95c916c-3faa-4d5f-aeac-ff3ed7084dfd-delete_volume" released by "delete_volume" :: held 3.317s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:53:13 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-104451cc-cc67-45a9-9dc1-70651846f941 tempest-VolumesListAdminTestJSON-59337829 None] Acquiring lock "cinder-68d301be-8518-4773-a387-2657f4f0e274-delete_volume" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:53:13 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-104451cc-cc67-45a9-9dc1-70651846f941 tempest-VolumesListAdminTestJSON-59337829 None] Lock "cinder-68d301be-8518-4773-a387-2657f4f0e274-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:53:13 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-104451cc-cc67-45a9-9dc1-70651846f941 tempest-VolumesListAdminTestJSON-59337829 None] Acquiring lock "cinder-quobyte-68d301be-8518-4773-a387-2657f4f0e274" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:53:13 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-104451cc-cc67-45a9-9dc1-70651846f941 tempest-VolumesListAdminTestJSON-59337829 None] Lock "cinder-quobyte-68d301be-8518-4773-a387-2657f4f0e274" acquired by "delete_volume" :: waited 0.018s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:53:13 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1277125-97d1-4d64-95ca-ac39728825cf]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 19:53:13 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-104451cc-cc67-45a9-9dc1-70651846f941 tempest-VolumesListAdminTestJSON-59337829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-68d301be-8518-4773-a387-2657f4f0e274 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:53:13 devstack sudo[98067]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-68d301be-8518-4773-a387-2657f4f0e274
Jul 02 19:53:13 devstack sudo[98067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:53:13 devstack sudo[98064]: pam_unix(sudo:session): session closed for user root
Jul 02 19:53:13 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-6844da5c-1479-48f0-aaeb-2cc3f115dc3b tempest-VolumesTestJSON-454859533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-23e753c4-b709-4fa4-9601-aad491300048" returned: 0 in 0.743s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:53:13 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-6844da5c-1479-48f0-aaeb-2cc3f115dc3b tempest-VolumesTestJSON-454859533 None] <== create_volume: return (1796ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'} {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 19:53:13 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-6844da5c-1479-48f0-aaeb-2cc3f115dc3b tempest-VolumesTestJSON-454859533 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.800s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:53:13 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-40436f50-46e0-4e82-a9da-83338023e787 tempest-VolumesListTestJSON-1365139275 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.583s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:53:13 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-40436f50-46e0-4e82-a9da-83338023e787 tempest-VolumesListTestJSON-1365139275 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce906cb830>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T17:53:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-662853809',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aae422d0-fb22-43cc-8617-ab141d343b6a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='eb0c14739d3042c5aabddbc124ac4a40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T17:53:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T17:53:12Z,use_quota=True,user_id='d1fb29a0b9a44f2eb3cc6cc2fdddbf0a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)}" {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 19:53:13 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-40436f50-46e0-4e82-a9da-83338023e787 tempest-VolumesListTestJSON-1365139275 None] Creating volume aae422d0-fb22-43cc-8617-ab141d343b6a {{(pid=86639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 19:53:13 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-40436f50-46e0-4e82-a9da-83338023e787 tempest-VolumesListTestJSON-1365139275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:53:13 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-40436f50-46e0-4e82-a9da-83338023e787 tempest-VolumesListTestJSON-1365139275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:53:13 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-40436f50-46e0-4e82-a9da-83338023e787 tempest-VolumesListTestJSON-1365139275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 19:53:13 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-40436f50-46e0-4e82-a9da-83338023e787 tempest-VolumesListTestJSON-1365139275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 19:53:13 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-40436f50-46e0-4e82-a9da-83338023e787 tempest-VolumesListTestJSON-1365139275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:53:13 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-40436f50-46e0-4e82-a9da-83338023e787 tempest-VolumesListTestJSON-1365139275 None] Selected osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92 as target Quobyte volume. {{(pid=86639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 19:53:13 devstack cinder-volume[86639]: INFO cinder.volume.drivers.remotefs [None req-40436f50-46e0-4e82-a9da-83338023e787 tempest-VolumesListTestJSON-1365139275 None] casted to osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92
Jul 02 19:53:13 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-40436f50-46e0-4e82-a9da-83338023e787 tempest-VolumesListTestJSON-1365139275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-aae422d0-fb22-43cc-8617-ab141d343b6a 1073741824 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:53:13 devstack sudo[98071]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-aae422d0-fb22-43cc-8617-ab141d343b6a 1073741824
Jul 02 19:53:13 devstack sudo[98071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:53:13 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-6844da5c-1479-48f0-aaeb-2cc3f115dc3b tempest-VolumesTestJSON-454859533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcb0e237-0d2a-43ab-bfab-bee68486f49c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23e753c4-b709-4fa4-9601-aad491300048', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:53:13 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-6844da5c-1479-48f0-aaeb-2cc3f115dc3b tempest-VolumesTestJSON-454859533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e9f8ad9-274e-4473-a805-42b9d4877d6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:53:13 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-6844da5c-1479-48f0-aaeb-2cc3f115dc3b tempest-VolumesTestJSON-454859533 None] Volume volume-23e753c4-b709-4fa4-9601-aad491300048 (23e753c4-b709-4fa4-9601-aad491300048): created successfully
Jul 02 19:53:13 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-6844da5c-1479-48f0-aaeb-2cc3f115dc3b tempest-VolumesTestJSON-454859533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e9f8ad9-274e-4473-a805-42b9d4877d6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:53:13 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-6844da5c-1479-48f0-aaeb-2cc3f115dc3b tempest-VolumesTestJSON-454859533 None] Flow 'volume_create_manager' (d07b291c-4efb-4e07-9ea5-eee4891652d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 19:53:13 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-6844da5c-1479-48f0-aaeb-2cc3f115dc3b tempest-VolumesTestJSON-454859533 None] Created volume successfully.
Jul 02 19:53:14 devstack sudo[98067]: pam_unix(sudo:session): session closed for user root
Jul 02 19:53:14 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-104451cc-cc67-45a9-9dc1-70651846f941 tempest-VolumesListAdminTestJSON-59337829 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-68d301be-8518-4773-a387-2657f4f0e274" returned: 0 in 0.851s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:53:14 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-104451cc-cc67-45a9-9dc1-70651846f941 tempest-VolumesListAdminTestJSON-59337829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-68d301be-8518-4773-a387-2657f4f0e274 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:53:14 devstack sudo[98076]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-68d301be-8518-4773-a387-2657f4f0e274
Jul 02 19:53:14 devstack sudo[98076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:53:14 devstack sudo[98071]: pam_unix(sudo:session): session closed for user root
Jul 02 19:53:14 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-40436f50-46e0-4e82-a9da-83338023e787 tempest-VolumesListTestJSON-1365139275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-aae422d0-fb22-43cc-8617-ab141d343b6a 1073741824" returned: 0 in 1.244s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:53:14 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-40436f50-46e0-4e82-a9da-83338023e787 tempest-VolumesListTestJSON-1365139275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-aae422d0-fb22-43cc-8617-ab141d343b6a {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:53:14 devstack sudo[98083]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-aae422d0-fb22-43cc-8617-ab141d343b6a
Jul 02 19:53:14 devstack sudo[98083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:53:14 devstack sudo[98076]: pam_unix(sudo:session): session closed for user root
Jul 02 19:53:14 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-104451cc-cc67-45a9-9dc1-70651846f941 tempest-VolumesListAdminTestJSON-59337829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-68d301be-8518-4773-a387-2657f4f0e274" returned: 0 in 0.911s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:53:14 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-104451cc-cc67-45a9-9dc1-70651846f941 tempest-VolumesListAdminTestJSON-59337829 None] Lock "cinder-quobyte-68d301be-8518-4773-a387-2657f4f0e274" released by "delete_volume" :: held 1.828s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:53:15 devstack cinder-volume[86639]: DEBUG cinder.quota [None req-104451cc-cc67-45a9-9dc1-70651846f941 tempest-VolumesListAdminTestJSON-59337829 None] Created reservations ['94f58690-0f48-43d2-80a8-d4f4bb46eb79', 'd8c25633-c8b4-4394-8779-c96c42fbae3b', '1b738f2a-74a9-4568-9c72-7380d766e7bb', '1a3d4260-064d-4d17-ac42-45fb68f20a76'] {{(pid=86639) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 19:53:15 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-104451cc-cc67-45a9-9dc1-70651846f941 tempest-VolumesListAdminTestJSON-59337829 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:53:15 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-104451cc-cc67-45a9-9dc1-70651846f941 tempest-VolumesListAdminTestJSON-59337829 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:53:15 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-104451cc-cc67-45a9-9dc1-70651846f941 tempest-VolumesListAdminTestJSON-59337829 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 19:53:15 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-104451cc-cc67-45a9-9dc1-70651846f941 tempest-VolumesListAdminTestJSON-59337829 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 19:53:15 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-104451cc-cc67-45a9-9dc1-70651846f941 tempest-VolumesListAdminTestJSON-59337829 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:53:15 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-104451cc-cc67-45a9-9dc1-70651846f941 tempest-VolumesListAdminTestJSON-59337829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:53:15 devstack sudo[98085]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e
Jul 02 19:53:15 devstack sudo[98085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:53:15 devstack cinder-volume[86639]: DEBUG cinder.volume.flows.manager.create_volume [None req-aea9f6c2-b018-4447-b957-6b2dbb21c4b2 tempest-VolumesTestJSON-454859533 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 19:53:15 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-aea9f6c2-b018-4447-b957-6b2dbb21c4b2 tempest-VolumesTestJSON-454859533 None] Flow 'volume_create_manager' (c2fe1330-4438-4876-9d79-1883604d4e68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 19:53:15 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-aea9f6c2-b018-4447-b957-6b2dbb21c4b2 tempest-VolumesTestJSON-454859533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2162d74-8d33-47b6-8913-21a776b9b042) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:53:15 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-aea9f6c2-b018-4447-b957-6b2dbb21c4b2 tempest-VolumesTestJSON-454859533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2162d74-8d33-47b6-8913-21a776b9b042) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T17:53:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1760802036',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36d6f817-73dd-42eb-be3d-ffa5926ab5a1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3bb46a828a9a4cf8879f77e380257fb3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T17:53:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T17:53:15Z,use_quota=True,user_id='ff779e43583548959e4a79b18a2dd237',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:53:15 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-aea9f6c2-b018-4447-b957-6b2dbb21c4b2 tempest-VolumesTestJSON-454859533 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5719c225-1953-4957-8ec1-bd2de44fb631) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:53:15 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-aea9f6c2-b018-4447-b957-6b2dbb21c4b2 tempest-VolumesTestJSON-454859533 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5719c225-1953-4957-8ec1-bd2de44fb631) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:53:15 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-aea9f6c2-b018-4447-b957-6b2dbb21c4b2 tempest-VolumesTestJSON-454859533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55fabb75-6215-46d8-a799-7d4270cd88c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:53:15 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-aea9f6c2-b018-4447-b957-6b2dbb21c4b2 tempest-VolumesTestJSON-454859533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55fabb75-6215-46d8-a799-7d4270cd88c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36d6f817-73dd-42eb-be3d-ffa5926ab5a1', 'volume_name': 'volume-36d6f817-73dd-42eb-be3d-ffa5926ab5a1', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:53:15 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-aea9f6c2-b018-4447-b957-6b2dbb21c4b2 tempest-VolumesTestJSON-454859533 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e69605d1-fca5-437b-b176-909b15cad366) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:53:15 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-aea9f6c2-b018-4447-b957-6b2dbb21c4b2 tempest-VolumesTestJSON-454859533 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e69605d1-fca5-437b-b176-909b15cad366) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:53:15 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-aea9f6c2-b018-4447-b957-6b2dbb21c4b2 tempest-VolumesTestJSON-454859533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ef9280b-649a-4387-891d-43e3261d188b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:53:15 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-aea9f6c2-b018-4447-b957-6b2dbb21c4b2 tempest-VolumesTestJSON-454859533 None] Volume 36d6f817-73dd-42eb-be3d-ffa5926ab5a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36d6f817-73dd-42eb-be3d-ffa5926ab5a1', 'volume_size': 1}
Jul 02 19:53:15 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-aea9f6c2-b018-4447-b957-6b2dbb21c4b2 tempest-VolumesTestJSON-454859533 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:53:15 devstack sudo[98083]: pam_unix(sudo:session): session closed for user root
Jul 02 19:53:15 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-40436f50-46e0-4e82-a9da-83338023e787 tempest-VolumesListTestJSON-1365139275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-aae422d0-fb22-43cc-8617-ab141d343b6a" returned: 0 in 1.030s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:53:15 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-40436f50-46e0-4e82-a9da-83338023e787 tempest-VolumesListTestJSON-1365139275 None] <== create_volume: return (2347ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'} {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 19:53:15 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-40436f50-46e0-4e82-a9da-83338023e787 tempest-VolumesListTestJSON-1365139275 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.352s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:53:15 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-aea9f6c2-b018-4447-b957-6b2dbb21c4b2 tempest-VolumesTestJSON-454859533 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.409s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:53:15 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-aea9f6c2-b018-4447-b957-6b2dbb21c4b2 tempest-VolumesTestJSON-454859533 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce906cb830>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T17:53:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1760802036',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36d6f817-73dd-42eb-be3d-ffa5926ab5a1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3bb46a828a9a4cf8879f77e380257fb3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T17:53:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T17:53:15Z,use_quota=True,user_id='ff779e43583548959e4a79b18a2dd237',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)}" {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 19:53:15 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-aea9f6c2-b018-4447-b957-6b2dbb21c4b2 tempest-VolumesTestJSON-454859533 None] Creating volume 36d6f817-73dd-42eb-be3d-ffa5926ab5a1 {{(pid=86639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 19:53:15 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-aea9f6c2-b018-4447-b957-6b2dbb21c4b2 tempest-VolumesTestJSON-454859533 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:53:15 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-aea9f6c2-b018-4447-b957-6b2dbb21c4b2 tempest-VolumesTestJSON-454859533 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:53:15 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-aea9f6c2-b018-4447-b957-6b2dbb21c4b2 tempest-VolumesTestJSON-454859533 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 19:53:15 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-aea9f6c2-b018-4447-b957-6b2dbb21c4b2 tempest-VolumesTestJSON-454859533 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 19:53:15 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-aea9f6c2-b018-4447-b957-6b2dbb21c4b2 tempest-VolumesTestJSON-454859533 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:53:15 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-aea9f6c2-b018-4447-b957-6b2dbb21c4b2 tempest-VolumesTestJSON-454859533 None] Selected osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92 as target Quobyte volume. {{(pid=86639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 19:53:15 devstack cinder-volume[86639]: INFO cinder.volume.drivers.remotefs [None req-aea9f6c2-b018-4447-b957-6b2dbb21c4b2 tempest-VolumesTestJSON-454859533 None] casted to osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92
Jul 02 19:53:15 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-aea9f6c2-b018-4447-b957-6b2dbb21c4b2 tempest-VolumesTestJSON-454859533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-36d6f817-73dd-42eb-be3d-ffa5926ab5a1 1073741824 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:53:15 devstack sudo[98089]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-36d6f817-73dd-42eb-be3d-ffa5926ab5a1 1073741824
Jul 02 19:53:15 devstack sudo[98089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:53:15 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-40436f50-46e0-4e82-a9da-83338023e787 tempest-VolumesListTestJSON-1365139275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4adf7e61-a1de-4f85-a647-60b151b7a9a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aae422d0-fb22-43cc-8617-ab141d343b6a', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:53:15 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-40436f50-46e0-4e82-a9da-83338023e787 tempest-VolumesListTestJSON-1365139275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e39e43e-d5be-4f1b-948c-3573f1009458) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:53:15 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-40436f50-46e0-4e82-a9da-83338023e787 tempest-VolumesListTestJSON-1365139275 None] Volume volume-aae422d0-fb22-43cc-8617-ab141d343b6a (aae422d0-fb22-43cc-8617-ab141d343b6a): created successfully
Jul 02 19:53:15 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-40436f50-46e0-4e82-a9da-83338023e787 tempest-VolumesListTestJSON-1365139275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e39e43e-d5be-4f1b-948c-3573f1009458) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:53:15 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-40436f50-46e0-4e82-a9da-83338023e787 tempest-VolumesListTestJSON-1365139275 None] Flow 'volume_create_manager' (128e0c62-cd25-4fea-845b-856666f3280b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 19:53:15 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-40436f50-46e0-4e82-a9da-83338023e787 tempest-VolumesListTestJSON-1365139275 None] Created volume successfully.
Jul 02 19:53:16 devstack sudo[98085]: pam_unix(sudo:session): session closed for user root
Jul 02 19:53:16 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-104451cc-cc67-45a9-9dc1-70651846f941 tempest-VolumesListAdminTestJSON-59337829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e" returned: 0 in 0.933s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:53:16 devstack cinder-volume[86639]: DEBUG cinder.manager [None req-104451cc-cc67-45a9-9dc1-70651846f941 tempest-VolumesListAdminTestJSON-59337829 None] Notifying Schedulers of capabilities ... {{(pid=86639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 19:53:16 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-104451cc-cc67-45a9-9dc1-70651846f941 tempest-VolumesListAdminTestJSON-59337829 None] Deleted volume successfully.
Jul 02 19:53:16 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-104451cc-cc67-45a9-9dc1-70651846f941 tempest-VolumesListAdminTestJSON-59337829 None] Lock "cinder-68d301be-8518-4773-a387-2657f4f0e274-delete_volume" released by "delete_volume" :: held 3.098s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:53:17 devstack sudo[98089]: pam_unix(sudo:session): session closed for user root
Jul 02 19:53:17 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-aea9f6c2-b018-4447-b957-6b2dbb21c4b2 tempest-VolumesTestJSON-454859533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-36d6f817-73dd-42eb-be3d-ffa5926ab5a1 1073741824" returned: 0 in 1.159s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:53:17 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-aea9f6c2-b018-4447-b957-6b2dbb21c4b2 tempest-VolumesTestJSON-454859533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-36d6f817-73dd-42eb-be3d-ffa5926ab5a1 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:53:17 devstack sudo[98096]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-36d6f817-73dd-42eb-be3d-ffa5926ab5a1
Jul 02 19:53:17 devstack sudo[98096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:53:17 devstack cinder-volume[86639]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf755948-d3db-43c7-a8d6-f0d971205cc6 tempest-VolumesListTestJSON-1365139275 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 19:53:18 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-bf755948-d3db-43c7-a8d6-f0d971205cc6 tempest-VolumesListTestJSON-1365139275 None] Flow 'volume_create_manager' (a187ccf7-af0a-4ace-a9aa-d8e4c267f960) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 19:53:18 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-bf755948-d3db-43c7-a8d6-f0d971205cc6 tempest-VolumesListTestJSON-1365139275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d15f13e7-415b-4f89-81c0-cf8b46f779c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:53:18 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-bf755948-d3db-43c7-a8d6-f0d971205cc6 tempest-VolumesListTestJSON-1365139275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d15f13e7-415b-4f89-81c0-cf8b46f779c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T17:53:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-642975277',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=823f8a5c-188d-46d3-802d-f7584a13663c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='eb0c14739d3042c5aabddbc124ac4a40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T17:53:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T17:53:18Z,use_quota=True,user_id='d1fb29a0b9a44f2eb3cc6cc2fdddbf0a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:53:18 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-bf755948-d3db-43c7-a8d6-f0d971205cc6 tempest-VolumesListTestJSON-1365139275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3ab21a2-f9e2-4763-9cee-7e346050de95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:53:18 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-bf755948-d3db-43c7-a8d6-f0d971205cc6 tempest-VolumesListTestJSON-1365139275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3ab21a2-f9e2-4763-9cee-7e346050de95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:53:18 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-bf755948-d3db-43c7-a8d6-f0d971205cc6 tempest-VolumesListTestJSON-1365139275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5b10fce-b726-426e-a379-b066248187ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:53:18 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-bf755948-d3db-43c7-a8d6-f0d971205cc6 tempest-VolumesListTestJSON-1365139275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5b10fce-b726-426e-a379-b066248187ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '823f8a5c-188d-46d3-802d-f7584a13663c', 'volume_name': 'volume-823f8a5c-188d-46d3-802d-f7584a13663c', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:53:18 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-bf755948-d3db-43c7-a8d6-f0d971205cc6 tempest-VolumesListTestJSON-1365139275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (985176ec-3c96-4a78-9f26-396300ad99e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:53:18 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-bf755948-d3db-43c7-a8d6-f0d971205cc6 tempest-VolumesListTestJSON-1365139275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (985176ec-3c96-4a78-9f26-396300ad99e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:53:18 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-bf755948-d3db-43c7-a8d6-f0d971205cc6 tempest-VolumesListTestJSON-1365139275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0be4c9ae-eca9-49e4-9f1a-69ba809dcb1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:53:18 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-bf755948-d3db-43c7-a8d6-f0d971205cc6 tempest-VolumesListTestJSON-1365139275 None] Volume 823f8a5c-188d-46d3-802d-f7584a13663c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-823f8a5c-188d-46d3-802d-f7584a13663c', 'volume_size': 1}
Jul 02 19:53:18 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-bf755948-d3db-43c7-a8d6-f0d971205cc6 tempest-VolumesListTestJSON-1365139275 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:53:18 devstack sudo[98096]: pam_unix(sudo:session): session closed for user root
Jul 02 19:53:18 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-aea9f6c2-b018-4447-b957-6b2dbb21c4b2 tempest-VolumesTestJSON-454859533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-36d6f817-73dd-42eb-be3d-ffa5926ab5a1" returned: 0 in 1.052s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:53:18 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-aea9f6c2-b018-4447-b957-6b2dbb21c4b2 tempest-VolumesTestJSON-454859533 None] <== create_volume: return (2267ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'} {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 19:53:18 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-aea9f6c2-b018-4447-b957-6b2dbb21c4b2 tempest-VolumesTestJSON-454859533 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.272s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:53:18 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-bf755948-d3db-43c7-a8d6-f0d971205cc6 tempest-VolumesListTestJSON-1365139275 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.049s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:53:18 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-bf755948-d3db-43c7-a8d6-f0d971205cc6 tempest-VolumesListTestJSON-1365139275 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce906cb830>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T17:53:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-642975277',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=823f8a5c-188d-46d3-802d-f7584a13663c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='eb0c14739d3042c5aabddbc124ac4a40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T17:53:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T17:53:18Z,use_quota=True,user_id='d1fb29a0b9a44f2eb3cc6cc2fdddbf0a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)}" {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 19:53:18 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-bf755948-d3db-43c7-a8d6-f0d971205cc6 tempest-VolumesListTestJSON-1365139275 None] Creating volume 823f8a5c-188d-46d3-802d-f7584a13663c {{(pid=86639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 19:53:18 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-bf755948-d3db-43c7-a8d6-f0d971205cc6 tempest-VolumesListTestJSON-1365139275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:53:18 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-bf755948-d3db-43c7-a8d6-f0d971205cc6 tempest-VolumesListTestJSON-1365139275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:53:18 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-bf755948-d3db-43c7-a8d6-f0d971205cc6 tempest-VolumesListTestJSON-1365139275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 19:53:18 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-bf755948-d3db-43c7-a8d6-f0d971205cc6 tempest-VolumesListTestJSON-1365139275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 19:53:18 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-bf755948-d3db-43c7-a8d6-f0d971205cc6 tempest-VolumesListTestJSON-1365139275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:53:18 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-bf755948-d3db-43c7-a8d6-f0d971205cc6 tempest-VolumesListTestJSON-1365139275 None] Selected osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92 as target Quobyte volume. {{(pid=86639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 19:53:18 devstack cinder-volume[86639]: INFO cinder.volume.drivers.remotefs [None req-bf755948-d3db-43c7-a8d6-f0d971205cc6 tempest-VolumesListTestJSON-1365139275 None] casted to osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92
Jul 02 19:53:18 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-bf755948-d3db-43c7-a8d6-f0d971205cc6 tempest-VolumesListTestJSON-1365139275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-823f8a5c-188d-46d3-802d-f7584a13663c 1073741824 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:53:18 devstack sudo[98100]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-823f8a5c-188d-46d3-802d-f7584a13663c 1073741824
Jul 02 19:53:18 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-aea9f6c2-b018-4447-b957-6b2dbb21c4b2 tempest-VolumesTestJSON-454859533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ef9280b-649a-4387-891d-43e3261d188b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36d6f817-73dd-42eb-be3d-ffa5926ab5a1', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:53:18 devstack sudo[98100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:53:18 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-aea9f6c2-b018-4447-b957-6b2dbb21c4b2 tempest-VolumesTestJSON-454859533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66687aed-8b00-40ff-81af-444626d7adb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:53:18 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-aea9f6c2-b018-4447-b957-6b2dbb21c4b2 tempest-VolumesTestJSON-454859533 None] Volume volume-36d6f817-73dd-42eb-be3d-ffa5926ab5a1 (36d6f817-73dd-42eb-be3d-ffa5926ab5a1): created successfully
Jul 02 19:53:18 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-aea9f6c2-b018-4447-b957-6b2dbb21c4b2 tempest-VolumesTestJSON-454859533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66687aed-8b00-40ff-81af-444626d7adb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:53:18 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-aea9f6c2-b018-4447-b957-6b2dbb21c4b2 tempest-VolumesTestJSON-454859533 None] Flow 'volume_create_manager' (c2fe1330-4438-4876-9d79-1883604d4e68) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 19:53:18 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-aea9f6c2-b018-4447-b957-6b2dbb21c4b2 tempest-VolumesTestJSON-454859533 None] Created volume successfully.
Jul 02 19:53:19 devstack cinder-volume[86639]: DEBUG dbcounter [-] [86639] Writing DB stats cinder:UPDATE=150,cinder:INSERT=33,cinder:SELECT=107,cinder:DELETE=13 {{(pid=86639) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 02 19:53:19 devstack cinder-volume[86639]: DEBUG dbcounter [-] [86639] Writing DB stats cinder:UPDATE=160,cinder:SELECT=113,cinder:DELETE=14,cinder:INSERT=49 {{(pid=86639) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 02 19:53:19 devstack cinder-volume[86639]: DEBUG cinder.volume.flows.manager.create_volume [None req-78130e58-cc1c-422b-9329-fc20d3f5cd33 tempest-VolumesTestJSON-454859533 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 19:53:19 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-78130e58-cc1c-422b-9329-fc20d3f5cd33 tempest-VolumesTestJSON-454859533 None] Flow 'volume_create_manager' (c87ea177-4a3a-4861-b663-0f8527c447e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 19:53:19 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-78130e58-cc1c-422b-9329-fc20d3f5cd33 tempest-VolumesTestJSON-454859533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (682d8c97-a03a-44e6-882a-9591782e40e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:53:19 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-78130e58-cc1c-422b-9329-fc20d3f5cd33 tempest-VolumesTestJSON-454859533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (682d8c97-a03a-44e6-882a-9591782e40e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T17:53:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-531666792',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=678ed91f-1ebb-4a59-9259-eda79babd79f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3bb46a828a9a4cf8879f77e380257fb3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T17:53:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T17:53:19Z,use_quota=True,user_id='ff779e43583548959e4a79b18a2dd237',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:53:19 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-78130e58-cc1c-422b-9329-fc20d3f5cd33 tempest-VolumesTestJSON-454859533 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fb7225d-0812-4b54-9d55-2c665a2d5a8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:53:19 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-78130e58-cc1c-422b-9329-fc20d3f5cd33 tempest-VolumesTestJSON-454859533 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fb7225d-0812-4b54-9d55-2c665a2d5a8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:53:19 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-78130e58-cc1c-422b-9329-fc20d3f5cd33 tempest-VolumesTestJSON-454859533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68c593b6-6a40-4253-a543-b4bd5a9cc799) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:53:19 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-78130e58-cc1c-422b-9329-fc20d3f5cd33 tempest-VolumesTestJSON-454859533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68c593b6-6a40-4253-a543-b4bd5a9cc799) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '678ed91f-1ebb-4a59-9259-eda79babd79f', 'volume_name': 'volume-678ed91f-1ebb-4a59-9259-eda79babd79f', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:53:19 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-78130e58-cc1c-422b-9329-fc20d3f5cd33 tempest-VolumesTestJSON-454859533 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5e55d10-184a-4bd3-9cd6-36660ec17f0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:53:19 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-78130e58-cc1c-422b-9329-fc20d3f5cd33 tempest-VolumesTestJSON-454859533 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5e55d10-184a-4bd3-9cd6-36660ec17f0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:53:19 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-78130e58-cc1c-422b-9329-fc20d3f5cd33 tempest-VolumesTestJSON-454859533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7dfd107f-d560-4c9c-9419-b794e3373fba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:53:19 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-78130e58-cc1c-422b-9329-fc20d3f5cd33 tempest-VolumesTestJSON-454859533 None] Volume 678ed91f-1ebb-4a59-9259-eda79babd79f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-678ed91f-1ebb-4a59-9259-eda79babd79f', 'volume_size': 1}
Jul 02 19:53:19 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-78130e58-cc1c-422b-9329-fc20d3f5cd33 tempest-VolumesTestJSON-454859533 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:53:19 devstack sudo[98100]: pam_unix(sudo:session): session closed for user root
Jul 02 19:53:19 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-bf755948-d3db-43c7-a8d6-f0d971205cc6 tempest-VolumesListTestJSON-1365139275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-823f8a5c-188d-46d3-802d-f7584a13663c 1073741824" returned: 0 in 1.568s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:53:19 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-bf755948-d3db-43c7-a8d6-f0d971205cc6 tempest-VolumesListTestJSON-1365139275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-823f8a5c-188d-46d3-802d-f7584a13663c {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:53:19 devstack sudo[98106]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-823f8a5c-188d-46d3-802d-f7584a13663c
Jul 02 19:53:19 devstack sudo[98106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:53:20 devstack sudo[98106]: pam_unix(sudo:session): session closed for user root
Jul 02 19:53:20 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-bf755948-d3db-43c7-a8d6-f0d971205cc6 tempest-VolumesListTestJSON-1365139275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-823f8a5c-188d-46d3-802d-f7584a13663c" returned: 0 in 0.854s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:53:20 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-bf755948-d3db-43c7-a8d6-f0d971205cc6 tempest-VolumesListTestJSON-1365139275 None] <== create_volume: return (2475ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'} {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 19:53:20 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-bf755948-d3db-43c7-a8d6-f0d971205cc6 tempest-VolumesListTestJSON-1365139275 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.479s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:53:20 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-78130e58-cc1c-422b-9329-fc20d3f5cd33 tempest-VolumesTestJSON-454859533 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.065s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:53:20 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-78130e58-cc1c-422b-9329-fc20d3f5cd33 tempest-VolumesTestJSON-454859533 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce906cb830>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T17:53:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-531666792',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=678ed91f-1ebb-4a59-9259-eda79babd79f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3bb46a828a9a4cf8879f77e380257fb3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T17:53:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T17:53:19Z,use_quota=True,user_id='ff779e43583548959e4a79b18a2dd237',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)}" {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 19:53:20 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-78130e58-cc1c-422b-9329-fc20d3f5cd33 tempest-VolumesTestJSON-454859533 None] Creating volume 678ed91f-1ebb-4a59-9259-eda79babd79f {{(pid=86639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 19:53:20 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-78130e58-cc1c-422b-9329-fc20d3f5cd33 tempest-VolumesTestJSON-454859533 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:53:20 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-78130e58-cc1c-422b-9329-fc20d3f5cd33 tempest-VolumesTestJSON-454859533 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:53:20 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-78130e58-cc1c-422b-9329-fc20d3f5cd33 tempest-VolumesTestJSON-454859533 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 19:53:20 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-78130e58-cc1c-422b-9329-fc20d3f5cd33 tempest-VolumesTestJSON-454859533 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 19:53:20 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-78130e58-cc1c-422b-9329-fc20d3f5cd33 tempest-VolumesTestJSON-454859533 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:53:20 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-78130e58-cc1c-422b-9329-fc20d3f5cd33 tempest-VolumesTestJSON-454859533 None] Selected osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92 as target Quobyte volume. {{(pid=86639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 19:53:20 devstack cinder-volume[86639]: INFO cinder.volume.drivers.remotefs [None req-78130e58-cc1c-422b-9329-fc20d3f5cd33 tempest-VolumesTestJSON-454859533 None] casted to osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92
Jul 02 19:53:20 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-78130e58-cc1c-422b-9329-fc20d3f5cd33 tempest-VolumesTestJSON-454859533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-678ed91f-1ebb-4a59-9259-eda79babd79f 1073741824 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:53:20 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-bf755948-d3db-43c7-a8d6-f0d971205cc6 tempest-VolumesListTestJSON-1365139275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0be4c9ae-eca9-49e4-9f1a-69ba809dcb1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-823f8a5c-188d-46d3-802d-f7584a13663c', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:53:20 devstack sudo[98110]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-678ed91f-1ebb-4a59-9259-eda79babd79f 1073741824
Jul 02 19:53:20 devstack sudo[98110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:53:20 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-bf755948-d3db-43c7-a8d6-f0d971205cc6 tempest-VolumesListTestJSON-1365139275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a9f3e12-0d4e-4822-b267-0a14bb9f4425) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:53:20 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-bf755948-d3db-43c7-a8d6-f0d971205cc6 tempest-VolumesListTestJSON-1365139275 None] Volume volume-823f8a5c-188d-46d3-802d-f7584a13663c (823f8a5c-188d-46d3-802d-f7584a13663c): created successfully
Jul 02 19:53:20 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-bf755948-d3db-43c7-a8d6-f0d971205cc6 tempest-VolumesListTestJSON-1365139275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a9f3e12-0d4e-4822-b267-0a14bb9f4425) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:53:20 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-bf755948-d3db-43c7-a8d6-f0d971205cc6 tempest-VolumesListTestJSON-1365139275 None] Flow 'volume_create_manager' (a187ccf7-af0a-4ace-a9aa-d8e4c267f960) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 19:53:20 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-bf755948-d3db-43c7-a8d6-f0d971205cc6 tempest-VolumesListTestJSON-1365139275 None] Created volume successfully.
Jul 02 19:53:21 devstack cinder-volume[86639]: DEBUG cinder.volume.flows.manager.create_volume [None req-782671ce-adf3-4d5c-830c-64e780cc9b74 tempest-VolumesListTestJSON-1365139275 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 19:53:21 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-782671ce-adf3-4d5c-830c-64e780cc9b74 tempest-VolumesListTestJSON-1365139275 None] Flow 'volume_create_manager' (80cf0171-5fc2-4abf-8b15-4f4a9dd72ad6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 19:53:21 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-782671ce-adf3-4d5c-830c-64e780cc9b74 tempest-VolumesListTestJSON-1365139275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da8fba2a-07b3-4bb4-a101-4decc0ed4740) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:53:21 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-782671ce-adf3-4d5c-830c-64e780cc9b74 tempest-VolumesListTestJSON-1365139275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da8fba2a-07b3-4bb4-a101-4decc0ed4740) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T17:53:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-537680551',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1018e869-7cec-44e7-97b6-4a0aab1f5eea,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='eb0c14739d3042c5aabddbc124ac4a40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T17:53:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T17:53:22Z,use_quota=True,user_id='d1fb29a0b9a44f2eb3cc6cc2fdddbf0a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:53:21 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-782671ce-adf3-4d5c-830c-64e780cc9b74 tempest-VolumesListTestJSON-1365139275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (791460e4-1780-4c2a-88d9-db48aa4a2a94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:53:21 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-782671ce-adf3-4d5c-830c-64e780cc9b74 tempest-VolumesListTestJSON-1365139275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (791460e4-1780-4c2a-88d9-db48aa4a2a94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:53:21 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-782671ce-adf3-4d5c-830c-64e780cc9b74 tempest-VolumesListTestJSON-1365139275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a8659c3-3c18-4c45-97aa-7b5267d94caa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:53:21 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-782671ce-adf3-4d5c-830c-64e780cc9b74 tempest-VolumesListTestJSON-1365139275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a8659c3-3c18-4c45-97aa-7b5267d94caa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1018e869-7cec-44e7-97b6-4a0aab1f5eea', 'volume_name': 'volume-1018e869-7cec-44e7-97b6-4a0aab1f5eea', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:53:21 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-782671ce-adf3-4d5c-830c-64e780cc9b74 tempest-VolumesListTestJSON-1365139275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41440c75-7b59-48ff-9850-be802f190bd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:53:21 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-782671ce-adf3-4d5c-830c-64e780cc9b74 tempest-VolumesListTestJSON-1365139275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41440c75-7b59-48ff-9850-be802f190bd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:53:21 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-782671ce-adf3-4d5c-830c-64e780cc9b74 tempest-VolumesListTestJSON-1365139275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5513a162-0be4-47b7-b078-d76f9213b2da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:53:21 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-782671ce-adf3-4d5c-830c-64e780cc9b74 tempest-VolumesListTestJSON-1365139275 None] Volume 1018e869-7cec-44e7-97b6-4a0aab1f5eea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1018e869-7cec-44e7-97b6-4a0aab1f5eea', 'volume_size': 1}
Jul 02 19:53:21 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-782671ce-adf3-4d5c-830c-64e780cc9b74 tempest-VolumesListTestJSON-1365139275 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:53:21 devstack sudo[98110]: pam_unix(sudo:session): session closed for user root
Jul 02 19:53:21 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-78130e58-cc1c-422b-9329-fc20d3f5cd33 tempest-VolumesTestJSON-454859533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-678ed91f-1ebb-4a59-9259-eda79babd79f 1073741824" returned: 0 in 1.340s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:53:22 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-78130e58-cc1c-422b-9329-fc20d3f5cd33 tempest-VolumesTestJSON-454859533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-678ed91f-1ebb-4a59-9259-eda79babd79f {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:53:22 devstack sudo[98117]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-678ed91f-1ebb-4a59-9259-eda79babd79f
Jul 02 19:53:22 devstack sudo[98117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:53:22 devstack sudo[98117]: pam_unix(sudo:session): session closed for user root
Jul 02 19:53:22 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-78130e58-cc1c-422b-9329-fc20d3f5cd33 tempest-VolumesTestJSON-454859533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-678ed91f-1ebb-4a59-9259-eda79babd79f" returned: 0 in 0.812s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:53:22 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-78130e58-cc1c-422b-9329-fc20d3f5cd33 tempest-VolumesTestJSON-454859533 None] <== create_volume: return (2194ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'} {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 19:53:22 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-78130e58-cc1c-422b-9329-fc20d3f5cd33 tempest-VolumesTestJSON-454859533 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.196s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:53:22 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-782671ce-adf3-4d5c-830c-64e780cc9b74 tempest-VolumesListTestJSON-1365139275 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.870s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:53:22 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-782671ce-adf3-4d5c-830c-64e780cc9b74 tempest-VolumesListTestJSON-1365139275 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce906cb830>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T17:53:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-537680551',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1018e869-7cec-44e7-97b6-4a0aab1f5eea,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='eb0c14739d3042c5aabddbc124ac4a40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T17:53:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T17:53:22Z,use_quota=True,user_id='d1fb29a0b9a44f2eb3cc6cc2fdddbf0a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)}" {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 19:53:22 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-782671ce-adf3-4d5c-830c-64e780cc9b74 tempest-VolumesListTestJSON-1365139275 None] Creating volume 1018e869-7cec-44e7-97b6-4a0aab1f5eea {{(pid=86639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 19:53:22 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-782671ce-adf3-4d5c-830c-64e780cc9b74 tempest-VolumesListTestJSON-1365139275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:53:22 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-782671ce-adf3-4d5c-830c-64e780cc9b74 tempest-VolumesListTestJSON-1365139275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:53:22 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-782671ce-adf3-4d5c-830c-64e780cc9b74 tempest-VolumesListTestJSON-1365139275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 19:53:22 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-782671ce-adf3-4d5c-830c-64e780cc9b74 tempest-VolumesListTestJSON-1365139275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 19:53:22 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-782671ce-adf3-4d5c-830c-64e780cc9b74 tempest-VolumesListTestJSON-1365139275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:53:22 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-782671ce-adf3-4d5c-830c-64e780cc9b74 tempest-VolumesListTestJSON-1365139275 None] Selected osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92 as target Quobyte volume. {{(pid=86639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 19:53:22 devstack cinder-volume[86639]: INFO cinder.volume.drivers.remotefs [None req-782671ce-adf3-4d5c-830c-64e780cc9b74 tempest-VolumesListTestJSON-1365139275 None] casted to osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92
Jul 02 19:53:22 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-782671ce-adf3-4d5c-830c-64e780cc9b74 tempest-VolumesListTestJSON-1365139275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-1018e869-7cec-44e7-97b6-4a0aab1f5eea 1073741824 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:53:22 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-78130e58-cc1c-422b-9329-fc20d3f5cd33 tempest-VolumesTestJSON-454859533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7dfd107f-d560-4c9c-9419-b794e3373fba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-678ed91f-1ebb-4a59-9259-eda79babd79f', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:53:22 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-78130e58-cc1c-422b-9329-fc20d3f5cd33 tempest-VolumesTestJSON-454859533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bff4b4d-415d-4ccc-842c-03c920269317) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:53:22 devstack sudo[98120]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-1018e869-7cec-44e7-97b6-4a0aab1f5eea 1073741824
Jul 02 19:53:22 devstack sudo[98120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:53:22 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-78130e58-cc1c-422b-9329-fc20d3f5cd33 tempest-VolumesTestJSON-454859533 None] Volume volume-678ed91f-1ebb-4a59-9259-eda79babd79f (678ed91f-1ebb-4a59-9259-eda79babd79f): created successfully
Jul 02 19:53:22 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-78130e58-cc1c-422b-9329-fc20d3f5cd33 tempest-VolumesTestJSON-454859533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bff4b4d-415d-4ccc-842c-03c920269317) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:53:22 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-78130e58-cc1c-422b-9329-fc20d3f5cd33 tempest-VolumesTestJSON-454859533 None] Flow 'volume_create_manager' (c87ea177-4a3a-4861-b663-0f8527c447e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 19:53:22 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-78130e58-cc1c-422b-9329-fc20d3f5cd33 tempest-VolumesTestJSON-454859533 None] Created volume successfully.
Jul 02 19:53:23 devstack sudo[98120]: pam_unix(sudo:session): session closed for user root
Jul 02 19:53:23 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-782671ce-adf3-4d5c-830c-64e780cc9b74 tempest-VolumesListTestJSON-1365139275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-1018e869-7cec-44e7-97b6-4a0aab1f5eea 1073741824" returned: 0 in 1.010s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:53:23 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-782671ce-adf3-4d5c-830c-64e780cc9b74 tempest-VolumesListTestJSON-1365139275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-1018e869-7cec-44e7-97b6-4a0aab1f5eea {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:53:23 devstack sudo[98127]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-1018e869-7cec-44e7-97b6-4a0aab1f5eea
Jul 02 19:53:23 devstack sudo[98127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:53:24 devstack sudo[98127]: pam_unix(sudo:session): session closed for user root
Jul 02 19:53:24 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-782671ce-adf3-4d5c-830c-64e780cc9b74 tempest-VolumesListTestJSON-1365139275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-1018e869-7cec-44e7-97b6-4a0aab1f5eea" returned: 0 in 0.701s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:53:24 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-782671ce-adf3-4d5c-830c-64e780cc9b74 tempest-VolumesListTestJSON-1365139275 None] <== create_volume: return (1758ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'} {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 19:53:24 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-782671ce-adf3-4d5c-830c-64e780cc9b74 tempest-VolumesListTestJSON-1365139275 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.761s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:53:24 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-782671ce-adf3-4d5c-830c-64e780cc9b74 tempest-VolumesListTestJSON-1365139275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5513a162-0be4-47b7-b078-d76f9213b2da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1018e869-7cec-44e7-97b6-4a0aab1f5eea', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:53:24 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-782671ce-adf3-4d5c-830c-64e780cc9b74 tempest-VolumesListTestJSON-1365139275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa4d2758-7643-48bf-ae4d-6c37778de358) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:53:24 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-782671ce-adf3-4d5c-830c-64e780cc9b74 tempest-VolumesListTestJSON-1365139275 None] Volume volume-1018e869-7cec-44e7-97b6-4a0aab1f5eea (1018e869-7cec-44e7-97b6-4a0aab1f5eea): created successfully
Jul 02 19:53:24 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-782671ce-adf3-4d5c-830c-64e780cc9b74 tempest-VolumesListTestJSON-1365139275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa4d2758-7643-48bf-ae4d-6c37778de358) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:53:24 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-782671ce-adf3-4d5c-830c-64e780cc9b74 tempest-VolumesListTestJSON-1365139275 None] Flow 'volume_create_manager' (80cf0171-5fc2-4abf-8b15-4f4a9dd72ad6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 19:53:24 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-782671ce-adf3-4d5c-830c-64e780cc9b74 tempest-VolumesListTestJSON-1365139275 None] Created volume successfully.
Jul 02 19:53:24 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-0a1e44b7-caa1-4c65-a807-8eadfa7011ee tempest-VolumesTestJSON-454859533 None] Acquiring lock "cinder-678ed91f-1ebb-4a59-9259-eda79babd79f-delete_volume" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:53:24 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-0a1e44b7-caa1-4c65-a807-8eadfa7011ee tempest-VolumesTestJSON-454859533 None] Lock "cinder-678ed91f-1ebb-4a59-9259-eda79babd79f-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:53:24 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-0a1e44b7-caa1-4c65-a807-8eadfa7011ee tempest-VolumesTestJSON-454859533 None] Acquiring lock "cinder-quobyte-678ed91f-1ebb-4a59-9259-eda79babd79f" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:53:24 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-0a1e44b7-caa1-4c65-a807-8eadfa7011ee tempest-VolumesTestJSON-454859533 None] Lock "cinder-quobyte-678ed91f-1ebb-4a59-9259-eda79babd79f" acquired by "delete_volume" :: waited 0.024s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:53:24 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c6d12af-d04c-4322-b245-7736341c7539]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 19:53:24 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-0a1e44b7-caa1-4c65-a807-8eadfa7011ee tempest-VolumesTestJSON-454859533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-678ed91f-1ebb-4a59-9259-eda79babd79f {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:53:24 devstack sudo[98130]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-678ed91f-1ebb-4a59-9259-eda79babd79f
Jul 02 19:53:24 devstack sudo[98130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:53:25 devstack sudo[98130]: pam_unix(sudo:session): session closed for user root
Jul 02 19:53:25 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-0a1e44b7-caa1-4c65-a807-8eadfa7011ee tempest-VolumesTestJSON-454859533 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-678ed91f-1ebb-4a59-9259-eda79babd79f" returned: 0 in 0.859s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:53:25 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-0a1e44b7-caa1-4c65-a807-8eadfa7011ee tempest-VolumesTestJSON-454859533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-678ed91f-1ebb-4a59-9259-eda79babd79f {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:53:25 devstack sudo[98135]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-678ed91f-1ebb-4a59-9259-eda79babd79f
Jul 02 19:53:25 devstack sudo[98135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:53:26 devstack sudo[98135]: pam_unix(sudo:session): session closed for user root
Jul 02 19:53:26 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-0a1e44b7-caa1-4c65-a807-8eadfa7011ee tempest-VolumesTestJSON-454859533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-678ed91f-1ebb-4a59-9259-eda79babd79f" returned: 0 in 0.730s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:53:26 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-0a1e44b7-caa1-4c65-a807-8eadfa7011ee tempest-VolumesTestJSON-454859533 None] Lock "cinder-quobyte-678ed91f-1ebb-4a59-9259-eda79babd79f" released by "delete_volume" :: held 1.642s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:53:26 devstack cinder-volume[86639]: DEBUG cinder.quota [None req-0a1e44b7-caa1-4c65-a807-8eadfa7011ee tempest-VolumesTestJSON-454859533 None] Created reservations ['9ac6944d-2c93-4067-9637-953e7bdf59db', '99228908-3953-4356-b31c-4d7c5cda8c0f', 'ca4165fb-9cc5-4eb0-8c85-67e7b397a018', 'edeca5be-b930-47ce-bdb8-053e269234db'] {{(pid=86639) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 19:53:26 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-0a1e44b7-caa1-4c65-a807-8eadfa7011ee tempest-VolumesTestJSON-454859533 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:53:26 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-0a1e44b7-caa1-4c65-a807-8eadfa7011ee tempest-VolumesTestJSON-454859533 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:53:26 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-0a1e44b7-caa1-4c65-a807-8eadfa7011ee tempest-VolumesTestJSON-454859533 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 19:53:26 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-0a1e44b7-caa1-4c65-a807-8eadfa7011ee tempest-VolumesTestJSON-454859533 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 19:53:26 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-0a1e44b7-caa1-4c65-a807-8eadfa7011ee tempest-VolumesTestJSON-454859533 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:53:26 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-0a1e44b7-caa1-4c65-a807-8eadfa7011ee tempest-VolumesTestJSON-454859533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:53:26 devstack sudo[98138]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e
Jul 02 19:53:26 devstack sudo[98138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:53:27 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-bc39cd06-800c-4226-9698-287d8922d596 tempest-VolumesTestJSON-454859533 None] Acquiring lock "cinder-36d6f817-73dd-42eb-be3d-ffa5926ab5a1-delete_volume" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:53:27 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-bc39cd06-800c-4226-9698-287d8922d596 tempest-VolumesTestJSON-454859533 None] Lock "cinder-36d6f817-73dd-42eb-be3d-ffa5926ab5a1-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:53:27 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-bc39cd06-800c-4226-9698-287d8922d596 tempest-VolumesTestJSON-454859533 None] Acquiring lock "cinder-quobyte-36d6f817-73dd-42eb-be3d-ffa5926ab5a1" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:53:27 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-bc39cd06-800c-4226-9698-287d8922d596 tempest-VolumesTestJSON-454859533 None] Lock "cinder-quobyte-36d6f817-73dd-42eb-be3d-ffa5926ab5a1" acquired by "delete_volume" :: waited 0.041s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:53:27 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a54be31-0d4e-47ef-af87-38a57e7ec8c1]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 19:53:27 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-bc39cd06-800c-4226-9698-287d8922d596 tempest-VolumesTestJSON-454859533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-36d6f817-73dd-42eb-be3d-ffa5926ab5a1 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:53:27 devstack sudo[98155]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-36d6f817-73dd-42eb-be3d-ffa5926ab5a1
Jul 02 19:53:27 devstack sudo[98155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:53:27 devstack sudo[98138]: pam_unix(sudo:session): session closed for user root
Jul 02 19:53:27 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-0a1e44b7-caa1-4c65-a807-8eadfa7011ee tempest-VolumesTestJSON-454859533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e" returned: 0 in 0.929s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:53:27 devstack cinder-volume[86639]: DEBUG cinder.manager [None req-0a1e44b7-caa1-4c65-a807-8eadfa7011ee tempest-VolumesTestJSON-454859533 None] Notifying Schedulers of capabilities ... {{(pid=86639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 19:53:27 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-0a1e44b7-caa1-4c65-a807-8eadfa7011ee tempest-VolumesTestJSON-454859533 None] Deleted volume successfully.
Jul 02 19:53:27 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-0a1e44b7-caa1-4c65-a807-8eadfa7011ee tempest-VolumesTestJSON-454859533 None] Lock "cinder-678ed91f-1ebb-4a59-9259-eda79babd79f-delete_volume" released by "delete_volume" :: held 2.866s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:53:27 devstack cinder-volume[86639]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4d42569-3d96-41b6-8ba1-43408bdbd87e tempest-VolumesDeleteCascade-296710616 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 19:53:27 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-e4d42569-3d96-41b6-8ba1-43408bdbd87e tempest-VolumesDeleteCascade-296710616 None] Flow 'volume_create_manager' (0e861f99-93c9-49c8-a45a-dca7ebd60ae6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 19:53:27 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-e4d42569-3d96-41b6-8ba1-43408bdbd87e tempest-VolumesDeleteCascade-296710616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fbe4532-a612-4c6c-bcd6-a8ae623ff96d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:53:27 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-e4d42569-3d96-41b6-8ba1-43408bdbd87e tempest-VolumesDeleteCascade-296710616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fbe4532-a612-4c6c-bcd6-a8ae623ff96d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T17:53:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1429533395',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b4a2ab1-a499-4804-9b3b-2bd376660f04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8daac3662f7488b9927af586b96099f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T17:53:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T17:53:28Z,use_quota=True,user_id='d2dd0f41a08f4b53aafba37e36ae5572',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:53:27 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-e4d42569-3d96-41b6-8ba1-43408bdbd87e tempest-VolumesDeleteCascade-296710616 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b97de11f-f828-4b22-818f-368f4bce4e1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:53:27 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-e4d42569-3d96-41b6-8ba1-43408bdbd87e tempest-VolumesDeleteCascade-296710616 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b97de11f-f828-4b22-818f-368f4bce4e1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:53:27 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-e4d42569-3d96-41b6-8ba1-43408bdbd87e tempest-VolumesDeleteCascade-296710616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (430ab045-1deb-413a-9273-6178c6638665) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:53:27 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-e4d42569-3d96-41b6-8ba1-43408bdbd87e tempest-VolumesDeleteCascade-296710616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (430ab045-1deb-413a-9273-6178c6638665) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b4a2ab1-a499-4804-9b3b-2bd376660f04', 'volume_name': 'volume-1b4a2ab1-a499-4804-9b3b-2bd376660f04', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:53:27 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-e4d42569-3d96-41b6-8ba1-43408bdbd87e tempest-VolumesDeleteCascade-296710616 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1a2cc73-b9b8-4b2a-9848-539f9b1138eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:53:27 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-e4d42569-3d96-41b6-8ba1-43408bdbd87e tempest-VolumesDeleteCascade-296710616 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1a2cc73-b9b8-4b2a-9848-539f9b1138eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:53:27 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-e4d42569-3d96-41b6-8ba1-43408bdbd87e tempest-VolumesDeleteCascade-296710616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4fe6528-5f51-472f-a815-809c915c644f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:53:27 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-e4d42569-3d96-41b6-8ba1-43408bdbd87e tempest-VolumesDeleteCascade-296710616 None] Volume 1b4a2ab1-a499-4804-9b3b-2bd376660f04: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b4a2ab1-a499-4804-9b3b-2bd376660f04', 'volume_size': 1}
Jul 02 19:53:27 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-e4d42569-3d96-41b6-8ba1-43408bdbd87e tempest-VolumesDeleteCascade-296710616 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:53:27 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-e4d42569-3d96-41b6-8ba1-43408bdbd87e tempest-VolumesDeleteCascade-296710616 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:53:27 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-e4d42569-3d96-41b6-8ba1-43408bdbd87e tempest-VolumesDeleteCascade-296710616 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce906cb830>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T17:53:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1429533395',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b4a2ab1-a499-4804-9b3b-2bd376660f04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8daac3662f7488b9927af586b96099f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T17:53:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T17:53:28Z,use_quota=True,user_id='d2dd0f41a08f4b53aafba37e36ae5572',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)}" {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 19:53:27 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-e4d42569-3d96-41b6-8ba1-43408bdbd87e tempest-VolumesDeleteCascade-296710616 None] Creating volume 1b4a2ab1-a499-4804-9b3b-2bd376660f04 {{(pid=86639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 19:53:27 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-e4d42569-3d96-41b6-8ba1-43408bdbd87e tempest-VolumesDeleteCascade-296710616 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:53:27 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-e4d42569-3d96-41b6-8ba1-43408bdbd87e tempest-VolumesDeleteCascade-296710616 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:53:27 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-e4d42569-3d96-41b6-8ba1-43408bdbd87e tempest-VolumesDeleteCascade-296710616 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 19:53:27 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-e4d42569-3d96-41b6-8ba1-43408bdbd87e tempest-VolumesDeleteCascade-296710616 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 19:53:27 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-e4d42569-3d96-41b6-8ba1-43408bdbd87e tempest-VolumesDeleteCascade-296710616 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:53:27 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-e4d42569-3d96-41b6-8ba1-43408bdbd87e tempest-VolumesDeleteCascade-296710616 None] Selected osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92 as target Quobyte volume. {{(pid=86639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 19:53:27 devstack cinder-volume[86639]: INFO cinder.volume.drivers.remotefs [None req-e4d42569-3d96-41b6-8ba1-43408bdbd87e tempest-VolumesDeleteCascade-296710616 None] casted to osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92
Jul 02 19:53:27 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-e4d42569-3d96-41b6-8ba1-43408bdbd87e tempest-VolumesDeleteCascade-296710616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-1b4a2ab1-a499-4804-9b3b-2bd376660f04 1073741824 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:53:27 devstack sudo[98177]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-1b4a2ab1-a499-4804-9b3b-2bd376660f04 1073741824
Jul 02 19:53:27 devstack sudo[98177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:53:27 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-73d1b7df-f931-4037-b79b-c80710e12943 tempest-VolumesListTestJSON-1365139275 None] Acquiring lock "cinder-1018e869-7cec-44e7-97b6-4a0aab1f5eea-delete_volume" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:53:27 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-73d1b7df-f931-4037-b79b-c80710e12943 tempest-VolumesListTestJSON-1365139275 None] Lock "cinder-1018e869-7cec-44e7-97b6-4a0aab1f5eea-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:53:27 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-73d1b7df-f931-4037-b79b-c80710e12943 tempest-VolumesListTestJSON-1365139275 None] Acquiring lock "cinder-quobyte-1018e869-7cec-44e7-97b6-4a0aab1f5eea" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:53:27 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-73d1b7df-f931-4037-b79b-c80710e12943 tempest-VolumesListTestJSON-1365139275 None] Lock "cinder-quobyte-1018e869-7cec-44e7-97b6-4a0aab1f5eea" acquired by "delete_volume" :: waited 0.025s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:53:28 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5e30281-b385-4eac-93ea-b972c9f1589b]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 19:53:28 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-73d1b7df-f931-4037-b79b-c80710e12943 tempest-VolumesListTestJSON-1365139275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-1018e869-7cec-44e7-97b6-4a0aab1f5eea {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:53:28 devstack sudo[98181]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-1018e869-7cec-44e7-97b6-4a0aab1f5eea
Jul 02 19:53:28 devstack sudo[98181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:53:28 devstack sudo[98155]: pam_unix(sudo:session): session closed for user root
Jul 02 19:53:28 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-bc39cd06-800c-4226-9698-287d8922d596 tempest-VolumesTestJSON-454859533 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-36d6f817-73dd-42eb-be3d-ffa5926ab5a1" returned: 0 in 0.997s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:53:28 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-bc39cd06-800c-4226-9698-287d8922d596 tempest-VolumesTestJSON-454859533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-36d6f817-73dd-42eb-be3d-ffa5926ab5a1 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:53:28 devstack sudo[98186]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-36d6f817-73dd-42eb-be3d-ffa5926ab5a1
Jul 02 19:53:28 devstack sudo[98186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:53:28 devstack sudo[98177]: pam_unix(sudo:session): session closed for user root
Jul 02 19:53:28 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-e4d42569-3d96-41b6-8ba1-43408bdbd87e tempest-VolumesDeleteCascade-296710616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-1b4a2ab1-a499-4804-9b3b-2bd376660f04 1073741824" returned: 0 in 1.083s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:53:28 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-e4d42569-3d96-41b6-8ba1-43408bdbd87e tempest-VolumesDeleteCascade-296710616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-1b4a2ab1-a499-4804-9b3b-2bd376660f04 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:53:28 devstack sudo[98194]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-1b4a2ab1-a499-4804-9b3b-2bd376660f04
Jul 02 19:53:28 devstack sudo[98194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:53:29 devstack sudo[98181]: pam_unix(sudo:session): session closed for user root
Jul 02 19:53:29 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-73d1b7df-f931-4037-b79b-c80710e12943 tempest-VolumesListTestJSON-1365139275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-1018e869-7cec-44e7-97b6-4a0aab1f5eea" returned: 0 in 1.002s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:53:29 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-73d1b7df-f931-4037-b79b-c80710e12943 tempest-VolumesListTestJSON-1365139275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-1018e869-7cec-44e7-97b6-4a0aab1f5eea {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:53:29 devstack sudo[98197]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-1018e869-7cec-44e7-97b6-4a0aab1f5eea
Jul 02 19:53:29 devstack sudo[98197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:53:29 devstack sudo[98186]: pam_unix(sudo:session): session closed for user root
Jul 02 19:53:29 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-bc39cd06-800c-4226-9698-287d8922d596 tempest-VolumesTestJSON-454859533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-36d6f817-73dd-42eb-be3d-ffa5926ab5a1" returned: 0 in 0.801s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:53:29 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-bc39cd06-800c-4226-9698-287d8922d596 tempest-VolumesTestJSON-454859533 None] Lock "cinder-quobyte-36d6f817-73dd-42eb-be3d-ffa5926ab5a1" released by "delete_volume" :: held 1.891s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:53:29 devstack cinder-volume[86639]: DEBUG cinder.quota [None req-bc39cd06-800c-4226-9698-287d8922d596 tempest-VolumesTestJSON-454859533 None] Created reservations ['f52510f7-e721-4e81-98a1-3abfcdcba41b', '2d5051ce-8962-48c0-a799-825b49822520', '3e24d144-025a-4934-9f86-6cca8219b07c', '139c4f99-1519-451b-82fb-9ecd5c7d1432'] {{(pid=86639) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 19:53:29 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-bc39cd06-800c-4226-9698-287d8922d596 tempest-VolumesTestJSON-454859533 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:53:29 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-bc39cd06-800c-4226-9698-287d8922d596 tempest-VolumesTestJSON-454859533 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:53:29 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-bc39cd06-800c-4226-9698-287d8922d596 tempest-VolumesTestJSON-454859533 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 19:53:29 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-bc39cd06-800c-4226-9698-287d8922d596 tempest-VolumesTestJSON-454859533 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 19:53:29 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-bc39cd06-800c-4226-9698-287d8922d596 tempest-VolumesTestJSON-454859533 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:53:29 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-bc39cd06-800c-4226-9698-287d8922d596 tempest-VolumesTestJSON-454859533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:53:29 devstack sudo[98199]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e
Jul 02 19:53:29 devstack sudo[98199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:53:29 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-f9eeb919-53ba-4044-acf9-d20727289025 tempest-VolumesTestJSON-454859533 None] Acquiring lock "cinder-23e753c4-b709-4fa4-9601-aad491300048-delete_volume" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:53:29 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-f9eeb919-53ba-4044-acf9-d20727289025 tempest-VolumesTestJSON-454859533 None] Lock "cinder-23e753c4-b709-4fa4-9601-aad491300048-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:53:29 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-f9eeb919-53ba-4044-acf9-d20727289025 tempest-VolumesTestJSON-454859533 None] Acquiring lock "cinder-quobyte-23e753c4-b709-4fa4-9601-aad491300048" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:53:29 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-f9eeb919-53ba-4044-acf9-d20727289025 tempest-VolumesTestJSON-454859533 None] Lock "cinder-quobyte-23e753c4-b709-4fa4-9601-aad491300048" acquired by "delete_volume" :: waited 0.024s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:53:29 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[40bf70d0-50a6-4472-97fe-948c652ef5be]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 19:53:29 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-f9eeb919-53ba-4044-acf9-d20727289025 tempest-VolumesTestJSON-454859533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-23e753c4-b709-4fa4-9601-aad491300048 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:53:29 devstack sudo[98201]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-23e753c4-b709-4fa4-9601-aad491300048
Jul 02 19:53:29 devstack sudo[98201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:53:29 devstack sudo[98194]: pam_unix(sudo:session): session closed for user root
Jul 02 19:53:29 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-e4d42569-3d96-41b6-8ba1-43408bdbd87e tempest-VolumesDeleteCascade-296710616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-1b4a2ab1-a499-4804-9b3b-2bd376660f04" returned: 0 in 0.990s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:53:29 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-e4d42569-3d96-41b6-8ba1-43408bdbd87e tempest-VolumesDeleteCascade-296710616 None] <== create_volume: return (2130ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'} {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 19:53:29 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-e4d42569-3d96-41b6-8ba1-43408bdbd87e tempest-VolumesDeleteCascade-296710616 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.132s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:53:29 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-e4d42569-3d96-41b6-8ba1-43408bdbd87e tempest-VolumesDeleteCascade-296710616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4fe6528-5f51-472f-a815-809c915c644f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b4a2ab1-a499-4804-9b3b-2bd376660f04', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:53:29 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-e4d42569-3d96-41b6-8ba1-43408bdbd87e tempest-VolumesDeleteCascade-296710616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9425327f-63a7-4d58-a8c1-e52cbc2bfdc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:53:29 devstack sudo[98197]: pam_unix(sudo:session): session closed for user root
Jul 02 19:53:30 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-73d1b7df-f931-4037-b79b-c80710e12943 tempest-VolumesListTestJSON-1365139275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-1018e869-7cec-44e7-97b6-4a0aab1f5eea" returned: 0 in 0.969s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:53:30 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-e4d42569-3d96-41b6-8ba1-43408bdbd87e tempest-VolumesDeleteCascade-296710616 None] Volume volume-1b4a2ab1-a499-4804-9b3b-2bd376660f04 (1b4a2ab1-a499-4804-9b3b-2bd376660f04): created successfully
Jul 02 19:53:30 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-e4d42569-3d96-41b6-8ba1-43408bdbd87e tempest-VolumesDeleteCascade-296710616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9425327f-63a7-4d58-a8c1-e52cbc2bfdc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:53:30 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-e4d42569-3d96-41b6-8ba1-43408bdbd87e tempest-VolumesDeleteCascade-296710616 None] Flow 'volume_create_manager' (0e861f99-93c9-49c8-a45a-dca7ebd60ae6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 19:53:30 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-73d1b7df-f931-4037-b79b-c80710e12943 tempest-VolumesListTestJSON-1365139275 None] Lock "cinder-quobyte-1018e869-7cec-44e7-97b6-4a0aab1f5eea" released by "delete_volume" :: held 2.061s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:53:30 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-e4d42569-3d96-41b6-8ba1-43408bdbd87e tempest-VolumesDeleteCascade-296710616 None] Created volume successfully.
Jul 02 19:53:30 devstack sudo[98199]: pam_unix(sudo:session): session closed for user root
Jul 02 19:53:30 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-bc39cd06-800c-4226-9698-287d8922d596 tempest-VolumesTestJSON-454859533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e" returned: 0 in 0.792s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:53:30 devstack cinder-volume[86639]: DEBUG cinder.manager [None req-bc39cd06-800c-4226-9698-287d8922d596 tempest-VolumesTestJSON-454859533 None] Notifying Schedulers of capabilities ... {{(pid=86639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 19:53:30 devstack cinder-volume[86639]: DEBUG cinder.quota [None req-73d1b7df-f931-4037-b79b-c80710e12943 tempest-VolumesListTestJSON-1365139275 None] Created reservations ['17dbbc73-1a8b-4c25-a81f-30ce6b497ce4', 'c334b27a-4ac3-45f7-8693-6d8958506b17', '0970136c-39f6-4c5b-96f1-40d36f43ce7e', '4b3fd928-5a35-4232-bf3e-e9babc0b4e6f'] {{(pid=86639) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 19:53:30 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-bc39cd06-800c-4226-9698-287d8922d596 tempest-VolumesTestJSON-454859533 None] Deleted volume successfully.
Jul 02 19:53:30 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-bc39cd06-800c-4226-9698-287d8922d596 tempest-VolumesTestJSON-454859533 None] Lock "cinder-36d6f817-73dd-42eb-be3d-ffa5926ab5a1-delete_volume" released by "delete_volume" :: held 3.011s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:53:30 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-73d1b7df-f931-4037-b79b-c80710e12943 tempest-VolumesListTestJSON-1365139275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:53:30 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-73d1b7df-f931-4037-b79b-c80710e12943 tempest-VolumesListTestJSON-1365139275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:53:30 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-73d1b7df-f931-4037-b79b-c80710e12943 tempest-VolumesListTestJSON-1365139275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 19:53:30 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-73d1b7df-f931-4037-b79b-c80710e12943 tempest-VolumesListTestJSON-1365139275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 19:53:30 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-73d1b7df-f931-4037-b79b-c80710e12943 tempest-VolumesListTestJSON-1365139275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:53:30 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-73d1b7df-f931-4037-b79b-c80710e12943 tempest-VolumesListTestJSON-1365139275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:53:30 devstack sudo[98206]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e
Jul 02 19:53:30 devstack sudo[98206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:53:30 devstack sudo[98201]: pam_unix(sudo:session): session closed for user root
Jul 02 19:53:30 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-f9eeb919-53ba-4044-acf9-d20727289025 tempest-VolumesTestJSON-454859533 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-23e753c4-b709-4fa4-9601-aad491300048" returned: 0 in 1.022s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:53:30 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-f9eeb919-53ba-4044-acf9-d20727289025 tempest-VolumesTestJSON-454859533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-23e753c4-b709-4fa4-9601-aad491300048 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:53:30 devstack sudo[98211]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-23e753c4-b709-4fa4-9601-aad491300048
Jul 02 19:53:30 devstack sudo[98211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:53:30 devstack sudo[98206]: pam_unix(sudo:session): session closed for user root
Jul 02 19:53:30 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-73d1b7df-f931-4037-b79b-c80710e12943 tempest-VolumesListTestJSON-1365139275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e" returned: 0 in 0.702s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:53:30 devstack cinder-volume[86639]: DEBUG cinder.manager [None req-73d1b7df-f931-4037-b79b-c80710e12943 tempest-VolumesListTestJSON-1365139275 None] Notifying Schedulers of capabilities ... {{(pid=86639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 19:53:30 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-73d1b7df-f931-4037-b79b-c80710e12943 tempest-VolumesListTestJSON-1365139275 None] Deleted volume successfully.
Jul 02 19:53:30 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-73d1b7df-f931-4037-b79b-c80710e12943 tempest-VolumesListTestJSON-1365139275 None] Lock "cinder-1018e869-7cec-44e7-97b6-4a0aab1f5eea-delete_volume" released by "delete_volume" :: held 3.065s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:53:31 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-177043b3-fa05-4d86-8623-5a6696cb3205 tempest-VolumesDeleteCascade-296710616 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:53:31 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-177043b3-fa05-4d86-8623-5a6696cb3205 tempest-VolumesDeleteCascade-296710616 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:53:31 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-177043b3-fa05-4d86-8623-5a6696cb3205 tempest-VolumesDeleteCascade-296710616 None] Creating offline snapshot 653e0fb5-e4fc-4e1f-8599-4287df26fc8f of volume 1b4a2ab1-a499-4804-9b3b-2bd376660f04 {{(pid=86639) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 02 19:53:31 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[c54b2584-2be3-43ec-aa73-0a23ba9b0a52]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 19:53:31 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-177043b3-fa05-4d86-8623-5a6696cb3205 tempest-VolumesDeleteCascade-296710616 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-1b4a2ab1-a499-4804-9b3b-2bd376660f04 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:53:31 devstack sudo[98214]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-1b4a2ab1-a499-4804-9b3b-2bd376660f04
Jul 02 19:53:31 devstack sudo[98214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:53:31 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-e86f8cd9-95c7-4267-b060-2c6384d0d667 tempest-VolumesListTestJSON-1365139275 None] Acquiring lock "cinder-823f8a5c-188d-46d3-802d-f7584a13663c-delete_volume" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:53:31 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-e86f8cd9-95c7-4267-b060-2c6384d0d667 tempest-VolumesListTestJSON-1365139275 None] Lock "cinder-823f8a5c-188d-46d3-802d-f7584a13663c-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:53:31 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-e86f8cd9-95c7-4267-b060-2c6384d0d667 tempest-VolumesListTestJSON-1365139275 None] Acquiring lock "cinder-quobyte-823f8a5c-188d-46d3-802d-f7584a13663c" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:53:31 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-e86f8cd9-95c7-4267-b060-2c6384d0d667 tempest-VolumesListTestJSON-1365139275 None] Lock "cinder-quobyte-823f8a5c-188d-46d3-802d-f7584a13663c" acquired by "delete_volume" :: waited 0.026s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:53:31 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d065305-b7c4-4259-9aeb-7ab6096d5c0d]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 19:53:31 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-e86f8cd9-95c7-4267-b060-2c6384d0d667 tempest-VolumesListTestJSON-1365139275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-823f8a5c-188d-46d3-802d-f7584a13663c {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:53:31 devstack sudo[98211]: pam_unix(sudo:session): session closed for user root
Jul 02 19:53:31 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-f9eeb919-53ba-4044-acf9-d20727289025 tempest-VolumesTestJSON-454859533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-23e753c4-b709-4fa4-9601-aad491300048" returned: 0 in 0.993s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:53:31 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-f9eeb919-53ba-4044-acf9-d20727289025 tempest-VolumesTestJSON-454859533 None] Lock "cinder-quobyte-23e753c4-b709-4fa4-9601-aad491300048" released by "delete_volume" :: held 2.107s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:53:31 devstack cinder-volume[86639]: DEBUG cinder.quota [None req-f9eeb919-53ba-4044-acf9-d20727289025 tempest-VolumesTestJSON-454859533 None] Created reservations ['d84394c0-729c-466f-b0b2-7812a3d1f02f', '6910ce2e-48e9-4a05-89bd-f27a5fc7331c', '1dd2b6f1-ef55-4248-aa40-7dc130ef0f94', '1149f8aa-a10d-40c4-8ebd-d802ab35ca6c'] {{(pid=86639) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 19:53:31 devstack sudo[98217]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-823f8a5c-188d-46d3-802d-f7584a13663c
Jul 02 19:53:31 devstack sudo[98217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:53:31 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-f9eeb919-53ba-4044-acf9-d20727289025 tempest-VolumesTestJSON-454859533 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:53:31 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-f9eeb919-53ba-4044-acf9-d20727289025 tempest-VolumesTestJSON-454859533 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:53:31 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-f9eeb919-53ba-4044-acf9-d20727289025 tempest-VolumesTestJSON-454859533 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 19:53:31 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-f9eeb919-53ba-4044-acf9-d20727289025 tempest-VolumesTestJSON-454859533 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 19:53:31 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-f9eeb919-53ba-4044-acf9-d20727289025 tempest-VolumesTestJSON-454859533 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:53:31 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-f9eeb919-53ba-4044-acf9-d20727289025 tempest-VolumesTestJSON-454859533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:53:31 devstack sudo[98219]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e
Jul 02 19:53:31 devstack sudo[98219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:53:32 devstack sudo[98214]: pam_unix(sudo:session): session closed for user root
Jul 02 19:53:32 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-177043b3-fa05-4d86-8623-5a6696cb3205 tempest-VolumesDeleteCascade-296710616 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-1b4a2ab1-a499-4804-9b3b-2bd376660f04" returned: 0 in 0.923s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:53:32 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-177043b3-fa05-4d86-8623-5a6696cb3205 tempest-VolumesDeleteCascade-296710616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-1b4a2ab1-a499-4804-9b3b-2bd376660f04,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-1b4a2ab1-a499-4804-9b3b-2bd376660f04.653e0fb5-e4fc-4e1f-8599-4287df26fc8f 1G {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:53:32 devstack sudo[98224]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-1b4a2ab1-a499-4804-9b3b-2bd376660f04,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-1b4a2ab1-a499-4804-9b3b-2bd376660f04.653e0fb5-e4fc-4e1f-8599-4287df26fc8f 1G
Jul 02 19:53:32 devstack sudo[98224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:53:32 devstack sudo[98217]: pam_unix(sudo:session): session closed for user root
Jul 02 19:53:32 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-e86f8cd9-95c7-4267-b060-2c6384d0d667 tempest-VolumesListTestJSON-1365139275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-823f8a5c-188d-46d3-802d-f7584a13663c" returned: 0 in 0.917s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:53:32 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-e86f8cd9-95c7-4267-b060-2c6384d0d667 tempest-VolumesListTestJSON-1365139275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-823f8a5c-188d-46d3-802d-f7584a13663c {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:53:32 devstack sudo[98231]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-823f8a5c-188d-46d3-802d-f7584a13663c
Jul 02 19:53:32 devstack sudo[98231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:53:32 devstack sudo[98219]: pam_unix(sudo:session): session closed for user root
Jul 02 19:53:32 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-f9eeb919-53ba-4044-acf9-d20727289025 tempest-VolumesTestJSON-454859533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e" returned: 0 in 0.716s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:53:32 devstack cinder-volume[86639]: DEBUG cinder.manager [None req-f9eeb919-53ba-4044-acf9-d20727289025 tempest-VolumesTestJSON-454859533 None] Notifying Schedulers of capabilities ... {{(pid=86639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 19:53:32 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-f9eeb919-53ba-4044-acf9-d20727289025 tempest-VolumesTestJSON-454859533 None] Deleted volume successfully.
Jul 02 19:53:32 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-f9eeb919-53ba-4044-acf9-d20727289025 tempest-VolumesTestJSON-454859533 None] Lock "cinder-23e753c4-b709-4fa4-9601-aad491300048-delete_volume" released by "delete_volume" :: held 3.142s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:53:33 devstack sudo[98224]: pam_unix(sudo:session): session closed for user root
Jul 02 19:53:33 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-177043b3-fa05-4d86-8623-5a6696cb3205 tempest-VolumesDeleteCascade-296710616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-1b4a2ab1-a499-4804-9b3b-2bd376660f04,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-1b4a2ab1-a499-4804-9b3b-2bd376660f04.653e0fb5-e4fc-4e1f-8599-4287df26fc8f 1G" returned: 0 in 0.985s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:53:33 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-177043b3-fa05-4d86-8623-5a6696cb3205 tempest-VolumesDeleteCascade-296710616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b4a2ab1-a499-4804-9b3b-2bd376660f04 -F qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-1b4a2ab1-a499-4804-9b3b-2bd376660f04.653e0fb5-e4fc-4e1f-8599-4287df26fc8f {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:53:33 devstack sudo[98243]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b4a2ab1-a499-4804-9b3b-2bd376660f04 -F qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-1b4a2ab1-a499-4804-9b3b-2bd376660f04.653e0fb5-e4fc-4e1f-8599-4287df26fc8f
Jul 02 19:53:33 devstack sudo[98243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:53:33 devstack sudo[98231]: pam_unix(sudo:session): session closed for user root
Jul 02 19:53:33 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-e86f8cd9-95c7-4267-b060-2c6384d0d667 tempest-VolumesListTestJSON-1365139275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-823f8a5c-188d-46d3-802d-f7584a13663c" returned: 0 in 0.738s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:53:33 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-e86f8cd9-95c7-4267-b060-2c6384d0d667 tempest-VolumesListTestJSON-1365139275 None] Lock "cinder-quobyte-823f8a5c-188d-46d3-802d-f7584a13663c" released by "delete_volume" :: held 1.725s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:53:33 devstack cinder-volume[86639]: DEBUG cinder.quota [None req-e86f8cd9-95c7-4267-b060-2c6384d0d667 tempest-VolumesListTestJSON-1365139275 None] Created reservations ['14defa6c-9843-4399-be20-564a5b5d5a32', '3676fde6-4567-42ae-b200-950df3a79964', '5e49d02f-a8d4-469a-9826-fa85ca586d04', 'af298c60-1cd3-4d17-9da8-d12b06dfc408'] {{(pid=86639) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 19:53:33 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-e86f8cd9-95c7-4267-b060-2c6384d0d667 tempest-VolumesListTestJSON-1365139275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:53:33 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-e86f8cd9-95c7-4267-b060-2c6384d0d667 tempest-VolumesListTestJSON-1365139275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:53:33 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-e86f8cd9-95c7-4267-b060-2c6384d0d667 tempest-VolumesListTestJSON-1365139275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 19:53:33 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-e86f8cd9-95c7-4267-b060-2c6384d0d667 tempest-VolumesListTestJSON-1365139275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 19:53:33 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-e86f8cd9-95c7-4267-b060-2c6384d0d667 tempest-VolumesListTestJSON-1365139275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:53:33 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-e86f8cd9-95c7-4267-b060-2c6384d0d667 tempest-VolumesListTestJSON-1365139275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:53:33 devstack sudo[98248]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e
Jul 02 19:53:33 devstack sudo[98248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:53:33 devstack sudo[98243]: pam_unix(sudo:session): session closed for user root
Jul 02 19:53:33 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-177043b3-fa05-4d86-8623-5a6696cb3205 tempest-VolumesDeleteCascade-296710616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b4a2ab1-a499-4804-9b3b-2bd376660f04 -F qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-1b4a2ab1-a499-4804-9b3b-2bd376660f04.653e0fb5-e4fc-4e1f-8599-4287df26fc8f" returned: 0 in 0.780s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:53:33 devstack cinder-volume[86639]: WARNING cinder.volume.drivers.remotefs [None req-177043b3-fa05-4d86-8623-5a6696cb3205 tempest-VolumesDeleteCascade-296710616 None] /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-1b4a2ab1-a499-4804-9b3b-2bd376660f04.653e0fb5-e4fc-4e1f-8599-4287df26fc8f is being set with open permissions: ugo+rw
Jul 02 19:53:33 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-177043b3-fa05-4d86-8623-5a6696cb3205 tempest-VolumesDeleteCascade-296710616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-1b4a2ab1-a499-4804-9b3b-2bd376660f04.653e0fb5-e4fc-4e1f-8599-4287df26fc8f {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:53:33 devstack sudo[98254]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-1b4a2ab1-a499-4804-9b3b-2bd376660f04.653e0fb5-e4fc-4e1f-8599-4287df26fc8f
Jul 02 19:53:33 devstack sudo[98254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:53:34 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-884375cf-e415-41d0-a2af-ef23e00a2812 tempest-VolumesListTestJSON-1365139275 None] Acquiring lock "cinder-aae422d0-fb22-43cc-8617-ab141d343b6a-delete_volume" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:53:34 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-884375cf-e415-41d0-a2af-ef23e00a2812 tempest-VolumesListTestJSON-1365139275 None] Lock "cinder-aae422d0-fb22-43cc-8617-ab141d343b6a-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:53:34 devstack sudo[98248]: pam_unix(sudo:session): session closed for user root
Jul 02 19:53:34 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-e86f8cd9-95c7-4267-b060-2c6384d0d667 tempest-VolumesListTestJSON-1365139275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e" returned: 0 in 0.762s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:53:34 devstack cinder-volume[86639]: DEBUG cinder.manager [None req-e86f8cd9-95c7-4267-b060-2c6384d0d667 tempest-VolumesListTestJSON-1365139275 None] Notifying Schedulers of capabilities ... {{(pid=86639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 19:53:34 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-884375cf-e415-41d0-a2af-ef23e00a2812 tempest-VolumesListTestJSON-1365139275 None] Acquiring lock "cinder-quobyte-aae422d0-fb22-43cc-8617-ab141d343b6a" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:53:34 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-e86f8cd9-95c7-4267-b060-2c6384d0d667 tempest-VolumesListTestJSON-1365139275 None] Deleted volume successfully.
Jul 02 19:53:34 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-884375cf-e415-41d0-a2af-ef23e00a2812 tempest-VolumesListTestJSON-1365139275 None] Lock "cinder-quobyte-aae422d0-fb22-43cc-8617-ab141d343b6a" acquired by "delete_volume" :: waited 0.032s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:53:34 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-e86f8cd9-95c7-4267-b060-2c6384d0d667 tempest-VolumesListTestJSON-1365139275 None] Lock "cinder-823f8a5c-188d-46d3-802d-f7584a13663c-delete_volume" released by "delete_volume" :: held 2.784s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:53:34 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a9989df-44c6-47ec-9f66-3f0c3cc0e137]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 19:53:34 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-884375cf-e415-41d0-a2af-ef23e00a2812 tempest-VolumesListTestJSON-1365139275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-aae422d0-fb22-43cc-8617-ab141d343b6a {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:53:34 devstack sudo[98257]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-aae422d0-fb22-43cc-8617-ab141d343b6a
Jul 02 19:53:34 devstack sudo[98257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:53:34 devstack sudo[98254]: pam_unix(sudo:session): session closed for user root
Jul 02 19:53:34 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-177043b3-fa05-4d86-8623-5a6696cb3205 tempest-VolumesDeleteCascade-296710616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-1b4a2ab1-a499-4804-9b3b-2bd376660f04.653e0fb5-e4fc-4e1f-8599-4287df26fc8f" returned: 0 in 0.879s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:53:34 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-177043b3-fa05-4d86-8623-5a6696cb3205 tempest-VolumesDeleteCascade-296710616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-1b4a2ab1-a499-4804-9b3b-2bd376660f04.info {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:53:34 devstack sudo[98260]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-1b4a2ab1-a499-4804-9b3b-2bd376660f04.info
Jul 02 19:53:34 devstack sudo[98260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:53:35 devstack sudo[98257]: pam_unix(sudo:session): session closed for user root
Jul 02 19:53:35 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-884375cf-e415-41d0-a2af-ef23e00a2812 tempest-VolumesListTestJSON-1365139275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-aae422d0-fb22-43cc-8617-ab141d343b6a" returned: 0 in 0.841s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:53:35 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-884375cf-e415-41d0-a2af-ef23e00a2812 tempest-VolumesListTestJSON-1365139275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-aae422d0-fb22-43cc-8617-ab141d343b6a {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:53:35 devstack sudo[98266]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-aae422d0-fb22-43cc-8617-ab141d343b6a
Jul 02 19:53:35 devstack sudo[98266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:53:35 devstack sudo[98260]: pam_unix(sudo:session): session closed for user root
Jul 02 19:53:35 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-177043b3-fa05-4d86-8623-5a6696cb3205 tempest-VolumesDeleteCascade-296710616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-1b4a2ab1-a499-4804-9b3b-2bd376660f04.info" returned: 0 in 0.725s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:53:35 devstack cinder-volume[86639]: WARNING cinder.volume.drivers.remotefs [None req-177043b3-fa05-4d86-8623-5a6696cb3205 tempest-VolumesDeleteCascade-296710616 None] /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-1b4a2ab1-a499-4804-9b3b-2bd376660f04.info is being set with open permissions: ugo+rw
Jul 02 19:53:35 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-177043b3-fa05-4d86-8623-5a6696cb3205 tempest-VolumesDeleteCascade-296710616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-1b4a2ab1-a499-4804-9b3b-2bd376660f04.info {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:53:35 devstack sudo[98269]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-1b4a2ab1-a499-4804-9b3b-2bd376660f04.info
Jul 02 19:53:35 devstack sudo[98269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:53:35 devstack sudo[98266]: pam_unix(sudo:session): session closed for user root
Jul 02 19:53:35 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-884375cf-e415-41d0-a2af-ef23e00a2812 tempest-VolumesListTestJSON-1365139275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-aae422d0-fb22-43cc-8617-ab141d343b6a" returned: 0 in 0.702s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:53:35 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-884375cf-e415-41d0-a2af-ef23e00a2812 tempest-VolumesListTestJSON-1365139275 None] Lock "cinder-quobyte-aae422d0-fb22-43cc-8617-ab141d343b6a" released by "delete_volume" :: held 1.601s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:53:35 devstack cinder-volume[86639]: DEBUG cinder.quota [None req-884375cf-e415-41d0-a2af-ef23e00a2812 tempest-VolumesListTestJSON-1365139275 None] Created reservations ['11f19c5f-56a3-4649-8801-48898ded7088', '82a5676f-5a04-4c59-a87d-5d83445de6e1', 'a6b3f557-1ca3-49d1-ba87-14823ece2372', '05a79203-1ac8-4b8d-ab06-feb07eeb82b9'] {{(pid=86639) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 19:53:36 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-884375cf-e415-41d0-a2af-ef23e00a2812 tempest-VolumesListTestJSON-1365139275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:53:36 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-884375cf-e415-41d0-a2af-ef23e00a2812 tempest-VolumesListTestJSON-1365139275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:53:36 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-884375cf-e415-41d0-a2af-ef23e00a2812 tempest-VolumesListTestJSON-1365139275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 19:53:36 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-884375cf-e415-41d0-a2af-ef23e00a2812 tempest-VolumesListTestJSON-1365139275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 19:53:36 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-884375cf-e415-41d0-a2af-ef23e00a2812 tempest-VolumesListTestJSON-1365139275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:53:36 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-884375cf-e415-41d0-a2af-ef23e00a2812 tempest-VolumesListTestJSON-1365139275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:53:36 devstack sudo[98272]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e
Jul 02 19:53:36 devstack sudo[98272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:53:36 devstack sudo[98269]: pam_unix(sudo:session): session closed for user root
Jul 02 19:53:36 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-177043b3-fa05-4d86-8623-5a6696cb3205 tempest-VolumesDeleteCascade-296710616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-1b4a2ab1-a499-4804-9b3b-2bd376660f04.info" returned: 0 in 0.746s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:53:36 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-177043b3-fa05-4d86-8623-5a6696cb3205 tempest-VolumesDeleteCascade-296710616 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.154s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:53:36 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-177043b3-fa05-4d86-8623-5a6696cb3205 tempest-VolumesDeleteCascade-296710616 None] Create snapshot completed successfully
Jul 02 19:53:36 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-9bf20637-aa26-471f-bf87-e72e1e6a5970 tempest-VolumesDeleteCascade-296710616 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:53:36 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-9bf20637-aa26-471f-bf87-e72e1e6a5970 tempest-VolumesDeleteCascade-296710616 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:53:36 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-9bf20637-aa26-471f-bf87-e72e1e6a5970 tempest-VolumesDeleteCascade-296710616 None] Creating offline snapshot c5c943ba-798f-4ab6-a182-ba56bc00a35e of volume 1b4a2ab1-a499-4804-9b3b-2bd376660f04 {{(pid=86639) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 02 19:53:36 devstack sudo[98272]: pam_unix(sudo:session): session closed for user root
Jul 02 19:53:36 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-884375cf-e415-41d0-a2af-ef23e00a2812 tempest-VolumesListTestJSON-1365139275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e" returned: 0 in 0.787s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:53:36 devstack cinder-volume[86639]: DEBUG cinder.manager [None req-884375cf-e415-41d0-a2af-ef23e00a2812 tempest-VolumesListTestJSON-1365139275 None] Notifying Schedulers of capabilities ... {{(pid=86639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 19:53:36 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-884375cf-e415-41d0-a2af-ef23e00a2812 tempest-VolumesListTestJSON-1365139275 None] Deleted volume successfully.
Jul 02 19:53:36 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[60b0a735-6e2d-40fe-ad28-e67afa9dd1cf]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 19:53:36 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-9bf20637-aa26-471f-bf87-e72e1e6a5970 tempest-VolumesDeleteCascade-296710616 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-1b4a2ab1-a499-4804-9b3b-2bd376660f04.653e0fb5-e4fc-4e1f-8599-4287df26fc8f {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:53:36 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-884375cf-e415-41d0-a2af-ef23e00a2812 tempest-VolumesListTestJSON-1365139275 None] Lock "cinder-aae422d0-fb22-43cc-8617-ab141d343b6a-delete_volume" released by "delete_volume" :: held 2.702s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:53:36 devstack sudo[98276]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-1b4a2ab1-a499-4804-9b3b-2bd376660f04.653e0fb5-e4fc-4e1f-8599-4287df26fc8f
Jul 02 19:53:36 devstack sudo[98276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:53:37 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-122bf168-c03f-4d0a-b0f0-641bdc0c1eaf tempest-GroupsV314Test-134590508 None] Group tempest-GroupsV314Test-Group-158670513: creating
Jul 02 19:53:37 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-122bf168-c03f-4d0a-b0f0-641bdc0c1eaf tempest-GroupsV314Test-134590508 None] Group tempest-GroupsV314Test-Group-158670513: created successfully
Jul 02 19:53:37 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-122bf168-c03f-4d0a-b0f0-641bdc0c1eaf tempest-GroupsV314Test-134590508 None] Create group completed successfully.
Jul 02 19:53:37 devstack sudo[98276]: pam_unix(sudo:session): session closed for user root
Jul 02 19:53:37 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-9bf20637-aa26-471f-bf87-e72e1e6a5970 tempest-VolumesDeleteCascade-296710616 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-1b4a2ab1-a499-4804-9b3b-2bd376660f04.653e0fb5-e4fc-4e1f-8599-4287df26fc8f" returned: 0 in 0.999s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:53:37 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-9bf20637-aa26-471f-bf87-e72e1e6a5970 tempest-VolumesDeleteCascade-296710616 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1b4a2ab1-a499-4804-9b3b-2bd376660f04(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86639) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 02 19:53:37 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-9bf20637-aa26-471f-bf87-e72e1e6a5970 tempest-VolumesDeleteCascade-296710616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-1b4a2ab1-a499-4804-9b3b-2bd376660f04.653e0fb5-e4fc-4e1f-8599-4287df26fc8f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-1b4a2ab1-a499-4804-9b3b-2bd376660f04.c5c943ba-798f-4ab6-a182-ba56bc00a35e 1G {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:53:37 devstack sudo[98281]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-1b4a2ab1-a499-4804-9b3b-2bd376660f04.653e0fb5-e4fc-4e1f-8599-4287df26fc8f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-1b4a2ab1-a499-4804-9b3b-2bd376660f04.c5c943ba-798f-4ab6-a182-ba56bc00a35e 1G
Jul 02 19:53:37 devstack sudo[98281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:53:38 devstack sudo[98281]: pam_unix(sudo:session): session closed for user root
Jul 02 19:53:38 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-9bf20637-aa26-471f-bf87-e72e1e6a5970 tempest-VolumesDeleteCascade-296710616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-1b4a2ab1-a499-4804-9b3b-2bd376660f04.653e0fb5-e4fc-4e1f-8599-4287df26fc8f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-1b4a2ab1-a499-4804-9b3b-2bd376660f04.c5c943ba-798f-4ab6-a182-ba56bc00a35e 1G" returned: 0 in 0.982s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:53:38 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-9bf20637-aa26-471f-bf87-e72e1e6a5970 tempest-VolumesDeleteCascade-296710616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b4a2ab1-a499-4804-9b3b-2bd376660f04.653e0fb5-e4fc-4e1f-8599-4287df26fc8f -F qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-1b4a2ab1-a499-4804-9b3b-2bd376660f04.c5c943ba-798f-4ab6-a182-ba56bc00a35e {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:53:38 devstack sudo[98286]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b4a2ab1-a499-4804-9b3b-2bd376660f04.653e0fb5-e4fc-4e1f-8599-4287df26fc8f -F qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-1b4a2ab1-a499-4804-9b3b-2bd376660f04.c5c943ba-798f-4ab6-a182-ba56bc00a35e
Jul 02 19:53:38 devstack sudo[98286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:53:39 devstack cinder-volume[86639]: DEBUG cinder.volume.flows.manager.create_volume [None req-31439714-4d3e-4608-9645-a38c606be9b2 tempest-GroupsV314Test-134590508 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 19:53:39 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-31439714-4d3e-4608-9645-a38c606be9b2 tempest-GroupsV314Test-134590508 None] Flow 'volume_create_manager' (05fbc882-fbec-43e2-b3f4-2481352157c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 19:53:39 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-31439714-4d3e-4608-9645-a38c606be9b2 tempest-GroupsV314Test-134590508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be2e4236-2f46-43b5-9bd7-5dd6fee2fe38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:53:39 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-31439714-4d3e-4608-9645-a38c606be9b2 tempest-GroupsV314Test-134590508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be2e4236-2f46-43b5-9bd7-5dd6fee2fe38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T17:53:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1248194289',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=8f278e6d-57b5-4e53-8c21-ecf32a8c4e34,host='devstack@QuobyteHD#QuobyteHD',id=8fee3096-61c1-4607-aac6-7b7fc78ef1fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdb5722620f8465780833761a3779b2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T17:53:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T17:53:39Z,use_quota=True,user_id='fb5a1c70e5fa4656890a391aca14aeae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63549298-3f90-4ce6-8733-c6573a847b43),volume_type_id=63549298-3f90-4ce6-8733-c6573a847b43)' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:53:39 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-31439714-4d3e-4608-9645-a38c606be9b2 tempest-GroupsV314Test-134590508 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e19df6c6-bad7-4ea3-81e3-c1e1588c261f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:53:39 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-31439714-4d3e-4608-9645-a38c606be9b2 tempest-GroupsV314Test-134590508 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e19df6c6-bad7-4ea3-81e3-c1e1588c261f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:53:39 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-31439714-4d3e-4608-9645-a38c606be9b2 tempest-GroupsV314Test-134590508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d69e3d5-b434-4b07-bb7b-9cb729bd1701) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:53:39 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-31439714-4d3e-4608-9645-a38c606be9b2 tempest-GroupsV314Test-134590508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d69e3d5-b434-4b07-bb7b-9cb729bd1701) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8fee3096-61c1-4607-aac6-7b7fc78ef1fb', 'volume_name': 'volume-8fee3096-61c1-4607-aac6-7b7fc78ef1fb', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:53:39 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-31439714-4d3e-4608-9645-a38c606be9b2 tempest-GroupsV314Test-134590508 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce16bb64-170d-4124-9a25-06cf2c1e1d4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:53:39 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-31439714-4d3e-4608-9645-a38c606be9b2 tempest-GroupsV314Test-134590508 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce16bb64-170d-4124-9a25-06cf2c1e1d4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:53:39 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-31439714-4d3e-4608-9645-a38c606be9b2 tempest-GroupsV314Test-134590508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (507fd48a-8391-43a8-a26d-a8621c21ce68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:53:39 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-31439714-4d3e-4608-9645-a38c606be9b2 tempest-GroupsV314Test-134590508 None] Volume 8fee3096-61c1-4607-aac6-7b7fc78ef1fb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8fee3096-61c1-4607-aac6-7b7fc78ef1fb', 'volume_size': 1}
Jul 02 19:53:39 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-31439714-4d3e-4608-9645-a38c606be9b2 tempest-GroupsV314Test-134590508 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:53:39 devstack sudo[98286]: pam_unix(sudo:session): session closed for user root
Jul 02 19:53:39 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-9bf20637-aa26-471f-bf87-e72e1e6a5970 tempest-VolumesDeleteCascade-296710616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b4a2ab1-a499-4804-9b3b-2bd376660f04.653e0fb5-e4fc-4e1f-8599-4287df26fc8f -F qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-1b4a2ab1-a499-4804-9b3b-2bd376660f04.c5c943ba-798f-4ab6-a182-ba56bc00a35e" returned: 0 in 0.936s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:53:39 devstack cinder-volume[86639]: WARNING cinder.volume.drivers.remotefs [None req-9bf20637-aa26-471f-bf87-e72e1e6a5970 tempest-VolumesDeleteCascade-296710616 None] /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-1b4a2ab1-a499-4804-9b3b-2bd376660f04.c5c943ba-798f-4ab6-a182-ba56bc00a35e is being set with open permissions: ugo+rw
Jul 02 19:53:39 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-9bf20637-aa26-471f-bf87-e72e1e6a5970 tempest-VolumesDeleteCascade-296710616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-1b4a2ab1-a499-4804-9b3b-2bd376660f04.c5c943ba-798f-4ab6-a182-ba56bc00a35e {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:53:39 devstack sudo[98292]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-1b4a2ab1-a499-4804-9b3b-2bd376660f04.c5c943ba-798f-4ab6-a182-ba56bc00a35e
Jul 02 19:53:39 devstack sudo[98292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:53:40 devstack sudo[98292]: pam_unix(sudo:session): session closed for user root
Jul 02 19:53:40 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-9bf20637-aa26-471f-bf87-e72e1e6a5970 tempest-VolumesDeleteCascade-296710616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-1b4a2ab1-a499-4804-9b3b-2bd376660f04.c5c943ba-798f-4ab6-a182-ba56bc00a35e" returned: 0 in 0.726s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:53:40 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-9bf20637-aa26-471f-bf87-e72e1e6a5970 tempest-VolumesDeleteCascade-296710616 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.810s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:53:40 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-31439714-4d3e-4608-9645-a38c606be9b2 tempest-GroupsV314Test-134590508 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.942s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:53:40 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-31439714-4d3e-4608-9645-a38c606be9b2 tempest-GroupsV314Test-134590508 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce906cb830>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=8f278e6d-57b5-4e53-8c21-ecf32a8c4e34,created_at=2026-07-02T17:53:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1248194289',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=8f278e6d-57b5-4e53-8c21-ecf32a8c4e34,host='devstack@QuobyteHD#QuobyteHD',id=8fee3096-61c1-4607-aac6-7b7fc78ef1fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdb5722620f8465780833761a3779b2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T17:53:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T17:53:39Z,use_quota=True,user_id='fb5a1c70e5fa4656890a391aca14aeae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63549298-3f90-4ce6-8733-c6573a847b43),volume_type_id=63549298-3f90-4ce6-8733-c6573a847b43)}" {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 19:53:40 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-31439714-4d3e-4608-9645-a38c606be9b2 tempest-GroupsV314Test-134590508 None] Creating volume 8fee3096-61c1-4607-aac6-7b7fc78ef1fb {{(pid=86639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 19:53:40 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-31439714-4d3e-4608-9645-a38c606be9b2 tempest-GroupsV314Test-134590508 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:53:40 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-31439714-4d3e-4608-9645-a38c606be9b2 tempest-GroupsV314Test-134590508 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:53:40 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-31439714-4d3e-4608-9645-a38c606be9b2 tempest-GroupsV314Test-134590508 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 19:53:40 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-31439714-4d3e-4608-9645-a38c606be9b2 tempest-GroupsV314Test-134590508 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 19:53:40 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-31439714-4d3e-4608-9645-a38c606be9b2 tempest-GroupsV314Test-134590508 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:53:40 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-31439714-4d3e-4608-9645-a38c606be9b2 tempest-GroupsV314Test-134590508 None] Selected osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92 as target Quobyte volume. {{(pid=86639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 19:53:40 devstack cinder-volume[86639]: INFO cinder.volume.drivers.remotefs [None req-31439714-4d3e-4608-9645-a38c606be9b2 tempest-GroupsV314Test-134590508 None] casted to osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92
Jul 02 19:53:40 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-31439714-4d3e-4608-9645-a38c606be9b2 tempest-GroupsV314Test-134590508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8fee3096-61c1-4607-aac6-7b7fc78ef1fb 1073741824 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:53:40 devstack sudo[98295]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8fee3096-61c1-4607-aac6-7b7fc78ef1fb 1073741824
Jul 02 19:53:40 devstack sudo[98295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:53:40 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-9bf20637-aa26-471f-bf87-e72e1e6a5970 tempest-VolumesDeleteCascade-296710616 None] Create snapshot completed successfully
Jul 02 19:53:41 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-7af71934-633e-4783-919f-d63620d056b2 tempest-VolumesDeleteCascade-296710616 None] Acquiring lock "cinder-1b4a2ab1-a499-4804-9b3b-2bd376660f04-delete_volume" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:53:41 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-7af71934-633e-4783-919f-d63620d056b2 tempest-VolumesDeleteCascade-296710616 None] Lock "cinder-1b4a2ab1-a499-4804-9b3b-2bd376660f04-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:53:41 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-7af71934-633e-4783-919f-d63620d056b2 tempest-VolumesDeleteCascade-296710616 None] Performing cascade delete. {{(pid=86639) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Jul 02 19:53:41 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-7af71934-633e-4783-919f-d63620d056b2 tempest-VolumesDeleteCascade-296710616 None] Acquiring lock "cinder-653e0fb5-e4fc-4e1f-8599-4287df26fc8f-delete_snapshot" by "delete_snapshot" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:53:41 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-7af71934-633e-4783-919f-d63620d056b2 tempest-VolumesDeleteCascade-296710616 None] Lock "cinder-653e0fb5-e4fc-4e1f-8599-4287df26fc8f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:53:41 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-7af71934-633e-4783-919f-d63620d056b2 tempest-VolumesDeleteCascade-296710616 None] Acquiring lock "cinder-quobyte-1b4a2ab1-a499-4804-9b3b-2bd376660f04" by "delete_snapshot" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:53:41 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-7af71934-633e-4783-919f-d63620d056b2 tempest-VolumesDeleteCascade-296710616 None] Lock "cinder-quobyte-1b4a2ab1-a499-4804-9b3b-2bd376660f04" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:53:41 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-7af71934-633e-4783-919f-d63620d056b2 tempest-VolumesDeleteCascade-296710616 None] Acquiring lock "cinder-quobyte-653e0fb5-e4fc-4e1f-8599-4287df26fc8f" by "_delete_snapshot" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:53:41 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-7af71934-633e-4783-919f-d63620d056b2 tempest-VolumesDeleteCascade-296710616 None] Lock "cinder-quobyte-653e0fb5-e4fc-4e1f-8599-4287df26fc8f" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:53:41 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-7af71934-633e-4783-919f-d63620d056b2 tempest-VolumesDeleteCascade-296710616 None] Deleting offline snapshot 653e0fb5-e4fc-4e1f-8599-4287df26fc8f of volume 1b4a2ab1-a499-4804-9b3b-2bd376660f04 {{(pid=86639) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 02 19:53:41 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-7af71934-633e-4783-919f-d63620d056b2 tempest-VolumesDeleteCascade-296710616 None] snapshot_file for this snap is: volume-1b4a2ab1-a499-4804-9b3b-2bd376660f04.653e0fb5-e4fc-4e1f-8599-4287df26fc8f {{(pid=86639) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 02 19:53:41 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce150a0e-9a5c-41a7-98bc-f97479c20817]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 19:53:41 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-7af71934-633e-4783-919f-d63620d056b2 tempest-VolumesDeleteCascade-296710616 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-1b4a2ab1-a499-4804-9b3b-2bd376660f04.653e0fb5-e4fc-4e1f-8599-4287df26fc8f {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:53:41 devstack sudo[98297]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-1b4a2ab1-a499-4804-9b3b-2bd376660f04.653e0fb5-e4fc-4e1f-8599-4287df26fc8f
Jul 02 19:53:41 devstack sudo[98297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:53:41 devstack cinder-volume[86639]: DEBUG oslo_service.periodic_task [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86639) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 02 19:53:41 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:53:41 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:53:41 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 19:53:41 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 19:53:41 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:53:41 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:53:41 devstack sudo[98303]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e
Jul 02 19:53:41 devstack sudo[98303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:53:41 devstack sudo[98295]: pam_unix(sudo:session): session closed for user root
Jul 02 19:53:41 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-31439714-4d3e-4608-9645-a38c606be9b2 tempest-GroupsV314Test-134590508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8fee3096-61c1-4607-aac6-7b7fc78ef1fb 1073741824" returned: 0 in 1.038s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:53:41 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-31439714-4d3e-4608-9645-a38c606be9b2 tempest-GroupsV314Test-134590508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8fee3096-61c1-4607-aac6-7b7fc78ef1fb {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:53:41 devstack sudo[98305]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8fee3096-61c1-4607-aac6-7b7fc78ef1fb
Jul 02 19:53:41 devstack sudo[98305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:53:42 devstack sudo[98297]: pam_unix(sudo:session): session closed for user root
Jul 02 19:53:42 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-7af71934-633e-4783-919f-d63620d056b2 tempest-VolumesDeleteCascade-296710616 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-1b4a2ab1-a499-4804-9b3b-2bd376660f04.653e0fb5-e4fc-4e1f-8599-4287df26fc8f" returned: 0 in 1.028s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:53:42 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-7af71934-633e-4783-919f-d63620d056b2 tempest-VolumesDeleteCascade-296710616 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1b4a2ab1-a499-4804-9b3b-2bd376660f04(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86639) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 02 19:53:42 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[898fc2e5-377f-4eb3-addb-655d233dbbbf]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 19:53:42 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-7af71934-633e-4783-919f-d63620d056b2 tempest-VolumesDeleteCascade-296710616 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-1b4a2ab1-a499-4804-9b3b-2bd376660f04 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:53:42 devstack sudo[98310]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-1b4a2ab1-a499-4804-9b3b-2bd376660f04
Jul 02 19:53:42 devstack sudo[98310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:53:42 devstack sudo[98303]: pam_unix(sudo:session): session closed for user root
Jul 02 19:53:42 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e" returned: 0 in 0.909s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:53:42 devstack cinder-volume[86639]: DEBUG cinder.manager [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] Notifying Schedulers of capabilities ... {{(pid=86639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 19:53:42 devstack cinder-volume[86639]: DEBUG oslo_service.periodic_task [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] Running periodic task VolumeManager._thread_info {{(pid=86639) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 02 19:53:42 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] thread count: 28 {{(pid=86639) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 02 19:53:42 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] thread info: [<_MainThread(MainThread, started 140525261275264)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 140525150678016)>, <Thread(Thread-3 (stat_writer), started daemon 140525150025920)>, <Thread(Rabbit-heartbeat, started daemon 140525150500864)>, <Thread(Thread-5 (_runner), started daemon 140525149847296)>, <Thread(Thread-7 (_runner), started daemon 140525149863424)>, <Thread(fd_logger, started daemon 140525146589376)>, <Thread(privsep_reader, started daemon 140525144562432)>, <Thread(tpool_thread_0, started daemon 140525137151680)>, <Thread(tpool_thread_1, started daemon 140525128758976)>, <Thread(tpool_thread_2, started daemon 140525120349888)>, <Thread(tpool_thread_3, started daemon 140525111940800)>, <Thread(tpool_thread_4, started daemon 140525103531712)>, <Thread(tpool_thread_5, started daemon 140525095122624)>, <Thread(tpool_thread_6, started daemon 140525086713536)>, <Thread(tpool_thread_7, started daemon 140525078304448)>, <Thread(tpool_thread_8, started daemon 140525069895360)>, <Thread(tpool_thread_9, started daemon 140525061486272)>, <Thread(tpool_thread_10, started daemon 140525053077184)>, <Thread(tpool_thread_11, started daemon 140525044668096)>, <Thread(tpool_thread_12, started daemon 140525036259008)>, <Thread(tpool_thread_13, started daemon 140525027849920)>, <Thread(tpool_thread_14, started daemon 140525019440832)>, <Thread(tpool_thread_15, started daemon 140525011031744)>, <Thread(tpool_thread_16, started daemon 140525002622656)>, <Thread(tpool_thread_17, started daemon 140524994213568)>, <Thread(tpool_thread_18, started daemon 140524985804480)>, <Thread(tpool_thread_19, started daemon 140524977395392)>] {{(pid=86639) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 02 19:53:42 devstack sudo[98305]: pam_unix(sudo:session): session closed for user root
Jul 02 19:53:42 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-31439714-4d3e-4608-9645-a38c606be9b2 tempest-GroupsV314Test-134590508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8fee3096-61c1-4607-aac6-7b7fc78ef1fb" returned: 0 in 0.944s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:53:42 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-31439714-4d3e-4608-9645-a38c606be9b2 tempest-GroupsV314Test-134590508 None] <== create_volume: return (2041ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'} {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 19:53:42 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-31439714-4d3e-4608-9645-a38c606be9b2 tempest-GroupsV314Test-134590508 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.047s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:53:42 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-31439714-4d3e-4608-9645-a38c606be9b2 tempest-GroupsV314Test-134590508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (507fd48a-8391-43a8-a26d-a8621c21ce68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8fee3096-61c1-4607-aac6-7b7fc78ef1fb', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:53:42 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-31439714-4d3e-4608-9645-a38c606be9b2 tempest-GroupsV314Test-134590508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f612f792-9cb5-4786-b541-d9951bea2b97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:53:42 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-31439714-4d3e-4608-9645-a38c606be9b2 tempest-GroupsV314Test-134590508 None] Volume volume-8fee3096-61c1-4607-aac6-7b7fc78ef1fb (8fee3096-61c1-4607-aac6-7b7fc78ef1fb): created successfully
Jul 02 19:53:42 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-31439714-4d3e-4608-9645-a38c606be9b2 tempest-GroupsV314Test-134590508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f612f792-9cb5-4786-b541-d9951bea2b97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:53:42 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-31439714-4d3e-4608-9645-a38c606be9b2 tempest-GroupsV314Test-134590508 None] Flow 'volume_create_manager' (05fbc882-fbec-43e2-b3f4-2481352157c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 19:53:42 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-31439714-4d3e-4608-9645-a38c606be9b2 tempest-GroupsV314Test-134590508 None] Created volume successfully.
Jul 02 19:53:43 devstack sudo[98310]: pam_unix(sudo:session): session closed for user root
Jul 02 19:53:43 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-7af71934-633e-4783-919f-d63620d056b2 tempest-VolumesDeleteCascade-296710616 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-1b4a2ab1-a499-4804-9b3b-2bd376660f04" returned: 0 in 0.851s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:53:43 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5fff06a-b28b-4f0c-9f4d-786abd06d7a3]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 19:53:43 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-7af71934-633e-4783-919f-d63620d056b2 tempest-VolumesDeleteCascade-296710616 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-1b4a2ab1-a499-4804-9b3b-2bd376660f04.c5c943ba-798f-4ab6-a182-ba56bc00a35e {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:53:43 devstack sudo[98317]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-1b4a2ab1-a499-4804-9b3b-2bd376660f04.c5c943ba-798f-4ab6-a182-ba56bc00a35e
Jul 02 19:53:43 devstack sudo[98317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:53:44 devstack sudo[98317]: pam_unix(sudo:session): session closed for user root
Jul 02 19:53:44 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-7af71934-633e-4783-919f-d63620d056b2 tempest-VolumesDeleteCascade-296710616 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-1b4a2ab1-a499-4804-9b3b-2bd376660f04.c5c943ba-798f-4ab6-a182-ba56bc00a35e" returned: 0 in 0.867s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:53:44 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-7af71934-633e-4783-919f-d63620d056b2 tempest-VolumesDeleteCascade-296710616 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1b4a2ab1-a499-4804-9b3b-2bd376660f04(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86639) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 02 19:53:44 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[adf05387-b512-4ab8-afef-059dad1a905d]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 19:53:44 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-7af71934-633e-4783-919f-d63620d056b2 tempest-VolumesDeleteCascade-296710616 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-1b4a2ab1-a499-4804-9b3b-2bd376660f04.653e0fb5-e4fc-4e1f-8599-4287df26fc8f {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:53:44 devstack sudo[98323]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-1b4a2ab1-a499-4804-9b3b-2bd376660f04.653e0fb5-e4fc-4e1f-8599-4287df26fc8f
Jul 02 19:53:44 devstack sudo[98323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:53:44 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-7986ba03-cb09-4c3e-8f28-ed5dd22c97b9 tempest-GroupsV314Test-134590508 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:53:44 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-7986ba03-cb09-4c3e-8f28-ed5dd22c97b9 tempest-GroupsV314Test-134590508 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:53:44 devstack cinder-volume[86639]: INFO cinder.volume.drivers.remotefs [None req-7986ba03-cb09-4c3e-8f28-ed5dd22c97b9 tempest-GroupsV314Test-134590508 None] Cloning volume 8fee3096-61c1-4607-aac6-7b7fc78ef1fb to volume 2dbf5b1f-d56f-4ccd-82a4-4fd5cc21b92b
Jul 02 19:53:44 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-7986ba03-cb09-4c3e-8f28-ed5dd22c97b9 tempest-GroupsV314Test-134590508 None] Creating offline snapshot 79ec9dad-ab69-49ad-aea9-581bd38b8246 of volume 8fee3096-61c1-4607-aac6-7b7fc78ef1fb {{(pid=86639) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 02 19:53:44 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a7f7176-a069-4bd1-aaf6-03c1ef3e93e7]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 19:53:44 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-7986ba03-cb09-4c3e-8f28-ed5dd22c97b9 tempest-GroupsV314Test-134590508 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8fee3096-61c1-4607-aac6-7b7fc78ef1fb {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:53:44 devstack sudo[98325]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8fee3096-61c1-4607-aac6-7b7fc78ef1fb
Jul 02 19:53:44 devstack sudo[98325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:53:45 devstack sudo[98323]: pam_unix(sudo:session): session closed for user root
Jul 02 19:53:45 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-7af71934-633e-4783-919f-d63620d056b2 tempest-VolumesDeleteCascade-296710616 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-1b4a2ab1-a499-4804-9b3b-2bd376660f04.653e0fb5-e4fc-4e1f-8599-4287df26fc8f" returned: 0 in 1.086s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:53:45 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-7af71934-633e-4783-919f-d63620d056b2 tempest-VolumesDeleteCascade-296710616 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1b4a2ab1-a499-4804-9b3b-2bd376660f04(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86639) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 02 19:53:45 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f8e52e9-f222-4ed8-9154-7214547aaf99]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 19:53:45 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-7af71934-633e-4783-919f-d63620d056b2 tempest-VolumesDeleteCascade-296710616 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-1b4a2ab1-a499-4804-9b3b-2bd376660f04 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:53:45 devstack sudo[98330]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-1b4a2ab1-a499-4804-9b3b-2bd376660f04
Jul 02 19:53:45 devstack sudo[98330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:53:45 devstack sudo[98325]: pam_unix(sudo:session): session closed for user root
Jul 02 19:53:45 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-7986ba03-cb09-4c3e-8f28-ed5dd22c97b9 tempest-GroupsV314Test-134590508 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8fee3096-61c1-4607-aac6-7b7fc78ef1fb" returned: 0 in 1.070s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:53:45 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-7986ba03-cb09-4c3e-8f28-ed5dd22c97b9 tempest-GroupsV314Test-134590508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8fee3096-61c1-4607-aac6-7b7fc78ef1fb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8fee3096-61c1-4607-aac6-7b7fc78ef1fb.79ec9dad-ab69-49ad-aea9-581bd38b8246 1G {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:53:45 devstack sudo[98335]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8fee3096-61c1-4607-aac6-7b7fc78ef1fb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8fee3096-61c1-4607-aac6-7b7fc78ef1fb.79ec9dad-ab69-49ad-aea9-581bd38b8246 1G
Jul 02 19:53:45 devstack sudo[98335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:53:46 devstack sudo[98330]: pam_unix(sudo:session): session closed for user root
Jul 02 19:53:46 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-7af71934-633e-4783-919f-d63620d056b2 tempest-VolumesDeleteCascade-296710616 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-1b4a2ab1-a499-4804-9b3b-2bd376660f04" returned: 0 in 0.893s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:53:46 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-7af71934-633e-4783-919f-d63620d056b2 tempest-VolumesDeleteCascade-296710616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-1b4a2ab1-a499-4804-9b3b-2bd376660f04.653e0fb5-e4fc-4e1f-8599-4287df26fc8f {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:53:46 devstack sudo[98340]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-1b4a2ab1-a499-4804-9b3b-2bd376660f04.653e0fb5-e4fc-4e1f-8599-4287df26fc8f
Jul 02 19:53:46 devstack sudo[98340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:53:46 devstack sudo[98335]: pam_unix(sudo:session): session closed for user root
Jul 02 19:53:46 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-7986ba03-cb09-4c3e-8f28-ed5dd22c97b9 tempest-GroupsV314Test-134590508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8fee3096-61c1-4607-aac6-7b7fc78ef1fb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8fee3096-61c1-4607-aac6-7b7fc78ef1fb.79ec9dad-ab69-49ad-aea9-581bd38b8246 1G" returned: 0 in 0.907s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:53:46 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-7986ba03-cb09-4c3e-8f28-ed5dd22c97b9 tempest-GroupsV314Test-134590508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8fee3096-61c1-4607-aac6-7b7fc78ef1fb -F qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8fee3096-61c1-4607-aac6-7b7fc78ef1fb.79ec9dad-ab69-49ad-aea9-581bd38b8246 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:53:46 devstack sudo[98346]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8fee3096-61c1-4607-aac6-7b7fc78ef1fb -F qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8fee3096-61c1-4607-aac6-7b7fc78ef1fb.79ec9dad-ab69-49ad-aea9-581bd38b8246
Jul 02 19:53:46 devstack sudo[98346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:53:47 devstack sudo[98340]: pam_unix(sudo:session): session closed for user root
Jul 02 19:53:47 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-7af71934-633e-4783-919f-d63620d056b2 tempest-VolumesDeleteCascade-296710616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-1b4a2ab1-a499-4804-9b3b-2bd376660f04.653e0fb5-e4fc-4e1f-8599-4287df26fc8f" returned: 0 in 0.922s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:53:47 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-7af71934-633e-4783-919f-d63620d056b2 tempest-VolumesDeleteCascade-296710616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-1b4a2ab1-a499-4804-9b3b-2bd376660f04.653e0fb5-e4fc-4e1f-8599-4287df26fc8f {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:53:47 devstack sudo[98352]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-1b4a2ab1-a499-4804-9b3b-2bd376660f04.653e0fb5-e4fc-4e1f-8599-4287df26fc8f
Jul 02 19:53:47 devstack sudo[98352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:53:47 devstack sudo[98346]: pam_unix(sudo:session): session closed for user root
Jul 02 19:53:47 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-7986ba03-cb09-4c3e-8f28-ed5dd22c97b9 tempest-GroupsV314Test-134590508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8fee3096-61c1-4607-aac6-7b7fc78ef1fb -F qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8fee3096-61c1-4607-aac6-7b7fc78ef1fb.79ec9dad-ab69-49ad-aea9-581bd38b8246" returned: 0 in 0.838s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:53:47 devstack cinder-volume[86639]: WARNING cinder.volume.drivers.remotefs [None req-7986ba03-cb09-4c3e-8f28-ed5dd22c97b9 tempest-GroupsV314Test-134590508 None] /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8fee3096-61c1-4607-aac6-7b7fc78ef1fb.79ec9dad-ab69-49ad-aea9-581bd38b8246 is being set with open permissions: ugo+rw: NotImplementedError
Jul 02 19:53:47 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-7986ba03-cb09-4c3e-8f28-ed5dd22c97b9 tempest-GroupsV314Test-134590508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8fee3096-61c1-4607-aac6-7b7fc78ef1fb.79ec9dad-ab69-49ad-aea9-581bd38b8246 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:53:47 devstack sudo[98358]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8fee3096-61c1-4607-aac6-7b7fc78ef1fb.79ec9dad-ab69-49ad-aea9-581bd38b8246
Jul 02 19:53:47 devstack sudo[98358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:53:47 devstack sudo[98352]: pam_unix(sudo:session): session closed for user root
Jul 02 19:53:47 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-7af71934-633e-4783-919f-d63620d056b2 tempest-VolumesDeleteCascade-296710616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-1b4a2ab1-a499-4804-9b3b-2bd376660f04.653e0fb5-e4fc-4e1f-8599-4287df26fc8f" returned: 0 in 0.893s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:53:47 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-7af71934-633e-4783-919f-d63620d056b2 tempest-VolumesDeleteCascade-296710616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b4a2ab1-a499-4804-9b3b-2bd376660f04 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-1b4a2ab1-a499-4804-9b3b-2bd376660f04.c5c943ba-798f-4ab6-a182-ba56bc00a35e -F qcow2 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:53:47 devstack sudo[98361]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b4a2ab1-a499-4804-9b3b-2bd376660f04 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-1b4a2ab1-a499-4804-9b3b-2bd376660f04.c5c943ba-798f-4ab6-a182-ba56bc00a35e -F qcow2
Jul 02 19:53:47 devstack sudo[98361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:53:48 devstack sudo[98358]: pam_unix(sudo:session): session closed for user root
Jul 02 19:53:48 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-7986ba03-cb09-4c3e-8f28-ed5dd22c97b9 tempest-GroupsV314Test-134590508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8fee3096-61c1-4607-aac6-7b7fc78ef1fb.79ec9dad-ab69-49ad-aea9-581bd38b8246" returned: 0 in 0.806s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:53:48 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-7986ba03-cb09-4c3e-8f28-ed5dd22c97b9 tempest-GroupsV314Test-134590508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8fee3096-61c1-4607-aac6-7b7fc78ef1fb.info {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:53:48 devstack sudo[98364]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8fee3096-61c1-4607-aac6-7b7fc78ef1fb.info
Jul 02 19:53:48 devstack sudo[98364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:53:48 devstack sudo[98361]: pam_unix(sudo:session): session closed for user root
Jul 02 19:53:48 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-7af71934-633e-4783-919f-d63620d056b2 tempest-VolumesDeleteCascade-296710616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b4a2ab1-a499-4804-9b3b-2bd376660f04 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-1b4a2ab1-a499-4804-9b3b-2bd376660f04.c5c943ba-798f-4ab6-a182-ba56bc00a35e -F qcow2" returned: 0 in 0.857s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:53:48 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-7af71934-633e-4783-919f-d63620d056b2 tempest-VolumesDeleteCascade-296710616 None] Lock "cinder-quobyte-653e0fb5-e4fc-4e1f-8599-4287df26fc8f" released by "_delete_snapshot" :: held 7.636s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:53:48 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-7af71934-633e-4783-919f-d63620d056b2 tempest-VolumesDeleteCascade-296710616 None] Lock "cinder-quobyte-1b4a2ab1-a499-4804-9b3b-2bd376660f04" released by "delete_snapshot" :: held 7.663s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:53:48 devstack cinder-volume[86639]: DEBUG cinder.quota [None req-7af71934-633e-4783-919f-d63620d056b2 tempest-VolumesDeleteCascade-296710616 None] Created reservations ['4a8c9644-2bd7-49af-8d01-79711cf9438c', '0d29736f-70c5-4586-8e9f-c6e72491fc00', 'c79066f8-8189-4170-a4f8-cb3102ae9eb0', 'c4f61b5d-ad36-44b5-967c-254d14ecf381'] {{(pid=86639) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 19:53:48 devstack sudo[98364]: pam_unix(sudo:session): session closed for user root
Jul 02 19:53:48 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-7986ba03-cb09-4c3e-8f28-ed5dd22c97b9 tempest-GroupsV314Test-134590508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8fee3096-61c1-4607-aac6-7b7fc78ef1fb.info" returned: 0 in 0.750s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:53:48 devstack cinder-volume[86639]: WARNING cinder.volume.drivers.remotefs [None req-7986ba03-cb09-4c3e-8f28-ed5dd22c97b9 tempest-GroupsV314Test-134590508 None] /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8fee3096-61c1-4607-aac6-7b7fc78ef1fb.info is being set with open permissions: ugo+rw: NotImplementedError
Jul 02 19:53:48 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-7986ba03-cb09-4c3e-8f28-ed5dd22c97b9 tempest-GroupsV314Test-134590508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8fee3096-61c1-4607-aac6-7b7fc78ef1fb.info {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:53:48 devstack sudo[98371]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8fee3096-61c1-4607-aac6-7b7fc78ef1fb.info
Jul 02 19:53:48 devstack sudo[98371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:53:48 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-7af71934-633e-4783-919f-d63620d056b2 tempest-VolumesDeleteCascade-296710616 None] Delete snapshot completed successfully.
Jul 02 19:53:49 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-7af71934-633e-4783-919f-d63620d056b2 tempest-VolumesDeleteCascade-296710616 None] Lock "cinder-653e0fb5-e4fc-4e1f-8599-4287df26fc8f-delete_snapshot" released by "delete_snapshot" :: held 7.895s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:53:49 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-7af71934-633e-4783-919f-d63620d056b2 tempest-VolumesDeleteCascade-296710616 None] Acquiring lock "cinder-c5c943ba-798f-4ab6-a182-ba56bc00a35e-delete_snapshot" by "delete_snapshot" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:53:49 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-7af71934-633e-4783-919f-d63620d056b2 tempest-VolumesDeleteCascade-296710616 None] Lock "cinder-c5c943ba-798f-4ab6-a182-ba56bc00a35e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:53:49 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-7af71934-633e-4783-919f-d63620d056b2 tempest-VolumesDeleteCascade-296710616 None] Acquiring lock "cinder-quobyte-1b4a2ab1-a499-4804-9b3b-2bd376660f04" by "delete_snapshot" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:53:49 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-7af71934-633e-4783-919f-d63620d056b2 tempest-VolumesDeleteCascade-296710616 None] Lock "cinder-quobyte-1b4a2ab1-a499-4804-9b3b-2bd376660f04" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:53:49 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-7af71934-633e-4783-919f-d63620d056b2 tempest-VolumesDeleteCascade-296710616 None] Acquiring lock "cinder-quobyte-c5c943ba-798f-4ab6-a182-ba56bc00a35e" by "_delete_snapshot" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:53:49 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-7af71934-633e-4783-919f-d63620d056b2 tempest-VolumesDeleteCascade-296710616 None] Lock "cinder-quobyte-c5c943ba-798f-4ab6-a182-ba56bc00a35e" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:53:49 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-7af71934-633e-4783-919f-d63620d056b2 tempest-VolumesDeleteCascade-296710616 None] Deleting offline snapshot c5c943ba-798f-4ab6-a182-ba56bc00a35e of volume 1b4a2ab1-a499-4804-9b3b-2bd376660f04 {{(pid=86639) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 02 19:53:49 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-7af71934-633e-4783-919f-d63620d056b2 tempest-VolumesDeleteCascade-296710616 None] snapshot_file for this snap is: volume-1b4a2ab1-a499-4804-9b3b-2bd376660f04.c5c943ba-798f-4ab6-a182-ba56bc00a35e {{(pid=86639) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 02 19:53:49 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[00a7fb6f-6139-425f-8ef1-d06803421247]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 19:53:49 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-7af71934-633e-4783-919f-d63620d056b2 tempest-VolumesDeleteCascade-296710616 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-1b4a2ab1-a499-4804-9b3b-2bd376660f04.c5c943ba-798f-4ab6-a182-ba56bc00a35e {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:53:49 devstack sudo[98373]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-1b4a2ab1-a499-4804-9b3b-2bd376660f04.c5c943ba-798f-4ab6-a182-ba56bc00a35e
Jul 02 19:53:49 devstack sudo[98373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:53:49 devstack sudo[98371]: pam_unix(sudo:session): session closed for user root
Jul 02 19:53:49 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-7986ba03-cb09-4c3e-8f28-ed5dd22c97b9 tempest-GroupsV314Test-134590508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8fee3096-61c1-4607-aac6-7b7fc78ef1fb.info" returned: 0 in 0.786s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:53:49 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-7986ba03-cb09-4c3e-8f28-ed5dd22c97b9 tempest-GroupsV314Test-134590508 None] Acquiring lock "cinder-quobyte-2dbf5b1f-d56f-4ccd-82a4-4fd5cc21b92b" by "_copy_volume_from_snapshot" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:53:49 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-7986ba03-cb09-4c3e-8f28-ed5dd22c97b9 tempest-GroupsV314Test-134590508 None] Lock "cinder-quobyte-2dbf5b1f-d56f-4ccd-82a4-4fd5cc21b92b" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:53:49 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-7986ba03-cb09-4c3e-8f28-ed5dd22c97b9 tempest-GroupsV314Test-134590508 None] snapshot: 79ec9dad-ab69-49ad-aea9-581bd38b8246, volume: 2dbf5b1f-d56f-4ccd-82a4-4fd5cc21b92b,  {{(pid=86639) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jul 02 19:53:49 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-7986ba03-cb09-4c3e-8f28-ed5dd22c97b9 tempest-GroupsV314Test-134590508 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:53:49 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-7986ba03-cb09-4c3e-8f28-ed5dd22c97b9 tempest-GroupsV314Test-134590508 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:53:49 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-7986ba03-cb09-4c3e-8f28-ed5dd22c97b9 tempest-GroupsV314Test-134590508 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 19:53:49 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-7986ba03-cb09-4c3e-8f28-ed5dd22c97b9 tempest-GroupsV314Test-134590508 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 19:53:49 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-7986ba03-cb09-4c3e-8f28-ed5dd22c97b9 tempest-GroupsV314Test-134590508 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:53:49 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[06f16bce-b826-4c1b-b73a-87e4d005319e]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 19:53:49 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-7986ba03-cb09-4c3e-8f28-ed5dd22c97b9 tempest-GroupsV314Test-134590508 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8fee3096-61c1-4607-aac6-7b7fc78ef1fb.79ec9dad-ab69-49ad-aea9-581bd38b8246 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:53:49 devstack sudo[98376]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8fee3096-61c1-4607-aac6-7b7fc78ef1fb.79ec9dad-ab69-49ad-aea9-581bd38b8246
Jul 02 19:53:49 devstack sudo[98376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:53:50 devstack sudo[98373]: pam_unix(sudo:session): session closed for user root
Jul 02 19:53:50 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-7af71934-633e-4783-919f-d63620d056b2 tempest-VolumesDeleteCascade-296710616 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-1b4a2ab1-a499-4804-9b3b-2bd376660f04.c5c943ba-798f-4ab6-a182-ba56bc00a35e" returned: 0 in 0.951s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:53:50 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-7af71934-633e-4783-919f-d63620d056b2 tempest-VolumesDeleteCascade-296710616 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1b4a2ab1-a499-4804-9b3b-2bd376660f04(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86639) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 02 19:53:50 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[68e35f67-16eb-4662-8b7d-b7a9b360ea5b]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 19:53:50 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-7af71934-633e-4783-919f-d63620d056b2 tempest-VolumesDeleteCascade-296710616 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-1b4a2ab1-a499-4804-9b3b-2bd376660f04 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:53:50 devstack sudo[98381]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-1b4a2ab1-a499-4804-9b3b-2bd376660f04
Jul 02 19:53:50 devstack sudo[98381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:53:50 devstack sudo[98376]: pam_unix(sudo:session): session closed for user root
Jul 02 19:53:50 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-7986ba03-cb09-4c3e-8f28-ed5dd22c97b9 tempest-GroupsV314Test-134590508 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8fee3096-61c1-4607-aac6-7b7fc78ef1fb.79ec9dad-ab69-49ad-aea9-581bd38b8246" returned: 0 in 0.903s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:53:50 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-7986ba03-cb09-4c3e-8f28-ed5dd22c97b9 tempest-GroupsV314Test-134590508 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8fee3096-61c1-4607-aac6-7b7fc78ef1fb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86639) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 02 19:53:50 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-7986ba03-cb09-4c3e-8f28-ed5dd22c97b9 tempest-GroupsV314Test-134590508 None] will copy from snapshot at /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8fee3096-61c1-4607-aac6-7b7fc78ef1fb {{(pid=86639) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jul 02 19:53:50 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-7986ba03-cb09-4c3e-8f28-ed5dd22c97b9 tempest-GroupsV314Test-134590508 None] Creating direct copy from snapshot {{(pid=86639) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jul 02 19:53:50 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[36b68fdf-b639-46b3-b42f-41745e8977b5]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 19:53:50 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-7986ba03-cb09-4c3e-8f28-ed5dd22c97b9 tempest-GroupsV314Test-134590508 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8fee3096-61c1-4607-aac6-7b7fc78ef1fb {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:53:50 devstack sudo[98387]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8fee3096-61c1-4607-aac6-7b7fc78ef1fb
Jul 02 19:53:50 devstack sudo[98387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:53:51 devstack sudo[98381]: pam_unix(sudo:session): session closed for user root
Jul 02 19:53:51 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-7af71934-633e-4783-919f-d63620d056b2 tempest-VolumesDeleteCascade-296710616 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-1b4a2ab1-a499-4804-9b3b-2bd376660f04" returned: 0 in 0.890s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:53:51 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-7af71934-633e-4783-919f-d63620d056b2 tempest-VolumesDeleteCascade-296710616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-1b4a2ab1-a499-4804-9b3b-2bd376660f04.c5c943ba-798f-4ab6-a182-ba56bc00a35e {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:53:51 devstack sudo[98392]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-1b4a2ab1-a499-4804-9b3b-2bd376660f04.c5c943ba-798f-4ab6-a182-ba56bc00a35e
Jul 02 19:53:51 devstack sudo[98392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:53:51 devstack sudo[98387]: pam_unix(sudo:session): session closed for user root
Jul 02 19:53:51 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-7986ba03-cb09-4c3e-8f28-ed5dd22c97b9 tempest-GroupsV314Test-134590508 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8fee3096-61c1-4607-aac6-7b7fc78ef1fb" returned: 0 in 0.885s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:53:51 devstack cinder-volume[86639]: DEBUG cinder.utils [None req-7986ba03-cb09-4c3e-8f28-ed5dd22c97b9 tempest-GroupsV314Test-134590508 None] Path /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-2dbf5b1f-d56f-4ccd-82a4-4fd5cc21b92b not found in is_blk_device check {{(pid=86639) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 02 19:53:51 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-7986ba03-cb09-4c3e-8f28-ed5dd22c97b9 tempest-GroupsV314Test-134590508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8fee3096-61c1-4607-aac6-7b7fc78ef1fb /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-2dbf5b1f-d56f-4ccd-82a4-4fd5cc21b92b {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:53:51 devstack sudo[98399]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8fee3096-61c1-4607-aac6-7b7fc78ef1fb /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-2dbf5b1f-d56f-4ccd-82a4-4fd5cc21b92b
Jul 02 19:53:51 devstack sudo[98399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:53:51 devstack sudo[98392]: pam_unix(sudo:session): session closed for user root
Jul 02 19:53:51 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-7af71934-633e-4783-919f-d63620d056b2 tempest-VolumesDeleteCascade-296710616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-1b4a2ab1-a499-4804-9b3b-2bd376660f04.c5c943ba-798f-4ab6-a182-ba56bc00a35e" returned: 0 in 0.834s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:53:51 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-7af71934-633e-4783-919f-d63620d056b2 tempest-VolumesDeleteCascade-296710616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-1b4a2ab1-a499-4804-9b3b-2bd376660f04.c5c943ba-798f-4ab6-a182-ba56bc00a35e {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:53:51 devstack sudo[98403]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-1b4a2ab1-a499-4804-9b3b-2bd376660f04.c5c943ba-798f-4ab6-a182-ba56bc00a35e
Jul 02 19:53:51 devstack sudo[98403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:53:52 devstack sudo[98403]: pam_unix(sudo:session): session closed for user root
Jul 02 19:53:52 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-7af71934-633e-4783-919f-d63620d056b2 tempest-VolumesDeleteCascade-296710616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-1b4a2ab1-a499-4804-9b3b-2bd376660f04.c5c943ba-798f-4ab6-a182-ba56bc00a35e" returned: 0 in 0.811s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:53:52 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-7af71934-633e-4783-919f-d63620d056b2 tempest-VolumesDeleteCascade-296710616 None] Lock "cinder-quobyte-c5c943ba-798f-4ab6-a182-ba56bc00a35e" released by "_delete_snapshot" :: held 3.610s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:53:52 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-7af71934-633e-4783-919f-d63620d056b2 tempest-VolumesDeleteCascade-296710616 None] Lock "cinder-quobyte-1b4a2ab1-a499-4804-9b3b-2bd376660f04" released by "delete_snapshot" :: held 3.641s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:53:52 devstack cinder-volume[86639]: DEBUG cinder.quota [None req-7af71934-633e-4783-919f-d63620d056b2 tempest-VolumesDeleteCascade-296710616 None] Created reservations ['bf422603-adef-41f3-baae-89948ab036fd', '8776d9db-ff0a-4251-8277-349c9f9f6a8a', '9f467b9f-c31c-421a-8a1b-b20a41427b15', '531fac93-5159-4766-b997-3a12d629dc32'] {{(pid=86639) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 19:53:52 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-7af71934-633e-4783-919f-d63620d056b2 tempest-VolumesDeleteCascade-296710616 None] Delete snapshot completed successfully.
Jul 02 19:53:52 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-7af71934-633e-4783-919f-d63620d056b2 tempest-VolumesDeleteCascade-296710616 None] Lock "cinder-c5c943ba-798f-4ab6-a182-ba56bc00a35e-delete_snapshot" released by "delete_snapshot" :: held 3.897s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:53:52 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-7af71934-633e-4783-919f-d63620d056b2 tempest-VolumesDeleteCascade-296710616 None] Snapshots deleted, issuing volume delete {{(pid=86639) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Jul 02 19:53:52 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-7af71934-633e-4783-919f-d63620d056b2 tempest-VolumesDeleteCascade-296710616 None] Acquiring lock "cinder-quobyte-1b4a2ab1-a499-4804-9b3b-2bd376660f04" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:53:52 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-7af71934-633e-4783-919f-d63620d056b2 tempest-VolumesDeleteCascade-296710616 None] Lock "cinder-quobyte-1b4a2ab1-a499-4804-9b3b-2bd376660f04" acquired by "delete_volume" :: waited 0.040s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:53:53 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[f04aeed6-ba0c-4815-bd02-b542b1609a3f]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 19:53:53 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-7af71934-633e-4783-919f-d63620d056b2 tempest-VolumesDeleteCascade-296710616 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-1b4a2ab1-a499-4804-9b3b-2bd376660f04 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:53:53 devstack sudo[98418]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-1b4a2ab1-a499-4804-9b3b-2bd376660f04
Jul 02 19:53:53 devstack sudo[98418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:53:55 devstack sudo[98418]: pam_unix(sudo:session): session closed for user root
Jul 02 19:53:55 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-7af71934-633e-4783-919f-d63620d056b2 tempest-VolumesDeleteCascade-296710616 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-1b4a2ab1-a499-4804-9b3b-2bd376660f04" returned: 0 in 2.462s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:53:55 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-7af71934-633e-4783-919f-d63620d056b2 tempest-VolumesDeleteCascade-296710616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-1b4a2ab1-a499-4804-9b3b-2bd376660f04 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:53:55 devstack sudo[98427]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-1b4a2ab1-a499-4804-9b3b-2bd376660f04
Jul 02 19:53:55 devstack sudo[98427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:53:57 devstack sudo[98427]: pam_unix(sudo:session): session closed for user root
Jul 02 19:53:57 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-7af71934-633e-4783-919f-d63620d056b2 tempest-VolumesDeleteCascade-296710616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-1b4a2ab1-a499-4804-9b3b-2bd376660f04" returned: 0 in 1.617s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:53:57 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-7af71934-633e-4783-919f-d63620d056b2 tempest-VolumesDeleteCascade-296710616 None] Lock "cinder-quobyte-1b4a2ab1-a499-4804-9b3b-2bd376660f04" released by "delete_volume" :: held 4.246s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:53:57 devstack cinder-volume[86639]: DEBUG cinder.quota [None req-7af71934-633e-4783-919f-d63620d056b2 tempest-VolumesDeleteCascade-296710616 None] Created reservations ['dca6a77a-e728-4c9f-99dd-1f486fe2e1e2', '5cbb0f16-839f-4e47-a730-c49948ccb825', 'bbcb8305-8803-41c7-9dc6-861d7ab7e2c8', 'f231ba65-3b5a-4c09-96b6-b2b8685758e7'] {{(pid=86639) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 19:53:57 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-7af71934-633e-4783-919f-d63620d056b2 tempest-VolumesDeleteCascade-296710616 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:53:57 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-7af71934-633e-4783-919f-d63620d056b2 tempest-VolumesDeleteCascade-296710616 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:53:57 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-7af71934-633e-4783-919f-d63620d056b2 tempest-VolumesDeleteCascade-296710616 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 19:53:57 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-7af71934-633e-4783-919f-d63620d056b2 tempest-VolumesDeleteCascade-296710616 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 19:53:57 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-7af71934-633e-4783-919f-d63620d056b2 tempest-VolumesDeleteCascade-296710616 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:53:57 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-7af71934-633e-4783-919f-d63620d056b2 tempest-VolumesDeleteCascade-296710616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:53:57 devstack sudo[98430]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e
Jul 02 19:53:57 devstack sudo[98430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:53:58 devstack sudo[98399]: pam_unix(sudo:session): session closed for user root
Jul 02 19:53:58 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-7986ba03-cb09-4c3e-8f28-ed5dd22c97b9 tempest-GroupsV314Test-134590508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8fee3096-61c1-4607-aac6-7b7fc78ef1fb /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-2dbf5b1f-d56f-4ccd-82a4-4fd5cc21b92b" returned: 0 in 6.698s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:53:58 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcb6a677-76a1-4aef-8b94-17df3e895b3a]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 19:53:58 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-7986ba03-cb09-4c3e-8f28-ed5dd22c97b9 tempest-GroupsV314Test-134590508 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8fee3096-61c1-4607-aac6-7b7fc78ef1fb {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:53:58 devstack sudo[98432]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8fee3096-61c1-4607-aac6-7b7fc78ef1fb
Jul 02 19:53:58 devstack sudo[98432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:53:58 devstack sudo[98430]: pam_unix(sudo:session): session closed for user root
Jul 02 19:53:58 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-7af71934-633e-4783-919f-d63620d056b2 tempest-VolumesDeleteCascade-296710616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e" returned: 0 in 1.188s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:53:58 devstack cinder-volume[86639]: DEBUG cinder.manager [None req-7af71934-633e-4783-919f-d63620d056b2 tempest-VolumesDeleteCascade-296710616 None] Notifying Schedulers of capabilities ... {{(pid=86639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 19:53:58 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-7af71934-633e-4783-919f-d63620d056b2 tempest-VolumesDeleteCascade-296710616 None] Deleted volume successfully.
Jul 02 19:53:59 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-7af71934-633e-4783-919f-d63620d056b2 tempest-VolumesDeleteCascade-296710616 None] Lock "cinder-1b4a2ab1-a499-4804-9b3b-2bd376660f04-delete_volume" released by "delete_volume" :: held 17.983s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:53:59 devstack cinder-volume[86639]: DEBUG cinder.volume.flows.manager.create_volume [None req-679b98ab-e998-473e-a664-05e1a1218486 tempest-VolumesDeleteCascade-296710616 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 19:53:59 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-679b98ab-e998-473e-a664-05e1a1218486 tempest-VolumesDeleteCascade-296710616 None] Flow 'volume_create_manager' (a4616542-be45-4a37-ba7c-c357f9a7bebb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 19:53:59 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-679b98ab-e998-473e-a664-05e1a1218486 tempest-VolumesDeleteCascade-296710616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d78c97ba-9868-436b-80ed-c1bf7bb07a40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:53:59 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-679b98ab-e998-473e-a664-05e1a1218486 tempest-VolumesDeleteCascade-296710616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d78c97ba-9868-436b-80ed-c1bf7bb07a40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T17:53:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2119394176',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1df93fb-9c6b-40cb-90f1-4be50507dade,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8daac3662f7488b9927af586b96099f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T17:53:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T17:53:59Z,use_quota=True,user_id='d2dd0f41a08f4b53aafba37e36ae5572',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:53:59 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-679b98ab-e998-473e-a664-05e1a1218486 tempest-VolumesDeleteCascade-296710616 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bf3ae74-6533-4252-89f3-68e1b01c02f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:53:59 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-679b98ab-e998-473e-a664-05e1a1218486 tempest-VolumesDeleteCascade-296710616 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bf3ae74-6533-4252-89f3-68e1b01c02f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:53:59 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-679b98ab-e998-473e-a664-05e1a1218486 tempest-VolumesDeleteCascade-296710616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2af31ad2-c9ce-467b-8bb1-0756e2f94a94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:53:59 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-679b98ab-e998-473e-a664-05e1a1218486 tempest-VolumesDeleteCascade-296710616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2af31ad2-c9ce-467b-8bb1-0756e2f94a94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c1df93fb-9c6b-40cb-90f1-4be50507dade', 'volume_name': 'volume-c1df93fb-9c6b-40cb-90f1-4be50507dade', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:53:59 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-679b98ab-e998-473e-a664-05e1a1218486 tempest-VolumesDeleteCascade-296710616 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4aeeebfc-6011-40be-910a-ad25db7fba0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:53:59 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-679b98ab-e998-473e-a664-05e1a1218486 tempest-VolumesDeleteCascade-296710616 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4aeeebfc-6011-40be-910a-ad25db7fba0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:53:59 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-679b98ab-e998-473e-a664-05e1a1218486 tempest-VolumesDeleteCascade-296710616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ed7ccff-62f3-49cb-86db-d02637181fe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:53:59 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-679b98ab-e998-473e-a664-05e1a1218486 tempest-VolumesDeleteCascade-296710616 None] Volume c1df93fb-9c6b-40cb-90f1-4be50507dade: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c1df93fb-9c6b-40cb-90f1-4be50507dade', 'volume_size': 1}
Jul 02 19:53:59 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-679b98ab-e998-473e-a664-05e1a1218486 tempest-VolumesDeleteCascade-296710616 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:53:59 devstack sudo[98432]: pam_unix(sudo:session): session closed for user root
Jul 02 19:53:59 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-7986ba03-cb09-4c3e-8f28-ed5dd22c97b9 tempest-GroupsV314Test-134590508 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8fee3096-61c1-4607-aac6-7b7fc78ef1fb" returned: 0 in 1.300s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:53:59 devstack cinder-volume[86639]: DEBUG cinder.image.image_utils [None req-7986ba03-cb09-4c3e-8f28-ed5dd22c97b9 tempest-GroupsV314Test-134590508 None] Image conversion details: src /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8fee3096-61c1-4607-aac6-7b7fc78ef1fb, size 1024.00 MB, duration 6.70 sec, destination /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-2dbf5b1f-d56f-4ccd-82a4-4fd5cc21b92b {{(pid=86639) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 02 19:53:59 devstack cinder-volume[86639]: INFO cinder.image.image_utils [None req-7986ba03-cb09-4c3e-8f28-ed5dd22c97b9 tempest-GroupsV314Test-134590508 None] Converted 1024.00 MB image at 152.82 MB/s
Jul 02 19:53:59 devstack cinder-volume[86639]: WARNING cinder.volume.drivers.remotefs [None req-7986ba03-cb09-4c3e-8f28-ed5dd22c97b9 tempest-GroupsV314Test-134590508 None] /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-2dbf5b1f-d56f-4ccd-82a4-4fd5cc21b92b is being set with open permissions: ugo+rw: NotImplementedError
Jul 02 19:53:59 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-7986ba03-cb09-4c3e-8f28-ed5dd22c97b9 tempest-GroupsV314Test-134590508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-2dbf5b1f-d56f-4ccd-82a4-4fd5cc21b92b {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:53:59 devstack sudo[98439]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-2dbf5b1f-d56f-4ccd-82a4-4fd5cc21b92b
Jul 02 19:53:59 devstack sudo[98439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:54:00 devstack sudo[98439]: pam_unix(sudo:session): session closed for user root
Jul 02 19:54:00 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-7986ba03-cb09-4c3e-8f28-ed5dd22c97b9 tempest-GroupsV314Test-134590508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-2dbf5b1f-d56f-4ccd-82a4-4fd5cc21b92b" returned: 0 in 0.903s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:54:00 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-7986ba03-cb09-4c3e-8f28-ed5dd22c97b9 tempest-GroupsV314Test-134590508 None] Lock "cinder-quobyte-2dbf5b1f-d56f-4ccd-82a4-4fd5cc21b92b" released by "_copy_volume_from_snapshot" :: held 10.837s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:54:00 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-7986ba03-cb09-4c3e-8f28-ed5dd22c97b9 tempest-GroupsV314Test-134590508 None] Acquiring lock "cinder-quobyte-79ec9dad-ab69-49ad-aea9-581bd38b8246" by "_delete_snapshot" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:54:00 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-7986ba03-cb09-4c3e-8f28-ed5dd22c97b9 tempest-GroupsV314Test-134590508 None] Lock "cinder-quobyte-79ec9dad-ab69-49ad-aea9-581bd38b8246" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:54:00 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-7986ba03-cb09-4c3e-8f28-ed5dd22c97b9 tempest-GroupsV314Test-134590508 None] Deleting offline snapshot 79ec9dad-ab69-49ad-aea9-581bd38b8246 of volume 8fee3096-61c1-4607-aac6-7b7fc78ef1fb {{(pid=86639) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 02 19:54:00 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-7986ba03-cb09-4c3e-8f28-ed5dd22c97b9 tempest-GroupsV314Test-134590508 None] snapshot_file for this snap is: volume-8fee3096-61c1-4607-aac6-7b7fc78ef1fb.79ec9dad-ab69-49ad-aea9-581bd38b8246 {{(pid=86639) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 02 19:54:00 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d7940d7-4159-4636-a246-9a88819dc3c9]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 19:54:00 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-7986ba03-cb09-4c3e-8f28-ed5dd22c97b9 tempest-GroupsV314Test-134590508 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8fee3096-61c1-4607-aac6-7b7fc78ef1fb.79ec9dad-ab69-49ad-aea9-581bd38b8246 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:54:00 devstack sudo[98442]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8fee3096-61c1-4607-aac6-7b7fc78ef1fb.79ec9dad-ab69-49ad-aea9-581bd38b8246
Jul 02 19:54:00 devstack sudo[98442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:54:01 devstack sudo[98442]: pam_unix(sudo:session): session closed for user root
Jul 02 19:54:01 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-7986ba03-cb09-4c3e-8f28-ed5dd22c97b9 tempest-GroupsV314Test-134590508 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8fee3096-61c1-4607-aac6-7b7fc78ef1fb.79ec9dad-ab69-49ad-aea9-581bd38b8246" returned: 0 in 1.137s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:54:01 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-7986ba03-cb09-4c3e-8f28-ed5dd22c97b9 tempest-GroupsV314Test-134590508 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8fee3096-61c1-4607-aac6-7b7fc78ef1fb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86639) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 02 19:54:01 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[297b7e37-183c-4727-930e-e6da2928703b]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 19:54:01 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-7986ba03-cb09-4c3e-8f28-ed5dd22c97b9 tempest-GroupsV314Test-134590508 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8fee3096-61c1-4607-aac6-7b7fc78ef1fb {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:54:02 devstack sudo[98449]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8fee3096-61c1-4607-aac6-7b7fc78ef1fb
Jul 02 19:54:02 devstack sudo[98449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:54:02 devstack sudo[98449]: pam_unix(sudo:session): session closed for user root
Jul 02 19:54:02 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-7986ba03-cb09-4c3e-8f28-ed5dd22c97b9 tempest-GroupsV314Test-134590508 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8fee3096-61c1-4607-aac6-7b7fc78ef1fb" returned: 0 in 0.895s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:54:02 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-7986ba03-cb09-4c3e-8f28-ed5dd22c97b9 tempest-GroupsV314Test-134590508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8fee3096-61c1-4607-aac6-7b7fc78ef1fb.79ec9dad-ab69-49ad-aea9-581bd38b8246 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:54:02 devstack sudo[98455]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8fee3096-61c1-4607-aac6-7b7fc78ef1fb.79ec9dad-ab69-49ad-aea9-581bd38b8246
Jul 02 19:54:02 devstack sudo[98455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:54:04 devstack sudo[98455]: pam_unix(sudo:session): session closed for user root
Jul 02 19:54:04 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-7986ba03-cb09-4c3e-8f28-ed5dd22c97b9 tempest-GroupsV314Test-134590508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8fee3096-61c1-4607-aac6-7b7fc78ef1fb.79ec9dad-ab69-49ad-aea9-581bd38b8246" returned: 0 in 1.305s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:54:04 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-7986ba03-cb09-4c3e-8f28-ed5dd22c97b9 tempest-GroupsV314Test-134590508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8fee3096-61c1-4607-aac6-7b7fc78ef1fb.79ec9dad-ab69-49ad-aea9-581bd38b8246 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:54:04 devstack sudo[98461]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8fee3096-61c1-4607-aac6-7b7fc78ef1fb.79ec9dad-ab69-49ad-aea9-581bd38b8246
Jul 02 19:54:04 devstack sudo[98461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:54:04 devstack sudo[98461]: pam_unix(sudo:session): session closed for user root
Jul 02 19:54:04 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-7986ba03-cb09-4c3e-8f28-ed5dd22c97b9 tempest-GroupsV314Test-134590508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8fee3096-61c1-4607-aac6-7b7fc78ef1fb.79ec9dad-ab69-49ad-aea9-581bd38b8246" returned: 0 in 0.845s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:54:04 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-7986ba03-cb09-4c3e-8f28-ed5dd22c97b9 tempest-GroupsV314Test-134590508 None] Lock "cinder-quobyte-79ec9dad-ab69-49ad-aea9-581bd38b8246" released by "_delete_snapshot" :: held 4.326s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:54:05 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-7986ba03-cb09-4c3e-8f28-ed5dd22c97b9 tempest-GroupsV314Test-134590508 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 20.603s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:54:05 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-679b98ab-e998-473e-a664-05e1a1218486 tempest-VolumesDeleteCascade-296710616 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.834s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:54:05 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-679b98ab-e998-473e-a664-05e1a1218486 tempest-VolumesDeleteCascade-296710616 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce906cb830>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T17:53:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2119394176',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1df93fb-9c6b-40cb-90f1-4be50507dade,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8daac3662f7488b9927af586b96099f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T17:53:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T17:53:59Z,use_quota=True,user_id='d2dd0f41a08f4b53aafba37e36ae5572',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)}" {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 19:54:05 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-679b98ab-e998-473e-a664-05e1a1218486 tempest-VolumesDeleteCascade-296710616 None] Creating volume c1df93fb-9c6b-40cb-90f1-4be50507dade {{(pid=86639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 19:54:05 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-679b98ab-e998-473e-a664-05e1a1218486 tempest-VolumesDeleteCascade-296710616 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:54:05 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-679b98ab-e998-473e-a664-05e1a1218486 tempest-VolumesDeleteCascade-296710616 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:54:05 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-679b98ab-e998-473e-a664-05e1a1218486 tempest-VolumesDeleteCascade-296710616 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 19:54:05 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-679b98ab-e998-473e-a664-05e1a1218486 tempest-VolumesDeleteCascade-296710616 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 19:54:05 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-679b98ab-e998-473e-a664-05e1a1218486 tempest-VolumesDeleteCascade-296710616 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:54:05 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-679b98ab-e998-473e-a664-05e1a1218486 tempest-VolumesDeleteCascade-296710616 None] Selected osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92 as target Quobyte volume. {{(pid=86639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 19:54:05 devstack cinder-volume[86639]: INFO cinder.volume.drivers.remotefs [None req-679b98ab-e998-473e-a664-05e1a1218486 tempest-VolumesDeleteCascade-296710616 None] casted to osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92
Jul 02 19:54:05 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-679b98ab-e998-473e-a664-05e1a1218486 tempest-VolumesDeleteCascade-296710616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-c1df93fb-9c6b-40cb-90f1-4be50507dade 1073741824 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:54:05 devstack sudo[98464]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-c1df93fb-9c6b-40cb-90f1-4be50507dade 1073741824
Jul 02 19:54:05 devstack sudo[98464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:54:05 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-7986ba03-cb09-4c3e-8f28-ed5dd22c97b9 tempest-GroupsV314Test-134590508 None] Create group from source-group-8f278e6d-57b5-4e53-8c21-ecf32a8c4e34 completed successfully.
Jul 02 19:54:06 devstack sudo[98464]: pam_unix(sudo:session): session closed for user root
Jul 02 19:54:06 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-679b98ab-e998-473e-a664-05e1a1218486 tempest-VolumesDeleteCascade-296710616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-c1df93fb-9c6b-40cb-90f1-4be50507dade 1073741824" returned: 0 in 1.123s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:54:06 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-679b98ab-e998-473e-a664-05e1a1218486 tempest-VolumesDeleteCascade-296710616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-c1df93fb-9c6b-40cb-90f1-4be50507dade {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:54:06 devstack sudo[98470]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-c1df93fb-9c6b-40cb-90f1-4be50507dade
Jul 02 19:54:06 devstack sudo[98470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:54:06 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-0c5522cb-87a5-4279-9f68-28050732bfd5 tempest-GroupsV314Test-134590508 None] Acquiring lock "cinder-quobyte-2dbf5b1f-d56f-4ccd-82a4-4fd5cc21b92b" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:54:06 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-0c5522cb-87a5-4279-9f68-28050732bfd5 tempest-GroupsV314Test-134590508 None] Lock "cinder-quobyte-2dbf5b1f-d56f-4ccd-82a4-4fd5cc21b92b" acquired by "delete_volume" :: waited 0.027s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:54:06 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c25b715-4a24-4bcb-a918-8193c95c3142]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 19:54:06 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-0c5522cb-87a5-4279-9f68-28050732bfd5 tempest-GroupsV314Test-134590508 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-2dbf5b1f-d56f-4ccd-82a4-4fd5cc21b92b {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:54:06 devstack sudo[98472]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-2dbf5b1f-d56f-4ccd-82a4-4fd5cc21b92b
Jul 02 19:54:06 devstack sudo[98472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:54:07 devstack sudo[98470]: pam_unix(sudo:session): session closed for user root
Jul 02 19:54:07 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-679b98ab-e998-473e-a664-05e1a1218486 tempest-VolumesDeleteCascade-296710616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-c1df93fb-9c6b-40cb-90f1-4be50507dade" returned: 0 in 0.969s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:54:07 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-679b98ab-e998-473e-a664-05e1a1218486 tempest-VolumesDeleteCascade-296710616 None] <== create_volume: return (2140ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'} {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 19:54:07 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-679b98ab-e998-473e-a664-05e1a1218486 tempest-VolumesDeleteCascade-296710616 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.143s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:54:07 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-679b98ab-e998-473e-a664-05e1a1218486 tempest-VolumesDeleteCascade-296710616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ed7ccff-62f3-49cb-86db-d02637181fe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c1df93fb-9c6b-40cb-90f1-4be50507dade', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:54:07 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-679b98ab-e998-473e-a664-05e1a1218486 tempest-VolumesDeleteCascade-296710616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2560d2ff-81f8-4649-b9c2-8369e9c6d0da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:54:07 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-679b98ab-e998-473e-a664-05e1a1218486 tempest-VolumesDeleteCascade-296710616 None] Volume volume-c1df93fb-9c6b-40cb-90f1-4be50507dade (c1df93fb-9c6b-40cb-90f1-4be50507dade): created successfully
Jul 02 19:54:07 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-679b98ab-e998-473e-a664-05e1a1218486 tempest-VolumesDeleteCascade-296710616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2560d2ff-81f8-4649-b9c2-8369e9c6d0da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:54:07 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-679b98ab-e998-473e-a664-05e1a1218486 tempest-VolumesDeleteCascade-296710616 None] Flow 'volume_create_manager' (a4616542-be45-4a37-ba7c-c357f9a7bebb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 19:54:07 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-679b98ab-e998-473e-a664-05e1a1218486 tempest-VolumesDeleteCascade-296710616 None] Created volume successfully.
Jul 02 19:54:07 devstack sudo[98472]: pam_unix(sudo:session): session closed for user root
Jul 02 19:54:07 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-0c5522cb-87a5-4279-9f68-28050732bfd5 tempest-GroupsV314Test-134590508 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-2dbf5b1f-d56f-4ccd-82a4-4fd5cc21b92b" returned: 0 in 1.128s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:54:07 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-0c5522cb-87a5-4279-9f68-28050732bfd5 tempest-GroupsV314Test-134590508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-2dbf5b1f-d56f-4ccd-82a4-4fd5cc21b92b {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:54:07 devstack sudo[98479]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-2dbf5b1f-d56f-4ccd-82a4-4fd5cc21b92b
Jul 02 19:54:07 devstack sudo[98479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:54:08 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-00558252-b5df-445d-bb68-686c13584e1a tempest-VolumesDeleteCascade-296710616 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:54:08 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-00558252-b5df-445d-bb68-686c13584e1a tempest-VolumesDeleteCascade-296710616 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:54:08 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-00558252-b5df-445d-bb68-686c13584e1a tempest-VolumesDeleteCascade-296710616 None] Creating offline snapshot b541625b-7d6c-4d77-aab2-5930290aac0c of volume c1df93fb-9c6b-40cb-90f1-4be50507dade {{(pid=86639) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 02 19:54:08 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[10391359-1246-4307-9a26-af90d8635246]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 19:54:08 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-00558252-b5df-445d-bb68-686c13584e1a tempest-VolumesDeleteCascade-296710616 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-c1df93fb-9c6b-40cb-90f1-4be50507dade {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:54:08 devstack sudo[98479]: pam_unix(sudo:session): session closed for user root
Jul 02 19:54:08 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-0c5522cb-87a5-4279-9f68-28050732bfd5 tempest-GroupsV314Test-134590508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-2dbf5b1f-d56f-4ccd-82a4-4fd5cc21b92b" returned: 0 in 0.681s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:54:08 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-0c5522cb-87a5-4279-9f68-28050732bfd5 tempest-GroupsV314Test-134590508 None] Lock "cinder-quobyte-2dbf5b1f-d56f-4ccd-82a4-4fd5cc21b92b" released by "delete_volume" :: held 1.884s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:54:08 devstack sudo[98482]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-c1df93fb-9c6b-40cb-90f1-4be50507dade
Jul 02 19:54:08 devstack sudo[98482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:54:08 devstack cinder-volume[86639]: DEBUG cinder.quota [None req-0c5522cb-87a5-4279-9f68-28050732bfd5 tempest-GroupsV314Test-134590508 None] Created reservations ['a57e705f-6c76-440b-aa71-792a788912a7'] {{(pid=86639) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 19:54:08 devstack cinder-volume[86639]: WARNING cinder.quota [None req-0c5522cb-87a5-4279-9f68-28050732bfd5 tempest-GroupsV314Test-134590508 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-2073851633 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-2073851633, it is now deprecated. Please use the default quota class for default quota.
Jul 02 19:54:08 devstack cinder-volume[86639]: WARNING cinder.quota [None req-0c5522cb-87a5-4279-9f68-28050732bfd5 tempest-GroupsV314Test-134590508 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-2073851633 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-2073851633, it is now deprecated. Please use the default quota class for default quota.
Jul 02 19:54:08 devstack cinder-volume[86639]: DEBUG cinder.quota [None req-0c5522cb-87a5-4279-9f68-28050732bfd5 tempest-GroupsV314Test-134590508 None] Created reservations ['4f918398-7232-4d38-93fc-f2618654cc16', '63229548-b1fc-48ce-93ce-4cda9ca87a03', '86233f61-79d3-4cc0-8dd5-1443a0dccda2', 'd2e458ea-6595-45c5-9905-97ddc9539218'] {{(pid=86639) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 19:54:08 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-0c5522cb-87a5-4279-9f68-28050732bfd5 tempest-GroupsV314Test-134590508 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:54:08 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-0c5522cb-87a5-4279-9f68-28050732bfd5 tempest-GroupsV314Test-134590508 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:54:08 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-0c5522cb-87a5-4279-9f68-28050732bfd5 tempest-GroupsV314Test-134590508 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 19:54:08 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-0c5522cb-87a5-4279-9f68-28050732bfd5 tempest-GroupsV314Test-134590508 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 19:54:08 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-0c5522cb-87a5-4279-9f68-28050732bfd5 tempest-GroupsV314Test-134590508 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:54:08 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-0c5522cb-87a5-4279-9f68-28050732bfd5 tempest-GroupsV314Test-134590508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:54:08 devstack sudo[98484]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e
Jul 02 19:54:08 devstack sudo[98484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:54:08 devstack sudo[98482]: pam_unix(sudo:session): session closed for user root
Jul 02 19:54:08 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-00558252-b5df-445d-bb68-686c13584e1a tempest-VolumesDeleteCascade-296710616 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-c1df93fb-9c6b-40cb-90f1-4be50507dade" returned: 0 in 0.865s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:54:09 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-00558252-b5df-445d-bb68-686c13584e1a tempest-VolumesDeleteCascade-296710616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-c1df93fb-9c6b-40cb-90f1-4be50507dade,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-c1df93fb-9c6b-40cb-90f1-4be50507dade.b541625b-7d6c-4d77-aab2-5930290aac0c 1G {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:54:09 devstack sudo[98489]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-c1df93fb-9c6b-40cb-90f1-4be50507dade,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-c1df93fb-9c6b-40cb-90f1-4be50507dade.b541625b-7d6c-4d77-aab2-5930290aac0c 1G
Jul 02 19:54:09 devstack sudo[98489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:54:09 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-1f57c29a-879b-40b9-b0c4-f5b11d41a1b2 tempest-GroupsV314Test-134590508 None] Acquiring lock "cinder-quobyte-8fee3096-61c1-4607-aac6-7b7fc78ef1fb" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:54:09 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-1f57c29a-879b-40b9-b0c4-f5b11d41a1b2 tempest-GroupsV314Test-134590508 None] Lock "cinder-quobyte-8fee3096-61c1-4607-aac6-7b7fc78ef1fb" acquired by "delete_volume" :: waited 0.025s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:54:09 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea7d1fef-fe34-497d-8809-f32f2f67f539]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 19:54:09 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-1f57c29a-879b-40b9-b0c4-f5b11d41a1b2 tempest-GroupsV314Test-134590508 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8fee3096-61c1-4607-aac6-7b7fc78ef1fb {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:54:09 devstack sudo[98491]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8fee3096-61c1-4607-aac6-7b7fc78ef1fb
Jul 02 19:54:09 devstack sudo[98491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:54:09 devstack sudo[98484]: pam_unix(sudo:session): session closed for user root
Jul 02 19:54:09 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-0c5522cb-87a5-4279-9f68-28050732bfd5 tempest-GroupsV314Test-134590508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e" returned: 0 in 0.983s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:54:09 devstack cinder-volume[86639]: DEBUG cinder.manager [None req-0c5522cb-87a5-4279-9f68-28050732bfd5 tempest-GroupsV314Test-134590508 None] Notifying Schedulers of capabilities ... {{(pid=86639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 19:54:09 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-0c5522cb-87a5-4279-9f68-28050732bfd5 tempest-GroupsV314Test-134590508 None] Delete group completed successfully.
Jul 02 19:54:10 devstack sudo[98489]: pam_unix(sudo:session): session closed for user root
Jul 02 19:54:10 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-00558252-b5df-445d-bb68-686c13584e1a tempest-VolumesDeleteCascade-296710616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-c1df93fb-9c6b-40cb-90f1-4be50507dade,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-c1df93fb-9c6b-40cb-90f1-4be50507dade.b541625b-7d6c-4d77-aab2-5930290aac0c 1G" returned: 0 in 1.080s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:54:10 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-00558252-b5df-445d-bb68-686c13584e1a tempest-VolumesDeleteCascade-296710616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c1df93fb-9c6b-40cb-90f1-4be50507dade -F qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-c1df93fb-9c6b-40cb-90f1-4be50507dade.b541625b-7d6c-4d77-aab2-5930290aac0c {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:54:10 devstack sudo[98500]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c1df93fb-9c6b-40cb-90f1-4be50507dade -F qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-c1df93fb-9c6b-40cb-90f1-4be50507dade.b541625b-7d6c-4d77-aab2-5930290aac0c
Jul 02 19:54:10 devstack sudo[98500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:54:10 devstack sudo[98491]: pam_unix(sudo:session): session closed for user root
Jul 02 19:54:10 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-1f57c29a-879b-40b9-b0c4-f5b11d41a1b2 tempest-GroupsV314Test-134590508 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8fee3096-61c1-4607-aac6-7b7fc78ef1fb" returned: 0 in 0.986s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:54:10 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-1f57c29a-879b-40b9-b0c4-f5b11d41a1b2 tempest-GroupsV314Test-134590508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8fee3096-61c1-4607-aac6-7b7fc78ef1fb {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:54:10 devstack sudo[98502]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8fee3096-61c1-4607-aac6-7b7fc78ef1fb
Jul 02 19:54:10 devstack sudo[98502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:54:10 devstack sudo[98500]: pam_unix(sudo:session): session closed for user root
Jul 02 19:54:10 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-00558252-b5df-445d-bb68-686c13584e1a tempest-VolumesDeleteCascade-296710616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c1df93fb-9c6b-40cb-90f1-4be50507dade -F qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-c1df93fb-9c6b-40cb-90f1-4be50507dade.b541625b-7d6c-4d77-aab2-5930290aac0c" returned: 0 in 0.866s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:54:10 devstack cinder-volume[86639]: WARNING cinder.volume.drivers.remotefs [None req-00558252-b5df-445d-bb68-686c13584e1a tempest-VolumesDeleteCascade-296710616 None] /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-c1df93fb-9c6b-40cb-90f1-4be50507dade.b541625b-7d6c-4d77-aab2-5930290aac0c is being set with open permissions: ugo+rw
Jul 02 19:54:10 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-00558252-b5df-445d-bb68-686c13584e1a tempest-VolumesDeleteCascade-296710616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-c1df93fb-9c6b-40cb-90f1-4be50507dade.b541625b-7d6c-4d77-aab2-5930290aac0c {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:54:10 devstack sudo[98509]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-c1df93fb-9c6b-40cb-90f1-4be50507dade.b541625b-7d6c-4d77-aab2-5930290aac0c
Jul 02 19:54:10 devstack sudo[98509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:54:11 devstack sudo[98502]: pam_unix(sudo:session): session closed for user root
Jul 02 19:54:11 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-1f57c29a-879b-40b9-b0c4-f5b11d41a1b2 tempest-GroupsV314Test-134590508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8fee3096-61c1-4607-aac6-7b7fc78ef1fb" returned: 0 in 0.787s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:54:11 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-1f57c29a-879b-40b9-b0c4-f5b11d41a1b2 tempest-GroupsV314Test-134590508 None] Lock "cinder-quobyte-8fee3096-61c1-4607-aac6-7b7fc78ef1fb" released by "delete_volume" :: held 1.866s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:54:11 devstack cinder-volume[86639]: DEBUG cinder.quota [None req-1f57c29a-879b-40b9-b0c4-f5b11d41a1b2 tempest-GroupsV314Test-134590508 None] Created reservations ['f726a285-7614-4dbc-9577-4e1c7963174a'] {{(pid=86639) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 19:54:11 devstack cinder-volume[86639]: DEBUG cinder.quota [None req-1f57c29a-879b-40b9-b0c4-f5b11d41a1b2 tempest-GroupsV314Test-134590508 None] Created reservations ['2990fafa-ec24-46dd-9358-cea3f3ed24eb', 'cf2ceede-4bde-40ac-89f4-7a00059dc9b0', '8063c82e-6e59-41a2-80da-ee6f3107e084', 'ccccfeb7-dcd5-42a4-803b-572117cf79db'] {{(pid=86639) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 19:54:11 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-1f57c29a-879b-40b9-b0c4-f5b11d41a1b2 tempest-GroupsV314Test-134590508 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:54:11 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-1f57c29a-879b-40b9-b0c4-f5b11d41a1b2 tempest-GroupsV314Test-134590508 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:54:11 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-1f57c29a-879b-40b9-b0c4-f5b11d41a1b2 tempest-GroupsV314Test-134590508 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 19:54:11 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-1f57c29a-879b-40b9-b0c4-f5b11d41a1b2 tempest-GroupsV314Test-134590508 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 19:54:11 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-1f57c29a-879b-40b9-b0c4-f5b11d41a1b2 tempest-GroupsV314Test-134590508 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:54:11 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-1f57c29a-879b-40b9-b0c4-f5b11d41a1b2 tempest-GroupsV314Test-134590508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:54:11 devstack sudo[98511]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e
Jul 02 19:54:11 devstack sudo[98511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:54:11 devstack sudo[98509]: pam_unix(sudo:session): session closed for user root
Jul 02 19:54:11 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-00558252-b5df-445d-bb68-686c13584e1a tempest-VolumesDeleteCascade-296710616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-c1df93fb-9c6b-40cb-90f1-4be50507dade.b541625b-7d6c-4d77-aab2-5930290aac0c" returned: 0 in 1.025s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:54:12 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-00558252-b5df-445d-bb68-686c13584e1a tempest-VolumesDeleteCascade-296710616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-c1df93fb-9c6b-40cb-90f1-4be50507dade.info {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:54:12 devstack sudo[98514]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-c1df93fb-9c6b-40cb-90f1-4be50507dade.info
Jul 02 19:54:12 devstack sudo[98514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:54:12 devstack cinder-volume[86639]: DEBUG cinder.volume.flows.manager.create_volume [None req-556f092a-20b6-42df-957b-1505466100bb tempest-TestInstancesWithCinderVolumes-1877930177 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 19:54:12 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-556f092a-20b6-42df-957b-1505466100bb tempest-TestInstancesWithCinderVolumes-1877930177 None] Flow 'volume_create_manager' (93a04f36-8e6d-4f06-a800-77acbe06c857) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 19:54:12 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-556f092a-20b6-42df-957b-1505466100bb tempest-TestInstancesWithCinderVolumes-1877930177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4444221-d748-429f-bf87-0ad00fa8e83b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:54:12 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-556f092a-20b6-42df-957b-1505466100bb tempest-TestInstancesWithCinderVolumes-1877930177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4444221-d748-429f-bf87-0ad00fa8e83b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T17:54:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1571988500',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b98fbaa-0a48-4707-b29f-ccc6f6169273,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24ff03127e8c4c3db47ed4087bc99478',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T17:54:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T17:54:12Z,use_quota=True,user_id='e1047049d3b64224916be57eeeb35ddb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2570051c-866a-4ada-ac8d-5966cfe76ac9),volume_type_id=2570051c-866a-4ada-ac8d-5966cfe76ac9)' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:54:12 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-556f092a-20b6-42df-957b-1505466100bb tempest-TestInstancesWithCinderVolumes-1877930177 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52619430-fdba-407a-bb94-824d3108dcef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:54:12 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-556f092a-20b6-42df-957b-1505466100bb tempest-TestInstancesWithCinderVolumes-1877930177 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52619430-fdba-407a-bb94-824d3108dcef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:54:12 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-556f092a-20b6-42df-957b-1505466100bb tempest-TestInstancesWithCinderVolumes-1877930177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (423d7190-df6c-49bd-a5c3-d989a947ba60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:54:12 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-556f092a-20b6-42df-957b-1505466100bb tempest-TestInstancesWithCinderVolumes-1877930177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (423d7190-df6c-49bd-a5c3-d989a947ba60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b98fbaa-0a48-4707-b29f-ccc6f6169273', 'volume_name': 'volume-7b98fbaa-0a48-4707-b29f-ccc6f6169273', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:54:12 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-556f092a-20b6-42df-957b-1505466100bb tempest-TestInstancesWithCinderVolumes-1877930177 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d0764a2-bd4f-4439-91d5-8c13e2bcb555) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:54:12 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-556f092a-20b6-42df-957b-1505466100bb tempest-TestInstancesWithCinderVolumes-1877930177 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d0764a2-bd4f-4439-91d5-8c13e2bcb555) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:54:12 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-556f092a-20b6-42df-957b-1505466100bb tempest-TestInstancesWithCinderVolumes-1877930177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (803b4447-d2e3-4e66-b72f-e74fbb5c6586) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:54:12 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-556f092a-20b6-42df-957b-1505466100bb tempest-TestInstancesWithCinderVolumes-1877930177 None] Volume 7b98fbaa-0a48-4707-b29f-ccc6f6169273: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b98fbaa-0a48-4707-b29f-ccc6f6169273', 'volume_size': 1}
Jul 02 19:54:12 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-556f092a-20b6-42df-957b-1505466100bb tempest-TestInstancesWithCinderVolumes-1877930177 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:54:12 devstack sudo[98511]: pam_unix(sudo:session): session closed for user root
Jul 02 19:54:12 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-1f57c29a-879b-40b9-b0c4-f5b11d41a1b2 tempest-GroupsV314Test-134590508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e" returned: 0 in 1.340s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:54:12 devstack cinder-volume[86639]: DEBUG cinder.manager [None req-1f57c29a-879b-40b9-b0c4-f5b11d41a1b2 tempest-GroupsV314Test-134590508 None] Notifying Schedulers of capabilities ... {{(pid=86639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 19:54:12 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-1f57c29a-879b-40b9-b0c4-f5b11d41a1b2 tempest-GroupsV314Test-134590508 None] Delete group completed successfully.
Jul 02 19:54:12 devstack cinder-volume[86639]: DEBUG cinder.volume.flows.manager.create_volume [None req-7441f50a-2495-4758-8c2e-a60b6e394ea6 tempest-TestInstancesWithCinderVolumes-1877930177 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 19:54:12 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-7441f50a-2495-4758-8c2e-a60b6e394ea6 tempest-TestInstancesWithCinderVolumes-1877930177 None] Flow 'volume_create_manager' (14fe3f10-8021-43b5-9fc1-f2195197ca73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 19:54:12 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-7441f50a-2495-4758-8c2e-a60b6e394ea6 tempest-TestInstancesWithCinderVolumes-1877930177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (958c48ae-0709-4053-8777-6083775625cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:54:12 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-7441f50a-2495-4758-8c2e-a60b6e394ea6 tempest-TestInstancesWithCinderVolumes-1877930177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (958c48ae-0709-4053-8777-6083775625cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T17:54:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2040830233',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff18f3bf-1e66-42c5-bccc-3e2b41e1dcf0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24ff03127e8c4c3db47ed4087bc99478',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T17:54:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T17:54:13Z,use_quota=True,user_id='e1047049d3b64224916be57eeeb35ddb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17d6a903-71c6-43ca-a60d-8fe0535d5036),volume_type_id=17d6a903-71c6-43ca-a60d-8fe0535d5036)' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:54:12 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-7441f50a-2495-4758-8c2e-a60b6e394ea6 tempest-TestInstancesWithCinderVolumes-1877930177 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c6e5658-04a2-4713-82cc-cfd1a9d3bece) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:54:12 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-7441f50a-2495-4758-8c2e-a60b6e394ea6 tempest-TestInstancesWithCinderVolumes-1877930177 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c6e5658-04a2-4713-82cc-cfd1a9d3bece) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:54:12 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-7441f50a-2495-4758-8c2e-a60b6e394ea6 tempest-TestInstancesWithCinderVolumes-1877930177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2cf6ef56-b594-4825-a9d1-ebae9513628b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:54:12 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-7441f50a-2495-4758-8c2e-a60b6e394ea6 tempest-TestInstancesWithCinderVolumes-1877930177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2cf6ef56-b594-4825-a9d1-ebae9513628b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ff18f3bf-1e66-42c5-bccc-3e2b41e1dcf0', 'volume_name': 'volume-ff18f3bf-1e66-42c5-bccc-3e2b41e1dcf0', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:54:12 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-7441f50a-2495-4758-8c2e-a60b6e394ea6 tempest-TestInstancesWithCinderVolumes-1877930177 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e107ec60-22c4-4351-917b-cb22b50597b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:54:12 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-7441f50a-2495-4758-8c2e-a60b6e394ea6 tempest-TestInstancesWithCinderVolumes-1877930177 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e107ec60-22c4-4351-917b-cb22b50597b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:54:12 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-7441f50a-2495-4758-8c2e-a60b6e394ea6 tempest-TestInstancesWithCinderVolumes-1877930177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66920191-a9e5-49a8-a0f2-f1eaf6bae6fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:54:12 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-7441f50a-2495-4758-8c2e-a60b6e394ea6 tempest-TestInstancesWithCinderVolumes-1877930177 None] Volume ff18f3bf-1e66-42c5-bccc-3e2b41e1dcf0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ff18f3bf-1e66-42c5-bccc-3e2b41e1dcf0', 'volume_size': 1}
Jul 02 19:54:12 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-7441f50a-2495-4758-8c2e-a60b6e394ea6 tempest-TestInstancesWithCinderVolumes-1877930177 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:54:13 devstack sudo[98514]: pam_unix(sudo:session): session closed for user root
Jul 02 19:54:13 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-00558252-b5df-445d-bb68-686c13584e1a tempest-VolumesDeleteCascade-296710616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-c1df93fb-9c6b-40cb-90f1-4be50507dade.info" returned: 0 in 1.277s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:54:13 devstack cinder-volume[86639]: WARNING cinder.volume.drivers.remotefs [None req-00558252-b5df-445d-bb68-686c13584e1a tempest-VolumesDeleteCascade-296710616 None] /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-c1df93fb-9c6b-40cb-90f1-4be50507dade.info is being set with open permissions: ugo+rw
Jul 02 19:54:13 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-00558252-b5df-445d-bb68-686c13584e1a tempest-VolumesDeleteCascade-296710616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-c1df93fb-9c6b-40cb-90f1-4be50507dade.info {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:54:13 devstack sudo[98518]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-c1df93fb-9c6b-40cb-90f1-4be50507dade.info
Jul 02 19:54:13 devstack sudo[98518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:54:14 devstack sudo[98518]: pam_unix(sudo:session): session closed for user root
Jul 02 19:54:14 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-00558252-b5df-445d-bb68-686c13584e1a tempest-VolumesDeleteCascade-296710616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-c1df93fb-9c6b-40cb-90f1-4be50507dade.info" returned: 0 in 0.740s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:54:14 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-00558252-b5df-445d-bb68-686c13584e1a tempest-VolumesDeleteCascade-296710616 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.046s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:54:14 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-556f092a-20b6-42df-957b-1505466100bb tempest-TestInstancesWithCinderVolumes-1877930177 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.681s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:54:14 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-556f092a-20b6-42df-957b-1505466100bb tempest-TestInstancesWithCinderVolumes-1877930177 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce906cb830>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T17:54:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1571988500',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b98fbaa-0a48-4707-b29f-ccc6f6169273,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24ff03127e8c4c3db47ed4087bc99478',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T17:54:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T17:54:12Z,use_quota=True,user_id='e1047049d3b64224916be57eeeb35ddb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2570051c-866a-4ada-ac8d-5966cfe76ac9),volume_type_id=2570051c-866a-4ada-ac8d-5966cfe76ac9)}" {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 19:54:14 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-556f092a-20b6-42df-957b-1505466100bb tempest-TestInstancesWithCinderVolumes-1877930177 None] Creating volume 7b98fbaa-0a48-4707-b29f-ccc6f6169273 {{(pid=86639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 19:54:14 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-556f092a-20b6-42df-957b-1505466100bb tempest-TestInstancesWithCinderVolumes-1877930177 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:54:14 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-556f092a-20b6-42df-957b-1505466100bb tempest-TestInstancesWithCinderVolumes-1877930177 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:54:14 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-556f092a-20b6-42df-957b-1505466100bb tempest-TestInstancesWithCinderVolumes-1877930177 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 19:54:14 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-556f092a-20b6-42df-957b-1505466100bb tempest-TestInstancesWithCinderVolumes-1877930177 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 19:54:14 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-556f092a-20b6-42df-957b-1505466100bb tempest-TestInstancesWithCinderVolumes-1877930177 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:54:14 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-556f092a-20b6-42df-957b-1505466100bb tempest-TestInstancesWithCinderVolumes-1877930177 None] Selected osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92 as target Quobyte volume. {{(pid=86639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 19:54:14 devstack cinder-volume[86639]: INFO cinder.volume.drivers.remotefs [None req-556f092a-20b6-42df-957b-1505466100bb tempest-TestInstancesWithCinderVolumes-1877930177 None] casted to osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92
Jul 02 19:54:14 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-556f092a-20b6-42df-957b-1505466100bb tempest-TestInstancesWithCinderVolumes-1877930177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-7b98fbaa-0a48-4707-b29f-ccc6f6169273 1073741824 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:54:14 devstack sudo[98523]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-7b98fbaa-0a48-4707-b29f-ccc6f6169273 1073741824
Jul 02 19:54:14 devstack sudo[98523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:54:14 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-00558252-b5df-445d-bb68-686c13584e1a tempest-VolumesDeleteCascade-296710616 None] Create snapshot completed successfully
Jul 02 19:54:14 devstack cinder-volume[86639]: DEBUG cinder.volume.flows.manager.create_volume [None req-4aa21129-23ac-4813-92af-f8cde5f58909 tempest-TestInstancesWithCinderVolumes-1877930177 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 19:54:14 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-4aa21129-23ac-4813-92af-f8cde5f58909 tempest-TestInstancesWithCinderVolumes-1877930177 None] Flow 'volume_create_manager' (5cd68f54-ad1b-4dd9-a763-a1e9db695f62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 19:54:14 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-4aa21129-23ac-4813-92af-f8cde5f58909 tempest-TestInstancesWithCinderVolumes-1877930177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1b00ee4-ae06-4320-b4b5-23f622cc8ab2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:54:14 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-4aa21129-23ac-4813-92af-f8cde5f58909 tempest-TestInstancesWithCinderVolumes-1877930177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1b00ee4-ae06-4320-b4b5-23f622cc8ab2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T17:54:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-549424812',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b318261-668e-4454-af8f-b593a15f2a15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24ff03127e8c4c3db47ed4087bc99478',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T17:54:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T17:54:14Z,use_quota=True,user_id='e1047049d3b64224916be57eeeb35ddb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cf2ac8e6-3fd3-49c1-810a-59b6536504d2),volume_type_id=cf2ac8e6-3fd3-49c1-810a-59b6536504d2)' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:54:14 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-4aa21129-23ac-4813-92af-f8cde5f58909 tempest-TestInstancesWithCinderVolumes-1877930177 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b01771db-d68f-4dad-a471-d0dda0a7c8ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:54:14 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-4aa21129-23ac-4813-92af-f8cde5f58909 tempest-TestInstancesWithCinderVolumes-1877930177 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b01771db-d68f-4dad-a471-d0dda0a7c8ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:54:14 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-4aa21129-23ac-4813-92af-f8cde5f58909 tempest-TestInstancesWithCinderVolumes-1877930177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55f06567-3521-405e-8b4f-f662e2cd3805) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:54:14 devstack cinder-volume[86639]: DEBUG cinder.image.glance [None req-4aa21129-23ac-4813-92af-f8cde5f58909 tempest-TestInstancesWithCinderVolumes-1877930177 None] Creating Keystone auth plugin from conf {{(pid=86639) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jul 02 19:54:14 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-4aa21129-23ac-4813-92af-f8cde5f58909 tempest-TestInstancesWithCinderVolumes-1877930177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55f06567-3521-405e-8b4f-f662e2cd3805) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '9b318261-668e-4454-af8f-b593a15f2a15', 'volume_name': 'volume-9b318261-668e-4454-af8f-b593a15f2a15', 'volume_size': 1, 'image_id': 'fe594add-05cd-4167-8d69-b57ffac5f626', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fe594add-05cd-4167-8d69-b57ffac5f626', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1890714012', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '24ff03127e8c4c3db47ed4087bc99478', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'fe594add-05cd-4167-8d69-b57ffac5f626', 'created_at': datetime.datetime(2026, 7, 2, 17, 54, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 2, 17, 54, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fe594add-05cd-4167-8d69-b57ffac5f626/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fce8efbaff0>}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:54:14 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-4aa21129-23ac-4813-92af-f8cde5f58909 tempest-TestInstancesWithCinderVolumes-1877930177 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b35a3e0d-c39f-4f26-a075-60faf5fba548) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:54:14 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-4aa21129-23ac-4813-92af-f8cde5f58909 tempest-TestInstancesWithCinderVolumes-1877930177 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b35a3e0d-c39f-4f26-a075-60faf5fba548) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:54:14 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-4aa21129-23ac-4813-92af-f8cde5f58909 tempest-TestInstancesWithCinderVolumes-1877930177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5d80f57-0f62-4f00-ad49-25433d3bdaa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:54:14 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-4aa21129-23ac-4813-92af-f8cde5f58909 tempest-TestInstancesWithCinderVolumes-1877930177 None] Volume 9b318261-668e-4454-af8f-b593a15f2a15: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-9b318261-668e-4454-af8f-b593a15f2a15', 'volume_size': 1, 'image_id': 'fe594add-05cd-4167-8d69-b57ffac5f626', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fe594add-05cd-4167-8d69-b57ffac5f626', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1890714012', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '24ff03127e8c4c3db47ed4087bc99478', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'fe594add-05cd-4167-8d69-b57ffac5f626', 'created_at': datetime.datetime(2026, 7, 2, 17, 54, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 2, 17, 54, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fe594add-05cd-4167-8d69-b57ffac5f626/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fce8efbaff0>}
Jul 02 19:54:14 devstack cinder-volume[86639]: DEBUG cinder.volume.flows.manager.create_volume [None req-4aa21129-23ac-4813-92af-f8cde5f58909 tempest-TestInstancesWithCinderVolumes-1877930177 None] Trying to clone 9b318261-668e-4454-af8f-b593a15f2a15 from image fe594add-05cd-4167-8d69-b57ffac5f626 at location (None, [{'url': 'file:///opt/stack/data/glance/images/fe594add-05cd-4167-8d69-b57ffac5f626', 'metadata': {}}]). {{(pid=86639) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jul 02 19:54:15 devstack sudo[98523]: pam_unix(sudo:session): session closed for user root
Jul 02 19:54:15 devstack cinder-volume[86639]: DEBUG cinder.volume.flows.manager.create_volume [None req-92f017ff-a1fa-438d-a5c7-065159d62e7c tempest-VolumesDeleteCascade-296710616 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 19:54:15 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-556f092a-20b6-42df-957b-1505466100bb tempest-TestInstancesWithCinderVolumes-1877930177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-7b98fbaa-0a48-4707-b29f-ccc6f6169273 1073741824" returned: 0 in 1.300s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:54:15 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-92f017ff-a1fa-438d-a5c7-065159d62e7c tempest-VolumesDeleteCascade-296710616 None] Flow 'volume_create_manager' (02a7f031-905e-435e-bab9-58522431b427) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 19:54:15 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-92f017ff-a1fa-438d-a5c7-065159d62e7c tempest-VolumesDeleteCascade-296710616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61909ad2-5736-4147-86e7-36f7a768ef55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:54:15 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-92f017ff-a1fa-438d-a5c7-065159d62e7c tempest-VolumesDeleteCascade-296710616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61909ad2-5736-4147-86e7-36f7a768ef55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T17:54:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1211181347',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8717a525-587f-46ab-b35e-d8570ad56d7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8daac3662f7488b9927af586b96099f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T17:54:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=b541625b-7d6c-4d77-aab2-5930290aac0c,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T17:54:15Z,use_quota=True,user_id='d2dd0f41a08f4b53aafba37e36ae5572',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:54:15 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-92f017ff-a1fa-438d-a5c7-065159d62e7c tempest-VolumesDeleteCascade-296710616 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (510bd4aa-ffd1-410e-9bb2-b56c62e87bcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:54:15 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-92f017ff-a1fa-438d-a5c7-065159d62e7c tempest-VolumesDeleteCascade-296710616 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (510bd4aa-ffd1-410e-9bb2-b56c62e87bcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:54:15 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-92f017ff-a1fa-438d-a5c7-065159d62e7c tempest-VolumesDeleteCascade-296710616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c463fed3-d7a7-403c-8360-5d149b30a481) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:54:15 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-92f017ff-a1fa-438d-a5c7-065159d62e7c tempest-VolumesDeleteCascade-296710616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c463fed3-d7a7-403c-8360-5d149b30a481) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '8717a525-587f-46ab-b35e-d8570ad56d7f', 'volume_name': 'volume-8717a525-587f-46ab-b35e-d8570ad56d7f', 'volume_size': 1, 'snapshot_id': 'b541625b-7d6c-4d77-aab2-5930290aac0c'}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:54:15 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-92f017ff-a1fa-438d-a5c7-065159d62e7c tempest-VolumesDeleteCascade-296710616 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3589a2f5-1d4a-47db-ba7b-9927669dc93d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:54:15 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-92f017ff-a1fa-438d-a5c7-065159d62e7c tempest-VolumesDeleteCascade-296710616 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3589a2f5-1d4a-47db-ba7b-9927669dc93d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:54:15 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-92f017ff-a1fa-438d-a5c7-065159d62e7c tempest-VolumesDeleteCascade-296710616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (855e3c41-2837-4542-9e59-b4928dfb49d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:54:15 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-92f017ff-a1fa-438d-a5c7-065159d62e7c tempest-VolumesDeleteCascade-296710616 None] Volume 8717a525-587f-46ab-b35e-d8570ad56d7f: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-8717a525-587f-46ab-b35e-d8570ad56d7f', 'volume_size': 1, 'snapshot_id': 'b541625b-7d6c-4d77-aab2-5930290aac0c'}
Jul 02 19:54:15 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-92f017ff-a1fa-438d-a5c7-065159d62e7c tempest-VolumesDeleteCascade-296710616 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:54:15 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-556f092a-20b6-42df-957b-1505466100bb tempest-TestInstancesWithCinderVolumes-1877930177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-7b98fbaa-0a48-4707-b29f-ccc6f6169273 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:54:15 devstack sudo[98529]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-7b98fbaa-0a48-4707-b29f-ccc6f6169273
Jul 02 19:54:15 devstack sudo[98529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:54:16 devstack sudo[98529]: pam_unix(sudo:session): session closed for user root
Jul 02 19:54:16 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-556f092a-20b6-42df-957b-1505466100bb tempest-TestInstancesWithCinderVolumes-1877930177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-7b98fbaa-0a48-4707-b29f-ccc6f6169273" returned: 0 in 0.709s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:54:16 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-556f092a-20b6-42df-957b-1505466100bb tempest-TestInstancesWithCinderVolumes-1877930177 None] <== create_volume: return (2155ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'} {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 19:54:16 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-556f092a-20b6-42df-957b-1505466100bb tempest-TestInstancesWithCinderVolumes-1877930177 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.159s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:54:16 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-7441f50a-2495-4758-8c2e-a60b6e394ea6 tempest-TestInstancesWithCinderVolumes-1877930177 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.354s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:54:16 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-7441f50a-2495-4758-8c2e-a60b6e394ea6 tempest-TestInstancesWithCinderVolumes-1877930177 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce906cb830>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T17:54:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2040830233',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff18f3bf-1e66-42c5-bccc-3e2b41e1dcf0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24ff03127e8c4c3db47ed4087bc99478',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T17:54:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T17:54:13Z,use_quota=True,user_id='e1047049d3b64224916be57eeeb35ddb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17d6a903-71c6-43ca-a60d-8fe0535d5036),volume_type_id=17d6a903-71c6-43ca-a60d-8fe0535d5036)}" {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 19:54:16 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-7441f50a-2495-4758-8c2e-a60b6e394ea6 tempest-TestInstancesWithCinderVolumes-1877930177 None] Creating volume ff18f3bf-1e66-42c5-bccc-3e2b41e1dcf0 {{(pid=86639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 19:54:16 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-7441f50a-2495-4758-8c2e-a60b6e394ea6 tempest-TestInstancesWithCinderVolumes-1877930177 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:54:16 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-7441f50a-2495-4758-8c2e-a60b6e394ea6 tempest-TestInstancesWithCinderVolumes-1877930177 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:54:16 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-7441f50a-2495-4758-8c2e-a60b6e394ea6 tempest-TestInstancesWithCinderVolumes-1877930177 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 19:54:16 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-7441f50a-2495-4758-8c2e-a60b6e394ea6 tempest-TestInstancesWithCinderVolumes-1877930177 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 19:54:16 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-7441f50a-2495-4758-8c2e-a60b6e394ea6 tempest-TestInstancesWithCinderVolumes-1877930177 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:54:16 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-7441f50a-2495-4758-8c2e-a60b6e394ea6 tempest-TestInstancesWithCinderVolumes-1877930177 None] Selected osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92 as target Quobyte volume. {{(pid=86639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 19:54:16 devstack cinder-volume[86639]: INFO cinder.volume.drivers.remotefs [None req-7441f50a-2495-4758-8c2e-a60b6e394ea6 tempest-TestInstancesWithCinderVolumes-1877930177 None] casted to osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92
Jul 02 19:54:16 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-7441f50a-2495-4758-8c2e-a60b6e394ea6 tempest-TestInstancesWithCinderVolumes-1877930177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-ff18f3bf-1e66-42c5-bccc-3e2b41e1dcf0 1073741824 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:54:16 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-556f092a-20b6-42df-957b-1505466100bb tempest-TestInstancesWithCinderVolumes-1877930177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (803b4447-d2e3-4e66-b72f-e74fbb5c6586) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b98fbaa-0a48-4707-b29f-ccc6f6169273', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:54:16 devstack sudo[98532]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-ff18f3bf-1e66-42c5-bccc-3e2b41e1dcf0 1073741824
Jul 02 19:54:16 devstack sudo[98532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:54:16 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-556f092a-20b6-42df-957b-1505466100bb tempest-TestInstancesWithCinderVolumes-1877930177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95020e38-b745-4ac0-b259-5b0b6591c1bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:54:16 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-556f092a-20b6-42df-957b-1505466100bb tempest-TestInstancesWithCinderVolumes-1877930177 None] Volume volume-7b98fbaa-0a48-4707-b29f-ccc6f6169273 (7b98fbaa-0a48-4707-b29f-ccc6f6169273): created successfully
Jul 02 19:54:16 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-556f092a-20b6-42df-957b-1505466100bb tempest-TestInstancesWithCinderVolumes-1877930177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95020e38-b745-4ac0-b259-5b0b6591c1bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:54:16 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-556f092a-20b6-42df-957b-1505466100bb tempest-TestInstancesWithCinderVolumes-1877930177 None] Flow 'volume_create_manager' (93a04f36-8e6d-4f06-a800-77acbe06c857) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 19:54:16 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-556f092a-20b6-42df-957b-1505466100bb tempest-TestInstancesWithCinderVolumes-1877930177 None] Created volume successfully.
Jul 02 19:54:17 devstack sudo[98532]: pam_unix(sudo:session): session closed for user root
Jul 02 19:54:17 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-7441f50a-2495-4758-8c2e-a60b6e394ea6 tempest-TestInstancesWithCinderVolumes-1877930177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-ff18f3bf-1e66-42c5-bccc-3e2b41e1dcf0 1073741824" returned: 0 in 0.900s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:54:17 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-7441f50a-2495-4758-8c2e-a60b6e394ea6 tempest-TestInstancesWithCinderVolumes-1877930177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-ff18f3bf-1e66-42c5-bccc-3e2b41e1dcf0 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:54:17 devstack sudo[98538]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-ff18f3bf-1e66-42c5-bccc-3e2b41e1dcf0
Jul 02 19:54:17 devstack sudo[98538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:54:18 devstack sudo[98538]: pam_unix(sudo:session): session closed for user root
Jul 02 19:54:18 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-7441f50a-2495-4758-8c2e-a60b6e394ea6 tempest-TestInstancesWithCinderVolumes-1877930177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-ff18f3bf-1e66-42c5-bccc-3e2b41e1dcf0" returned: 0 in 0.753s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:54:18 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-7441f50a-2495-4758-8c2e-a60b6e394ea6 tempest-TestInstancesWithCinderVolumes-1877930177 None] <== create_volume: return (1706ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'} {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 19:54:18 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-7441f50a-2495-4758-8c2e-a60b6e394ea6 tempest-TestInstancesWithCinderVolumes-1877930177 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.708s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:54:18 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-92f017ff-a1fa-438d-a5c7-065159d62e7c tempest-VolumesDeleteCascade-296710616 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.442s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:54:18 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-92f017ff-a1fa-438d-a5c7-065159d62e7c tempest-VolumesDeleteCascade-296710616 None] Acquiring lock "cinder-quobyte-b541625b-7d6c-4d77-aab2-5930290aac0c-8717a525-587f-46ab-b35e-d8570ad56d7f" by "_create_volume_from_snapshot" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:54:18 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-92f017ff-a1fa-438d-a5c7-065159d62e7c tempest-VolumesDeleteCascade-296710616 None] Lock "cinder-quobyte-b541625b-7d6c-4d77-aab2-5930290aac0c-8717a525-587f-46ab-b35e-d8570ad56d7f" acquired by "_create_volume_from_snapshot" :: waited 0.026s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:54:18 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-92f017ff-a1fa-438d-a5c7-065159d62e7c tempest-VolumesDeleteCascade-296710616 None] Creating volume 8717a525-587f-46ab-b35e-d8570ad56d7f from snapshot b541625b-7d6c-4d77-aab2-5930290aac0c {{(pid=86639) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jul 02 19:54:18 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-92f017ff-a1fa-438d-a5c7-065159d62e7c tempest-VolumesDeleteCascade-296710616 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:54:18 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-92f017ff-a1fa-438d-a5c7-065159d62e7c tempest-VolumesDeleteCascade-296710616 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:54:18 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-92f017ff-a1fa-438d-a5c7-065159d62e7c tempest-VolumesDeleteCascade-296710616 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 19:54:18 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-92f017ff-a1fa-438d-a5c7-065159d62e7c tempest-VolumesDeleteCascade-296710616 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 19:54:18 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-92f017ff-a1fa-438d-a5c7-065159d62e7c tempest-VolumesDeleteCascade-296710616 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:54:18 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-92f017ff-a1fa-438d-a5c7-065159d62e7c tempest-VolumesDeleteCascade-296710616 None] Selected osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92 as target Quobyte volume. {{(pid=86639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 19:54:18 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-92f017ff-a1fa-438d-a5c7-065159d62e7c tempest-VolumesDeleteCascade-296710616 None] Acquiring lock "cinder-quobyte-8717a525-587f-46ab-b35e-d8570ad56d7f" by "_copy_volume_from_snapshot" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:54:18 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-7441f50a-2495-4758-8c2e-a60b6e394ea6 tempest-TestInstancesWithCinderVolumes-1877930177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66920191-a9e5-49a8-a0f2-f1eaf6bae6fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff18f3bf-1e66-42c5-bccc-3e2b41e1dcf0', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:54:18 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-7441f50a-2495-4758-8c2e-a60b6e394ea6 tempest-TestInstancesWithCinderVolumes-1877930177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42376938-95a6-498c-b652-8054c1a2425a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:54:18 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-92f017ff-a1fa-438d-a5c7-065159d62e7c tempest-VolumesDeleteCascade-296710616 None] Lock "cinder-quobyte-8717a525-587f-46ab-b35e-d8570ad56d7f" acquired by "_copy_volume_from_snapshot" :: waited 0.037s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:54:18 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-92f017ff-a1fa-438d-a5c7-065159d62e7c tempest-VolumesDeleteCascade-296710616 None] snapshot: b541625b-7d6c-4d77-aab2-5930290aac0c, volume: 8717a525-587f-46ab-b35e-d8570ad56d7f,  {{(pid=86639) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jul 02 19:54:18 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-7441f50a-2495-4758-8c2e-a60b6e394ea6 tempest-TestInstancesWithCinderVolumes-1877930177 None] Volume volume-ff18f3bf-1e66-42c5-bccc-3e2b41e1dcf0 (ff18f3bf-1e66-42c5-bccc-3e2b41e1dcf0): created successfully
Jul 02 19:54:18 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-7441f50a-2495-4758-8c2e-a60b6e394ea6 tempest-TestInstancesWithCinderVolumes-1877930177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42376938-95a6-498c-b652-8054c1a2425a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:54:18 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-7441f50a-2495-4758-8c2e-a60b6e394ea6 tempest-TestInstancesWithCinderVolumes-1877930177 None] Flow 'volume_create_manager' (14fe3f10-8021-43b5-9fc1-f2195197ca73) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 19:54:18 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-92f017ff-a1fa-438d-a5c7-065159d62e7c tempest-VolumesDeleteCascade-296710616 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:54:18 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-92f017ff-a1fa-438d-a5c7-065159d62e7c tempest-VolumesDeleteCascade-296710616 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:54:18 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-92f017ff-a1fa-438d-a5c7-065159d62e7c tempest-VolumesDeleteCascade-296710616 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 19:54:18 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-92f017ff-a1fa-438d-a5c7-065159d62e7c tempest-VolumesDeleteCascade-296710616 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 19:54:18 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-92f017ff-a1fa-438d-a5c7-065159d62e7c tempest-VolumesDeleteCascade-296710616 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:54:18 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-7441f50a-2495-4758-8c2e-a60b6e394ea6 tempest-TestInstancesWithCinderVolumes-1877930177 None] Created volume successfully.
Jul 02 19:54:18 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f55a312-6a03-416b-bcfa-c2543a485a84]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 19:54:18 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-92f017ff-a1fa-438d-a5c7-065159d62e7c tempest-VolumesDeleteCascade-296710616 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-c1df93fb-9c6b-40cb-90f1-4be50507dade.b541625b-7d6c-4d77-aab2-5930290aac0c {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:54:18 devstack sudo[98542]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-c1df93fb-9c6b-40cb-90f1-4be50507dade.b541625b-7d6c-4d77-aab2-5930290aac0c
Jul 02 19:54:18 devstack sudo[98542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:54:19 devstack sudo[98542]: pam_unix(sudo:session): session closed for user root
Jul 02 19:54:19 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-92f017ff-a1fa-438d-a5c7-065159d62e7c tempest-VolumesDeleteCascade-296710616 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-c1df93fb-9c6b-40cb-90f1-4be50507dade.b541625b-7d6c-4d77-aab2-5930290aac0c" returned: 0 in 0.921s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:54:19 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-92f017ff-a1fa-438d-a5c7-065159d62e7c tempest-VolumesDeleteCascade-296710616 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c1df93fb-9c6b-40cb-90f1-4be50507dade(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86639) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 02 19:54:19 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-92f017ff-a1fa-438d-a5c7-065159d62e7c tempest-VolumesDeleteCascade-296710616 None] will copy from snapshot at /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-c1df93fb-9c6b-40cb-90f1-4be50507dade {{(pid=86639) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jul 02 19:54:19 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-92f017ff-a1fa-438d-a5c7-065159d62e7c tempest-VolumesDeleteCascade-296710616 None] Creating direct copy from snapshot {{(pid=86639) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jul 02 19:54:19 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c541eb5-7e78-46d8-93fe-2d1c82245edf]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 19:54:19 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-92f017ff-a1fa-438d-a5c7-065159d62e7c tempest-VolumesDeleteCascade-296710616 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-c1df93fb-9c6b-40cb-90f1-4be50507dade {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:54:19 devstack sudo[98548]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-c1df93fb-9c6b-40cb-90f1-4be50507dade
Jul 02 19:54:19 devstack sudo[98548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:54:19 devstack cinder-volume[86639]: DEBUG cinder.image.image_utils [None req-4aa21129-23ac-4813-92af-f8cde5f58909 tempest-TestInstancesWithCinderVolumes-1877930177 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_fe594add-05cd-4167-8d69-b57ffac5f626_oczfjmaodevstack@QuobyteHD, size 20.69 MB, duration 4.37 sec {{(pid=86639) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jul 02 19:54:19 devstack cinder-volume[86639]: INFO cinder.image.image_utils [None req-4aa21129-23ac-4813-92af-f8cde5f58909 tempest-TestInstancesWithCinderVolumes-1877930177 None] Image download 20.69 MB at 4.73 MB/s
Jul 02 19:54:19 devstack cinder-volume[86639]: DEBUG cinder.volume.flows.manager.create_volume [None req-18eb8483-e36e-454d-84f5-59e45c43d2f5 tempest-SnapshotsActionsTest-1617821023 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 19:54:19 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-18eb8483-e36e-454d-84f5-59e45c43d2f5 tempest-SnapshotsActionsTest-1617821023 None] Flow 'volume_create_manager' (c814def3-0107-4b82-9327-b65fa1c87fc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 19:54:19 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-18eb8483-e36e-454d-84f5-59e45c43d2f5 tempest-SnapshotsActionsTest-1617821023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c76cf4e-7f93-466b-b7d5-a1d4629e911f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:54:19 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[4344b862-76e1-4b26-bdb7-b49d335f9e04]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 19:54:19 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-4aa21129-23ac-4813-92af-f8cde5f58909 tempest-TestInstancesWithCinderVolumes-1877930177 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fe594add-05cd-4167-8d69-b57ffac5f626_oczfjmaodevstack@QuobyteHD {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:54:19 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-18eb8483-e36e-454d-84f5-59e45c43d2f5 tempest-SnapshotsActionsTest-1617821023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c76cf4e-7f93-466b-b7d5-a1d4629e911f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T17:54:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1041239686',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46d356a2-75af-4ae3-a828-0b1c37b99bae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5275d577773549d59d024bc9e2e985fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T17:54:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T17:54:19Z,use_quota=True,user_id='a5c752baaf90430abfd564f8a918325e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:54:19 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-18eb8483-e36e-454d-84f5-59e45c43d2f5 tempest-SnapshotsActionsTest-1617821023 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (562ece12-5c4a-482d-9cc5-62b06978f7d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:54:19 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-18eb8483-e36e-454d-84f5-59e45c43d2f5 tempest-SnapshotsActionsTest-1617821023 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (562ece12-5c4a-482d-9cc5-62b06978f7d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:54:19 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-18eb8483-e36e-454d-84f5-59e45c43d2f5 tempest-SnapshotsActionsTest-1617821023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3f5bca1-9ff0-4dfd-a886-3353f064a435) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:54:19 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-18eb8483-e36e-454d-84f5-59e45c43d2f5 tempest-SnapshotsActionsTest-1617821023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3f5bca1-9ff0-4dfd-a886-3353f064a435) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '46d356a2-75af-4ae3-a828-0b1c37b99bae', 'volume_name': 'volume-46d356a2-75af-4ae3-a828-0b1c37b99bae', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:54:19 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-18eb8483-e36e-454d-84f5-59e45c43d2f5 tempest-SnapshotsActionsTest-1617821023 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a49f87f0-0e08-4170-9d1b-d7b3ef2e0c5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:54:19 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-18eb8483-e36e-454d-84f5-59e45c43d2f5 tempest-SnapshotsActionsTest-1617821023 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a49f87f0-0e08-4170-9d1b-d7b3ef2e0c5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:54:19 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-18eb8483-e36e-454d-84f5-59e45c43d2f5 tempest-SnapshotsActionsTest-1617821023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f646bc70-0f7a-4816-973f-cb225b9e9e6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:54:19 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-18eb8483-e36e-454d-84f5-59e45c43d2f5 tempest-SnapshotsActionsTest-1617821023 None] Volume 46d356a2-75af-4ae3-a828-0b1c37b99bae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-46d356a2-75af-4ae3-a828-0b1c37b99bae', 'volume_size': 1}
Jul 02 19:54:19 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-18eb8483-e36e-454d-84f5-59e45c43d2f5 tempest-SnapshotsActionsTest-1617821023 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:54:19 devstack sudo[98550]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fe594add-05cd-4167-8d69-b57ffac5f626_oczfjmaodevstack@QuobyteHD
Jul 02 19:54:19 devstack sudo[98550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:54:19 devstack sudo[98548]: pam_unix(sudo:session): session closed for user root
Jul 02 19:54:20 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-92f017ff-a1fa-438d-a5c7-065159d62e7c tempest-VolumesDeleteCascade-296710616 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-c1df93fb-9c6b-40cb-90f1-4be50507dade" returned: 0 in 0.874s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:54:20 devstack cinder-volume[86639]: DEBUG cinder.utils [None req-92f017ff-a1fa-438d-a5c7-065159d62e7c tempest-VolumesDeleteCascade-296710616 None] Path /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8717a525-587f-46ab-b35e-d8570ad56d7f not found in is_blk_device check {{(pid=86639) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 02 19:54:20 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-92f017ff-a1fa-438d-a5c7-065159d62e7c tempest-VolumesDeleteCascade-296710616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-c1df93fb-9c6b-40cb-90f1-4be50507dade /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8717a525-587f-46ab-b35e-d8570ad56d7f {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:54:20 devstack sudo[98556]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-c1df93fb-9c6b-40cb-90f1-4be50507dade /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8717a525-587f-46ab-b35e-d8570ad56d7f
Jul 02 19:54:20 devstack sudo[98556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:54:20 devstack sudo[98550]: pam_unix(sudo:session): session closed for user root
Jul 02 19:54:20 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-4aa21129-23ac-4813-92af-f8cde5f58909 tempest-TestInstancesWithCinderVolumes-1877930177 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fe594add-05cd-4167-8d69-b57ffac5f626_oczfjmaodevstack@QuobyteHD" returned: 0 in 0.875s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:54:20 devstack cinder-volume[86639]: DEBUG cinder.image.image_utils [None req-4aa21129-23ac-4813-92af-f8cde5f58909 tempest-TestInstancesWithCinderVolumes-1877930177 None] Temporary image fe594add-05cd-4167-8d69-b57ffac5f626 is fetched for user e1047049d3b64224916be57eeeb35ddb. {{(pid=86639) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jul 02 19:54:20 devstack cinder-volume[86639]: DEBUG dbcounter [-] [86639] Writing DB stats cinder:SELECT=97,cinder:UPDATE=122,cinder:DELETE=11,cinder:INSERT=33 {{(pid=86639) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 02 19:54:20 devstack cinder-volume[86639]: DEBUG dbcounter [-] [86639] Writing DB stats cinder:SELECT=102,cinder:UPDATE=121,cinder:INSERT=25,cinder:DELETE=7 {{(pid=86639) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 02 19:54:20 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf348c8c-1818-4ee8-b3df-9d54dcda904d]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 19:54:20 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-4aa21129-23ac-4813-92af-f8cde5f58909 tempest-TestInstancesWithCinderVolumes-1877930177 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fe594add-05cd-4167-8d69-b57ffac5f626_oczfjmaodevstack@QuobyteHD {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:54:20 devstack sudo[98561]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fe594add-05cd-4167-8d69-b57ffac5f626_oczfjmaodevstack@QuobyteHD
Jul 02 19:54:20 devstack sudo[98561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:54:21 devstack sudo[98561]: pam_unix(sudo:session): session closed for user root
Jul 02 19:54:21 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-4aa21129-23ac-4813-92af-f8cde5f58909 tempest-TestInstancesWithCinderVolumes-1877930177 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fe594add-05cd-4167-8d69-b57ffac5f626_oczfjmaodevstack@QuobyteHD" returned: 0 in 0.847s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:54:21 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-4aa21129-23ac-4813-92af-f8cde5f58909 tempest-TestInstancesWithCinderVolumes-1877930177 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:54:25 devstack sudo[98556]: pam_unix(sudo:session): session closed for user root
Jul 02 19:54:25 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-92f017ff-a1fa-438d-a5c7-065159d62e7c tempest-VolumesDeleteCascade-296710616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-c1df93fb-9c6b-40cb-90f1-4be50507dade /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8717a525-587f-46ab-b35e-d8570ad56d7f" returned: 0 in 5.105s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:54:25 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd8341a4-867b-4612-a1cb-d62ccff9d991]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 19:54:25 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-92f017ff-a1fa-438d-a5c7-065159d62e7c tempest-VolumesDeleteCascade-296710616 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-c1df93fb-9c6b-40cb-90f1-4be50507dade {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:54:25 devstack sudo[98578]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-c1df93fb-9c6b-40cb-90f1-4be50507dade
Jul 02 19:54:25 devstack sudo[98578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:54:26 devstack sudo[98578]: pam_unix(sudo:session): session closed for user root
Jul 02 19:54:26 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-92f017ff-a1fa-438d-a5c7-065159d62e7c tempest-VolumesDeleteCascade-296710616 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-c1df93fb-9c6b-40cb-90f1-4be50507dade" returned: 0 in 0.947s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:54:26 devstack cinder-volume[86639]: DEBUG cinder.image.image_utils [None req-92f017ff-a1fa-438d-a5c7-065159d62e7c tempest-VolumesDeleteCascade-296710616 None] Image conversion details: src /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-c1df93fb-9c6b-40cb-90f1-4be50507dade, size 1024.00 MB, duration 5.11 sec, destination /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8717a525-587f-46ab-b35e-d8570ad56d7f {{(pid=86639) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 02 19:54:26 devstack cinder-volume[86639]: INFO cinder.image.image_utils [None req-92f017ff-a1fa-438d-a5c7-065159d62e7c tempest-VolumesDeleteCascade-296710616 None] Converted 1024.00 MB image at 200.56 MB/s
Jul 02 19:54:26 devstack cinder-volume[86639]: WARNING cinder.volume.drivers.remotefs [None req-92f017ff-a1fa-438d-a5c7-065159d62e7c tempest-VolumesDeleteCascade-296710616 None] /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8717a525-587f-46ab-b35e-d8570ad56d7f is being set with open permissions: ugo+rw
Jul 02 19:54:26 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-92f017ff-a1fa-438d-a5c7-065159d62e7c tempest-VolumesDeleteCascade-296710616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8717a525-587f-46ab-b35e-d8570ad56d7f {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:54:26 devstack sudo[98583]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8717a525-587f-46ab-b35e-d8570ad56d7f
Jul 02 19:54:26 devstack sudo[98583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:54:26 devstack sudo[98583]: pam_unix(sudo:session): session closed for user root
Jul 02 19:54:26 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-92f017ff-a1fa-438d-a5c7-065159d62e7c tempest-VolumesDeleteCascade-296710616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8717a525-587f-46ab-b35e-d8570ad56d7f" returned: 0 in 0.692s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:54:26 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-92f017ff-a1fa-438d-a5c7-065159d62e7c tempest-VolumesDeleteCascade-296710616 None] Lock "cinder-quobyte-8717a525-587f-46ab-b35e-d8570ad56d7f" released by "_copy_volume_from_snapshot" :: held 8.675s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:54:26 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-92f017ff-a1fa-438d-a5c7-065159d62e7c tempest-VolumesDeleteCascade-296710616 None] Lock "cinder-quobyte-b541625b-7d6c-4d77-aab2-5930290aac0c-8717a525-587f-46ab-b35e-d8570ad56d7f" released by "_create_volume_from_snapshot" :: held 8.731s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:54:26 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-92f017ff-a1fa-438d-a5c7-065159d62e7c tempest-VolumesDeleteCascade-296710616 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.758s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:54:26 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-18eb8483-e36e-454d-84f5-59e45c43d2f5 tempest-SnapshotsActionsTest-1617821023 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.332s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:54:26 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-18eb8483-e36e-454d-84f5-59e45c43d2f5 tempest-SnapshotsActionsTest-1617821023 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce906cb830>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T17:54:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1041239686',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46d356a2-75af-4ae3-a828-0b1c37b99bae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5275d577773549d59d024bc9e2e985fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T17:54:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T17:54:19Z,use_quota=True,user_id='a5c752baaf90430abfd564f8a918325e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)}" {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 19:54:26 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-18eb8483-e36e-454d-84f5-59e45c43d2f5 tempest-SnapshotsActionsTest-1617821023 None] Creating volume 46d356a2-75af-4ae3-a828-0b1c37b99bae {{(pid=86639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 19:54:26 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-18eb8483-e36e-454d-84f5-59e45c43d2f5 tempest-SnapshotsActionsTest-1617821023 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:54:26 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-18eb8483-e36e-454d-84f5-59e45c43d2f5 tempest-SnapshotsActionsTest-1617821023 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:54:26 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-18eb8483-e36e-454d-84f5-59e45c43d2f5 tempest-SnapshotsActionsTest-1617821023 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 19:54:26 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-18eb8483-e36e-454d-84f5-59e45c43d2f5 tempest-SnapshotsActionsTest-1617821023 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 19:54:26 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-18eb8483-e36e-454d-84f5-59e45c43d2f5 tempest-SnapshotsActionsTest-1617821023 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:54:26 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-18eb8483-e36e-454d-84f5-59e45c43d2f5 tempest-SnapshotsActionsTest-1617821023 None] Selected osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92 as target Quobyte volume. {{(pid=86639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 19:54:26 devstack cinder-volume[86639]: INFO cinder.volume.drivers.remotefs [None req-18eb8483-e36e-454d-84f5-59e45c43d2f5 tempest-SnapshotsActionsTest-1617821023 None] casted to osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92
Jul 02 19:54:26 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-18eb8483-e36e-454d-84f5-59e45c43d2f5 tempest-SnapshotsActionsTest-1617821023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-46d356a2-75af-4ae3-a828-0b1c37b99bae 1073741824 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:54:26 devstack sudo[98586]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-46d356a2-75af-4ae3-a828-0b1c37b99bae 1073741824
Jul 02 19:54:26 devstack sudo[98586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:54:26 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-92f017ff-a1fa-438d-a5c7-065159d62e7c tempest-VolumesDeleteCascade-296710616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (855e3c41-2837-4542-9e59-b4928dfb49d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8717a525-587f-46ab-b35e-d8570ad56d7f', 'volume_size': 1, 'snapshot_id': 'b541625b-7d6c-4d77-aab2-5930290aac0c'}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:54:26 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-92f017ff-a1fa-438d-a5c7-065159d62e7c tempest-VolumesDeleteCascade-296710616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1f9be6f-3e9a-4136-be6e-299277634209) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:54:26 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-92f017ff-a1fa-438d-a5c7-065159d62e7c tempest-VolumesDeleteCascade-296710616 None] Volume volume-8717a525-587f-46ab-b35e-d8570ad56d7f (8717a525-587f-46ab-b35e-d8570ad56d7f): created successfully
Jul 02 19:54:26 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-92f017ff-a1fa-438d-a5c7-065159d62e7c tempest-VolumesDeleteCascade-296710616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1f9be6f-3e9a-4136-be6e-299277634209) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:54:26 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-92f017ff-a1fa-438d-a5c7-065159d62e7c tempest-VolumesDeleteCascade-296710616 None] Flow 'volume_create_manager' (02a7f031-905e-435e-bab9-58522431b427) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 19:54:26 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-92f017ff-a1fa-438d-a5c7-065159d62e7c tempest-VolumesDeleteCascade-296710616 None] Created volume successfully.
Jul 02 19:54:27 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-40102cb9-418b-48fa-b74b-2a3ecd1ab440 tempest-VolumesDeleteCascade-296710616 None] Acquiring lock "cinder-c1df93fb-9c6b-40cb-90f1-4be50507dade-delete_volume" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:54:27 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-40102cb9-418b-48fa-b74b-2a3ecd1ab440 tempest-VolumesDeleteCascade-296710616 None] Lock "cinder-c1df93fb-9c6b-40cb-90f1-4be50507dade-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:54:27 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-40102cb9-418b-48fa-b74b-2a3ecd1ab440 tempest-VolumesDeleteCascade-296710616 None] Performing cascade delete. {{(pid=86639) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Jul 02 19:54:27 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-40102cb9-418b-48fa-b74b-2a3ecd1ab440 tempest-VolumesDeleteCascade-296710616 None] Acquiring lock "cinder-b541625b-7d6c-4d77-aab2-5930290aac0c-delete_snapshot" by "delete_snapshot" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:54:27 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-40102cb9-418b-48fa-b74b-2a3ecd1ab440 tempest-VolumesDeleteCascade-296710616 None] Lock "cinder-b541625b-7d6c-4d77-aab2-5930290aac0c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:54:27 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-40102cb9-418b-48fa-b74b-2a3ecd1ab440 tempest-VolumesDeleteCascade-296710616 None] Acquiring lock "cinder-quobyte-c1df93fb-9c6b-40cb-90f1-4be50507dade" by "delete_snapshot" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:54:27 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-40102cb9-418b-48fa-b74b-2a3ecd1ab440 tempest-VolumesDeleteCascade-296710616 None] Lock "cinder-quobyte-c1df93fb-9c6b-40cb-90f1-4be50507dade" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:54:27 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-40102cb9-418b-48fa-b74b-2a3ecd1ab440 tempest-VolumesDeleteCascade-296710616 None] Acquiring lock "cinder-quobyte-b541625b-7d6c-4d77-aab2-5930290aac0c" by "_delete_snapshot" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:54:27 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-40102cb9-418b-48fa-b74b-2a3ecd1ab440 tempest-VolumesDeleteCascade-296710616 None] Lock "cinder-quobyte-b541625b-7d6c-4d77-aab2-5930290aac0c" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:54:27 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-40102cb9-418b-48fa-b74b-2a3ecd1ab440 tempest-VolumesDeleteCascade-296710616 None] Deleting offline snapshot b541625b-7d6c-4d77-aab2-5930290aac0c of volume c1df93fb-9c6b-40cb-90f1-4be50507dade {{(pid=86639) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 02 19:54:27 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-40102cb9-418b-48fa-b74b-2a3ecd1ab440 tempest-VolumesDeleteCascade-296710616 None] snapshot_file for this snap is: volume-c1df93fb-9c6b-40cb-90f1-4be50507dade.b541625b-7d6c-4d77-aab2-5930290aac0c {{(pid=86639) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 02 19:54:27 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[21a1ba2c-d612-4a0c-861b-79da8e6cef28]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 19:54:27 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-40102cb9-418b-48fa-b74b-2a3ecd1ab440 tempest-VolumesDeleteCascade-296710616 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-c1df93fb-9c6b-40cb-90f1-4be50507dade.b541625b-7d6c-4d77-aab2-5930290aac0c {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:54:27 devstack sudo[98586]: pam_unix(sudo:session): session closed for user root
Jul 02 19:54:27 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-18eb8483-e36e-454d-84f5-59e45c43d2f5 tempest-SnapshotsActionsTest-1617821023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-46d356a2-75af-4ae3-a828-0b1c37b99bae 1073741824" returned: 0 in 0.925s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:54:27 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-18eb8483-e36e-454d-84f5-59e45c43d2f5 tempest-SnapshotsActionsTest-1617821023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-46d356a2-75af-4ae3-a828-0b1c37b99bae {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:54:27 devstack sudo[98593]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-46d356a2-75af-4ae3-a828-0b1c37b99bae
Jul 02 19:54:27 devstack sudo[98593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:54:27 devstack sudo[98592]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-c1df93fb-9c6b-40cb-90f1-4be50507dade.b541625b-7d6c-4d77-aab2-5930290aac0c
Jul 02 19:54:27 devstack sudo[98592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:54:28 devstack sudo[98593]: pam_unix(sudo:session): session closed for user root
Jul 02 19:54:28 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-18eb8483-e36e-454d-84f5-59e45c43d2f5 tempest-SnapshotsActionsTest-1617821023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-46d356a2-75af-4ae3-a828-0b1c37b99bae" returned: 0 in 0.679s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:54:28 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-18eb8483-e36e-454d-84f5-59e45c43d2f5 tempest-SnapshotsActionsTest-1617821023 None] <== create_volume: return (1651ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'} {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 19:54:28 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-18eb8483-e36e-454d-84f5-59e45c43d2f5 tempest-SnapshotsActionsTest-1617821023 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.654s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:54:28 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-4aa21129-23ac-4813-92af-f8cde5f58909 tempest-TestInstancesWithCinderVolumes-1877930177 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.241s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:54:28 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-4aa21129-23ac-4813-92af-f8cde5f58909 tempest-TestInstancesWithCinderVolumes-1877930177 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce906cb830>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T17:54:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-549424812',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b318261-668e-4454-af8f-b593a15f2a15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24ff03127e8c4c3db47ed4087bc99478',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T17:54:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T17:54:14Z,use_quota=True,user_id='e1047049d3b64224916be57eeeb35ddb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cf2ac8e6-3fd3-49c1-810a-59b6536504d2),volume_type_id=cf2ac8e6-3fd3-49c1-810a-59b6536504d2)}" {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 19:54:28 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-4aa21129-23ac-4813-92af-f8cde5f58909 tempest-TestInstancesWithCinderVolumes-1877930177 None] Creating volume 9b318261-668e-4454-af8f-b593a15f2a15 {{(pid=86639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 19:54:28 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-4aa21129-23ac-4813-92af-f8cde5f58909 tempest-TestInstancesWithCinderVolumes-1877930177 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:54:28 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-4aa21129-23ac-4813-92af-f8cde5f58909 tempest-TestInstancesWithCinderVolumes-1877930177 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:54:28 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-4aa21129-23ac-4813-92af-f8cde5f58909 tempest-TestInstancesWithCinderVolumes-1877930177 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 19:54:28 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-4aa21129-23ac-4813-92af-f8cde5f58909 tempest-TestInstancesWithCinderVolumes-1877930177 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 19:54:28 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-4aa21129-23ac-4813-92af-f8cde5f58909 tempest-TestInstancesWithCinderVolumes-1877930177 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:54:28 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-4aa21129-23ac-4813-92af-f8cde5f58909 tempest-TestInstancesWithCinderVolumes-1877930177 None] Selected osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92 as target Quobyte volume. {{(pid=86639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 19:54:28 devstack cinder-volume[86639]: INFO cinder.volume.drivers.remotefs [None req-4aa21129-23ac-4813-92af-f8cde5f58909 tempest-TestInstancesWithCinderVolumes-1877930177 None] casted to osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92
Jul 02 19:54:28 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-4aa21129-23ac-4813-92af-f8cde5f58909 tempest-TestInstancesWithCinderVolumes-1877930177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-9b318261-668e-4454-af8f-b593a15f2a15 1073741824 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:54:28 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-18eb8483-e36e-454d-84f5-59e45c43d2f5 tempest-SnapshotsActionsTest-1617821023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f646bc70-0f7a-4816-973f-cb225b9e9e6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46d356a2-75af-4ae3-a828-0b1c37b99bae', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:54:28 devstack sudo[98638]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-9b318261-668e-4454-af8f-b593a15f2a15 1073741824
Jul 02 19:54:28 devstack sudo[98638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:54:28 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-18eb8483-e36e-454d-84f5-59e45c43d2f5 tempest-SnapshotsActionsTest-1617821023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49cee509-65d6-4f06-99c5-7749fb47581f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:54:28 devstack sudo[98592]: pam_unix(sudo:session): session closed for user root
Jul 02 19:54:28 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-40102cb9-418b-48fa-b74b-2a3ecd1ab440 tempest-VolumesDeleteCascade-296710616 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-c1df93fb-9c6b-40cb-90f1-4be50507dade.b541625b-7d6c-4d77-aab2-5930290aac0c" returned: 0 in 0.827s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:54:28 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-40102cb9-418b-48fa-b74b-2a3ecd1ab440 tempest-VolumesDeleteCascade-296710616 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c1df93fb-9c6b-40cb-90f1-4be50507dade(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86639) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 02 19:54:28 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-18eb8483-e36e-454d-84f5-59e45c43d2f5 tempest-SnapshotsActionsTest-1617821023 None] Volume volume-46d356a2-75af-4ae3-a828-0b1c37b99bae (46d356a2-75af-4ae3-a828-0b1c37b99bae): created successfully
Jul 02 19:54:28 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-18eb8483-e36e-454d-84f5-59e45c43d2f5 tempest-SnapshotsActionsTest-1617821023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49cee509-65d6-4f06-99c5-7749fb47581f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:54:28 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-18eb8483-e36e-454d-84f5-59e45c43d2f5 tempest-SnapshotsActionsTest-1617821023 None] Flow 'volume_create_manager' (c814def3-0107-4b82-9327-b65fa1c87fc1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 19:54:28 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[3315f6e0-31a5-477e-9296-9b5e2be8cff9]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 19:54:28 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-40102cb9-418b-48fa-b74b-2a3ecd1ab440 tempest-VolumesDeleteCascade-296710616 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-c1df93fb-9c6b-40cb-90f1-4be50507dade {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:54:28 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-18eb8483-e36e-454d-84f5-59e45c43d2f5 tempest-SnapshotsActionsTest-1617821023 None] Created volume successfully.
Jul 02 19:54:28 devstack sudo[98640]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-c1df93fb-9c6b-40cb-90f1-4be50507dade
Jul 02 19:54:28 devstack sudo[98640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:54:29 devstack sudo[98640]: pam_unix(sudo:session): session closed for user root
Jul 02 19:54:29 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-40102cb9-418b-48fa-b74b-2a3ecd1ab440 tempest-VolumesDeleteCascade-296710616 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-c1df93fb-9c6b-40cb-90f1-4be50507dade" returned: 0 in 0.840s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:54:29 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-40102cb9-418b-48fa-b74b-2a3ecd1ab440 tempest-VolumesDeleteCascade-296710616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-c1df93fb-9c6b-40cb-90f1-4be50507dade.b541625b-7d6c-4d77-aab2-5930290aac0c {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:54:29 devstack sudo[98650]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-c1df93fb-9c6b-40cb-90f1-4be50507dade.b541625b-7d6c-4d77-aab2-5930290aac0c
Jul 02 19:54:29 devstack sudo[98650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:54:29 devstack sudo[98638]: pam_unix(sudo:session): session closed for user root
Jul 02 19:54:29 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-4aa21129-23ac-4813-92af-f8cde5f58909 tempest-TestInstancesWithCinderVolumes-1877930177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-9b318261-668e-4454-af8f-b593a15f2a15 1073741824" returned: 0 in 0.966s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:54:29 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-f8f1e554-a88c-4bc7-8ebf-887dc0574878 tempest-SnapshotsActionsTest-1617821023 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:54:29 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-4aa21129-23ac-4813-92af-f8cde5f58909 tempest-TestInstancesWithCinderVolumes-1877930177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-9b318261-668e-4454-af8f-b593a15f2a15 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:54:29 devstack sudo[98652]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-9b318261-668e-4454-af8f-b593a15f2a15
Jul 02 19:54:29 devstack sudo[98652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:54:30 devstack sudo[98652]: pam_unix(sudo:session): session closed for user root
Jul 02 19:54:30 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-4aa21129-23ac-4813-92af-f8cde5f58909 tempest-TestInstancesWithCinderVolumes-1877930177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-9b318261-668e-4454-af8f-b593a15f2a15" returned: 0 in 0.697s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:54:30 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-4aa21129-23ac-4813-92af-f8cde5f58909 tempest-TestInstancesWithCinderVolumes-1877930177 None] <== create_volume: return (1735ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'} {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 19:54:30 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-4aa21129-23ac-4813-92af-f8cde5f58909 tempest-TestInstancesWithCinderVolumes-1877930177 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.739s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:54:30 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-f8f1e554-a88c-4bc7-8ebf-887dc0574878 tempest-SnapshotsActionsTest-1617821023 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.712s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:54:30 devstack sudo[98650]: pam_unix(sudo:session): session closed for user root
Jul 02 19:54:30 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-40102cb9-418b-48fa-b74b-2a3ecd1ab440 tempest-VolumesDeleteCascade-296710616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-c1df93fb-9c6b-40cb-90f1-4be50507dade.b541625b-7d6c-4d77-aab2-5930290aac0c" returned: 0 in 0.837s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:54:30 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-f8f1e554-a88c-4bc7-8ebf-887dc0574878 tempest-SnapshotsActionsTest-1617821023 None] Creating offline snapshot 7186926e-6740-4ea9-8d45-1f115e50ba78 of volume 46d356a2-75af-4ae3-a828-0b1c37b99bae {{(pid=86639) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 02 19:54:30 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-40102cb9-418b-48fa-b74b-2a3ecd1ab440 tempest-VolumesDeleteCascade-296710616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-c1df93fb-9c6b-40cb-90f1-4be50507dade.b541625b-7d6c-4d77-aab2-5930290aac0c {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:54:30 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[aceb3798-1bba-40fb-894c-e1a7150e6a7c]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 19:54:30 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-f8f1e554-a88c-4bc7-8ebf-887dc0574878 tempest-SnapshotsActionsTest-1617821023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-46d356a2-75af-4ae3-a828-0b1c37b99bae {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:54:30 devstack sudo[98658]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-c1df93fb-9c6b-40cb-90f1-4be50507dade.b541625b-7d6c-4d77-aab2-5930290aac0c
Jul 02 19:54:30 devstack sudo[98658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:54:30 devstack cinder-volume[86639]: DEBUG cinder.volume.volume_utils [None req-4aa21129-23ac-4813-92af-f8cde5f58909 tempest-TestInstancesWithCinderVolumes-1877930177 None] Attempting download of fe594add-05cd-4167-8d69-b57ffac5f626 ((None, [{'url': 'file:///opt/stack/data/glance/images/fe594add-05cd-4167-8d69-b57ffac5f626', 'metadata': {}}])) to volume 9b318261-668e-4454-af8f-b593a15f2a15. {{(pid=86639) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jul 02 19:54:30 devstack sudo[98659]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-46d356a2-75af-4ae3-a828-0b1c37b99bae
Jul 02 19:54:30 devstack sudo[98659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:54:30 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd13da9e-7e5c-458e-b92e-1aa67ca01d02]: (4, 'raw') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 19:54:30 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-4aa21129-23ac-4813-92af-f8cde5f58909 tempest-TestInstancesWithCinderVolumes-1877930177 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fe594add-05cd-4167-8d69-b57ffac5f626_c350m697 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:54:30 devstack sudo[98662]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fe594add-05cd-4167-8d69-b57ffac5f626_c350m697
Jul 02 19:54:30 devstack sudo[98662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:54:30 devstack sudo[98658]: pam_unix(sudo:session): session closed for user root
Jul 02 19:54:30 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-40102cb9-418b-48fa-b74b-2a3ecd1ab440 tempest-VolumesDeleteCascade-296710616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-c1df93fb-9c6b-40cb-90f1-4be50507dade.b541625b-7d6c-4d77-aab2-5930290aac0c" returned: 0 in 0.750s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:54:31 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-40102cb9-418b-48fa-b74b-2a3ecd1ab440 tempest-VolumesDeleteCascade-296710616 None] Lock "cinder-quobyte-b541625b-7d6c-4d77-aab2-5930290aac0c" released by "_delete_snapshot" :: held 3.363s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:54:31 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-40102cb9-418b-48fa-b74b-2a3ecd1ab440 tempest-VolumesDeleteCascade-296710616 None] Lock "cinder-quobyte-c1df93fb-9c6b-40cb-90f1-4be50507dade" released by "delete_snapshot" :: held 3.385s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:54:31 devstack sudo[98659]: pam_unix(sudo:session): session closed for user root
Jul 02 19:54:31 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-f8f1e554-a88c-4bc7-8ebf-887dc0574878 tempest-SnapshotsActionsTest-1617821023 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-46d356a2-75af-4ae3-a828-0b1c37b99bae" returned: 0 in 0.823s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:54:31 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-f8f1e554-a88c-4bc7-8ebf-887dc0574878 tempest-SnapshotsActionsTest-1617821023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-46d356a2-75af-4ae3-a828-0b1c37b99bae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-46d356a2-75af-4ae3-a828-0b1c37b99bae.7186926e-6740-4ea9-8d45-1f115e50ba78 1G {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:54:31 devstack cinder-volume[86639]: DEBUG cinder.quota [None req-40102cb9-418b-48fa-b74b-2a3ecd1ab440 tempest-VolumesDeleteCascade-296710616 None] Created reservations ['b693f28a-712c-40d3-8ff9-556fb203650d', 'a76456e9-658a-48cd-a137-f4f4f83d9ee5', 'f7116030-eab1-4db0-b310-36c1ed03277e', 'bf1f318b-c2fd-4065-8b29-ddd2b80c492c'] {{(pid=86639) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 19:54:31 devstack sudo[98668]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-46d356a2-75af-4ae3-a828-0b1c37b99bae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-46d356a2-75af-4ae3-a828-0b1c37b99bae.7186926e-6740-4ea9-8d45-1f115e50ba78 1G
Jul 02 19:54:31 devstack sudo[98668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:54:31 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-40102cb9-418b-48fa-b74b-2a3ecd1ab440 tempest-VolumesDeleteCascade-296710616 None] Delete snapshot completed successfully.
Jul 02 19:54:31 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-40102cb9-418b-48fa-b74b-2a3ecd1ab440 tempest-VolumesDeleteCascade-296710616 None] Lock "cinder-b541625b-7d6c-4d77-aab2-5930290aac0c-delete_snapshot" released by "delete_snapshot" :: held 3.578s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:54:31 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-40102cb9-418b-48fa-b74b-2a3ecd1ab440 tempest-VolumesDeleteCascade-296710616 None] Snapshots deleted, issuing volume delete {{(pid=86639) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Jul 02 19:54:31 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-40102cb9-418b-48fa-b74b-2a3ecd1ab440 tempest-VolumesDeleteCascade-296710616 None] Acquiring lock "cinder-quobyte-c1df93fb-9c6b-40cb-90f1-4be50507dade" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:54:31 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-40102cb9-418b-48fa-b74b-2a3ecd1ab440 tempest-VolumesDeleteCascade-296710616 None] Lock "cinder-quobyte-c1df93fb-9c6b-40cb-90f1-4be50507dade" acquired by "delete_volume" :: waited 0.018s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:54:31 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e057962-0bba-4995-a537-2957e2a52ed0]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 19:54:31 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-40102cb9-418b-48fa-b74b-2a3ecd1ab440 tempest-VolumesDeleteCascade-296710616 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-c1df93fb-9c6b-40cb-90f1-4be50507dade {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:54:31 devstack sudo[98662]: pam_unix(sudo:session): session closed for user root
Jul 02 19:54:31 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-4aa21129-23ac-4813-92af-f8cde5f58909 tempest-TestInstancesWithCinderVolumes-1877930177 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fe594add-05cd-4167-8d69-b57ffac5f626_c350m697" returned: 0 in 0.783s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:54:31 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-4aa21129-23ac-4813-92af-f8cde5f58909 tempest-TestInstancesWithCinderVolumes-1877930177 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fe594add-05cd-4167-8d69-b57ffac5f626_c350m697 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:54:31 devstack sudo[98672]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-c1df93fb-9c6b-40cb-90f1-4be50507dade
Jul 02 19:54:31 devstack sudo[98672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:54:31 devstack sudo[98673]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fe594add-05cd-4167-8d69-b57ffac5f626_c350m697
Jul 02 19:54:31 devstack sudo[98673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:54:32 devstack sudo[98668]: pam_unix(sudo:session): session closed for user root
Jul 02 19:54:32 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-f8f1e554-a88c-4bc7-8ebf-887dc0574878 tempest-SnapshotsActionsTest-1617821023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-46d356a2-75af-4ae3-a828-0b1c37b99bae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-46d356a2-75af-4ae3-a828-0b1c37b99bae.7186926e-6740-4ea9-8d45-1f115e50ba78 1G" returned: 0 in 0.965s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:54:32 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-f8f1e554-a88c-4bc7-8ebf-887dc0574878 tempest-SnapshotsActionsTest-1617821023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-46d356a2-75af-4ae3-a828-0b1c37b99bae -F qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-46d356a2-75af-4ae3-a828-0b1c37b99bae.7186926e-6740-4ea9-8d45-1f115e50ba78 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:54:32 devstack sudo[98684]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-46d356a2-75af-4ae3-a828-0b1c37b99bae -F qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-46d356a2-75af-4ae3-a828-0b1c37b99bae.7186926e-6740-4ea9-8d45-1f115e50ba78
Jul 02 19:54:32 devstack sudo[98684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:54:32 devstack sudo[98673]: pam_unix(sudo:session): session closed for user root
Jul 02 19:54:32 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-4aa21129-23ac-4813-92af-f8cde5f58909 tempest-TestInstancesWithCinderVolumes-1877930177 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fe594add-05cd-4167-8d69-b57ffac5f626_c350m697" returned: 1 in 0.778s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:54:32 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-4aa21129-23ac-4813-92af-f8cde5f58909 tempest-TestInstancesWithCinderVolumes-1877930177 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fe594add-05cd-4167-8d69-b57ffac5f626_c350m697' failed. Not Retrying. {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 02 19:54:32 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[70393ae8-ebe1-409f-a032-2a89e99eae1d]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 19:54:32 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-4aa21129-23ac-4813-92af-f8cde5f58909 tempest-TestInstancesWithCinderVolumes-1877930177 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fe594add-05cd-4167-8d69-b57ffac5f626_oczfjmaodevstack@QuobyteHD {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:54:32 devstack sudo[98672]: pam_unix(sudo:session): session closed for user root
Jul 02 19:54:32 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-40102cb9-418b-48fa-b74b-2a3ecd1ab440 tempest-VolumesDeleteCascade-296710616 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-c1df93fb-9c6b-40cb-90f1-4be50507dade" returned: 0 in 0.861s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:54:32 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-40102cb9-418b-48fa-b74b-2a3ecd1ab440 tempest-VolumesDeleteCascade-296710616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-c1df93fb-9c6b-40cb-90f1-4be50507dade {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:54:32 devstack sudo[98687]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-c1df93fb-9c6b-40cb-90f1-4be50507dade
Jul 02 19:54:32 devstack sudo[98687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:54:32 devstack sudo[98686]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fe594add-05cd-4167-8d69-b57ffac5f626_oczfjmaodevstack@QuobyteHD
Jul 02 19:54:32 devstack sudo[98686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:54:32 devstack sudo[98687]: pam_unix(sudo:session): session closed for user root
Jul 02 19:54:32 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-40102cb9-418b-48fa-b74b-2a3ecd1ab440 tempest-VolumesDeleteCascade-296710616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-c1df93fb-9c6b-40cb-90f1-4be50507dade" returned: 0 in 0.666s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:54:32 devstack sudo[98684]: pam_unix(sudo:session): session closed for user root
Jul 02 19:54:32 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-f8f1e554-a88c-4bc7-8ebf-887dc0574878 tempest-SnapshotsActionsTest-1617821023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-46d356a2-75af-4ae3-a828-0b1c37b99bae -F qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-46d356a2-75af-4ae3-a828-0b1c37b99bae.7186926e-6740-4ea9-8d45-1f115e50ba78" returned: 0 in 0.756s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:54:32 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-40102cb9-418b-48fa-b74b-2a3ecd1ab440 tempest-VolumesDeleteCascade-296710616 None] Lock "cinder-quobyte-c1df93fb-9c6b-40cb-90f1-4be50507dade" released by "delete_volume" :: held 1.596s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:54:32 devstack cinder-volume[86639]: WARNING cinder.volume.drivers.remotefs [None req-f8f1e554-a88c-4bc7-8ebf-887dc0574878 tempest-SnapshotsActionsTest-1617821023 None] /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-46d356a2-75af-4ae3-a828-0b1c37b99bae.7186926e-6740-4ea9-8d45-1f115e50ba78 is being set with open permissions: ugo+rw
Jul 02 19:54:32 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-f8f1e554-a88c-4bc7-8ebf-887dc0574878 tempest-SnapshotsActionsTest-1617821023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-46d356a2-75af-4ae3-a828-0b1c37b99bae.7186926e-6740-4ea9-8d45-1f115e50ba78 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:54:32 devstack sudo[98700]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-46d356a2-75af-4ae3-a828-0b1c37b99bae.7186926e-6740-4ea9-8d45-1f115e50ba78
Jul 02 19:54:32 devstack sudo[98700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:54:32 devstack cinder-volume[86639]: DEBUG cinder.quota [None req-40102cb9-418b-48fa-b74b-2a3ecd1ab440 tempest-VolumesDeleteCascade-296710616 None] Created reservations ['b36db1f5-8faf-4f8e-adef-f14920e4557e', '7841afec-8c9f-4cde-8e84-e42483f06023', 'c575f6cd-3fe6-4c2f-aa2a-c3ed199bc70c', '465c9147-8ebc-48ca-a3f2-e0f49ed01a07'] {{(pid=86639) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 19:54:32 devstack sudo[98686]: pam_unix(sudo:session): session closed for user root
Jul 02 19:54:32 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-4aa21129-23ac-4813-92af-f8cde5f58909 tempest-TestInstancesWithCinderVolumes-1877930177 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fe594add-05cd-4167-8d69-b57ffac5f626_oczfjmaodevstack@QuobyteHD" returned: 0 in 0.849s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:54:32 devstack cinder-volume[86639]: DEBUG cinder.image.image_utils [None req-4aa21129-23ac-4813-92af-f8cde5f58909 tempest-TestInstancesWithCinderVolumes-1877930177 None] fe594add-05cd-4167-8d69-b57ffac5f626 was qcow2, converting to raw {{(pid=86639) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jul 02 19:54:32 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-4aa21129-23ac-4813-92af-f8cde5f58909 tempest-TestInstancesWithCinderVolumes-1877930177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_fe594add-05cd-4167-8d69-b57ffac5f626_oczfjmaodevstack@QuobyteHD /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-9b318261-668e-4454-af8f-b593a15f2a15 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:54:32 devstack sudo[98705]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_fe594add-05cd-4167-8d69-b57ffac5f626_oczfjmaodevstack@QuobyteHD /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-9b318261-668e-4454-af8f-b593a15f2a15
Jul 02 19:54:32 devstack sudo[98705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:54:33 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-40102cb9-418b-48fa-b74b-2a3ecd1ab440 tempest-VolumesDeleteCascade-296710616 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:54:33 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-40102cb9-418b-48fa-b74b-2a3ecd1ab440 tempest-VolumesDeleteCascade-296710616 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:54:33 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-40102cb9-418b-48fa-b74b-2a3ecd1ab440 tempest-VolumesDeleteCascade-296710616 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 19:54:33 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-40102cb9-418b-48fa-b74b-2a3ecd1ab440 tempest-VolumesDeleteCascade-296710616 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 19:54:33 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-40102cb9-418b-48fa-b74b-2a3ecd1ab440 tempest-VolumesDeleteCascade-296710616 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:54:33 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-40102cb9-418b-48fa-b74b-2a3ecd1ab440 tempest-VolumesDeleteCascade-296710616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:54:33 devstack sudo[98707]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e
Jul 02 19:54:33 devstack sudo[98707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:54:33 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-2208bbd8-e026-4f1b-990b-b053abd91215 tempest-VolumesDeleteCascade-296710616 None] Acquiring lock "cinder-8717a525-587f-46ab-b35e-d8570ad56d7f-delete_volume" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:54:33 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-2208bbd8-e026-4f1b-990b-b053abd91215 tempest-VolumesDeleteCascade-296710616 None] Lock "cinder-8717a525-587f-46ab-b35e-d8570ad56d7f-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:54:33 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-2208bbd8-e026-4f1b-990b-b053abd91215 tempest-VolumesDeleteCascade-296710616 None] Acquiring lock "cinder-quobyte-8717a525-587f-46ab-b35e-d8570ad56d7f" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:54:33 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-2208bbd8-e026-4f1b-990b-b053abd91215 tempest-VolumesDeleteCascade-296710616 None] Lock "cinder-quobyte-8717a525-587f-46ab-b35e-d8570ad56d7f" acquired by "delete_volume" :: waited 0.018s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:54:33 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ec9d85b-c75f-4c23-88f2-125e9837b1ff]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 19:54:33 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-2208bbd8-e026-4f1b-990b-b053abd91215 tempest-VolumesDeleteCascade-296710616 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8717a525-587f-46ab-b35e-d8570ad56d7f {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:54:33 devstack sudo[98710]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8717a525-587f-46ab-b35e-d8570ad56d7f
Jul 02 19:54:33 devstack sudo[98710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:54:33 devstack sudo[98700]: pam_unix(sudo:session): session closed for user root
Jul 02 19:54:33 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-f8f1e554-a88c-4bc7-8ebf-887dc0574878 tempest-SnapshotsActionsTest-1617821023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-46d356a2-75af-4ae3-a828-0b1c37b99bae.7186926e-6740-4ea9-8d45-1f115e50ba78" returned: 0 in 0.738s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:54:33 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-f8f1e554-a88c-4bc7-8ebf-887dc0574878 tempest-SnapshotsActionsTest-1617821023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-46d356a2-75af-4ae3-a828-0b1c37b99bae.info {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:54:33 devstack sudo[98713]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-46d356a2-75af-4ae3-a828-0b1c37b99bae.info
Jul 02 19:54:33 devstack sudo[98713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:54:33 devstack sudo[98707]: pam_unix(sudo:session): session closed for user root
Jul 02 19:54:33 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-40102cb9-418b-48fa-b74b-2a3ecd1ab440 tempest-VolumesDeleteCascade-296710616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e" returned: 0 in 0.858s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:54:33 devstack cinder-volume[86639]: DEBUG cinder.manager [None req-40102cb9-418b-48fa-b74b-2a3ecd1ab440 tempest-VolumesDeleteCascade-296710616 None] Notifying Schedulers of capabilities ... {{(pid=86639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 19:54:33 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-40102cb9-418b-48fa-b74b-2a3ecd1ab440 tempest-VolumesDeleteCascade-296710616 None] Deleted volume successfully.
Jul 02 19:54:33 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-40102cb9-418b-48fa-b74b-2a3ecd1ab440 tempest-VolumesDeleteCascade-296710616 None] Lock "cinder-c1df93fb-9c6b-40cb-90f1-4be50507dade-delete_volume" released by "delete_volume" :: held 6.389s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:54:34 devstack sudo[98713]: pam_unix(sudo:session): session closed for user root
Jul 02 19:54:34 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-f8f1e554-a88c-4bc7-8ebf-887dc0574878 tempest-SnapshotsActionsTest-1617821023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-46d356a2-75af-4ae3-a828-0b1c37b99bae.info" returned: 0 in 0.810s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:54:34 devstack cinder-volume[86639]: WARNING cinder.volume.drivers.remotefs [None req-f8f1e554-a88c-4bc7-8ebf-887dc0574878 tempest-SnapshotsActionsTest-1617821023 None] /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-46d356a2-75af-4ae3-a828-0b1c37b99bae.info is being set with open permissions: ugo+rw
Jul 02 19:54:34 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-f8f1e554-a88c-4bc7-8ebf-887dc0574878 tempest-SnapshotsActionsTest-1617821023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-46d356a2-75af-4ae3-a828-0b1c37b99bae.info {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:54:34 devstack sudo[98710]: pam_unix(sudo:session): session closed for user root
Jul 02 19:54:34 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-2208bbd8-e026-4f1b-990b-b053abd91215 tempest-VolumesDeleteCascade-296710616 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8717a525-587f-46ab-b35e-d8570ad56d7f" returned: 0 in 1.010s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:54:34 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-2208bbd8-e026-4f1b-990b-b053abd91215 tempest-VolumesDeleteCascade-296710616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8717a525-587f-46ab-b35e-d8570ad56d7f {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:54:34 devstack sudo[98727]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-46d356a2-75af-4ae3-a828-0b1c37b99bae.info
Jul 02 19:54:34 devstack sudo[98727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:54:34 devstack sudo[98728]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8717a525-587f-46ab-b35e-d8570ad56d7f
Jul 02 19:54:34 devstack sudo[98728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:54:35 devstack sudo[98705]: pam_unix(sudo:session): session closed for user root
Jul 02 19:54:35 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-4aa21129-23ac-4813-92af-f8cde5f58909 tempest-TestInstancesWithCinderVolumes-1877930177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_fe594add-05cd-4167-8d69-b57ffac5f626_oczfjmaodevstack@QuobyteHD /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-9b318261-668e-4454-af8f-b593a15f2a15" returned: 0 in 2.189s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:54:35 devstack cinder-volume[86639]: DEBUG cinder.image.image_utils [None req-4aa21129-23ac-4813-92af-f8cde5f58909 tempest-TestInstancesWithCinderVolumes-1877930177 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_fe594add-05cd-4167-8d69-b57ffac5f626_oczfjmaodevstack@QuobyteHD, size 112.00 MB, duration 2.19 sec, destination /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-9b318261-668e-4454-af8f-b593a15f2a15 {{(pid=86639) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 02 19:54:35 devstack cinder-volume[86639]: INFO cinder.image.image_utils [None req-4aa21129-23ac-4813-92af-f8cde5f58909 tempest-TestInstancesWithCinderVolumes-1877930177 None] Converted 112.00 MB image at 51.12 MB/s
Jul 02 19:54:35 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-4aa21129-23ac-4813-92af-f8cde5f58909 tempest-TestInstancesWithCinderVolumes-1877930177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-9b318261-668e-4454-af8f-b593a15f2a15 1G {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:54:35 devstack sudo[98732]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-9b318261-668e-4454-af8f-b593a15f2a15 1G
Jul 02 19:54:35 devstack sudo[98732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:54:35 devstack sudo[98728]: pam_unix(sudo:session): session closed for user root
Jul 02 19:54:35 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-2208bbd8-e026-4f1b-990b-b053abd91215 tempest-VolumesDeleteCascade-296710616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8717a525-587f-46ab-b35e-d8570ad56d7f" returned: 0 in 0.752s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:54:35 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-2208bbd8-e026-4f1b-990b-b053abd91215 tempest-VolumesDeleteCascade-296710616 None] Lock "cinder-quobyte-8717a525-587f-46ab-b35e-d8570ad56d7f" released by "delete_volume" :: held 1.827s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:54:35 devstack sudo[98727]: pam_unix(sudo:session): session closed for user root
Jul 02 19:54:35 devstack cinder-volume[86639]: DEBUG cinder.quota [None req-2208bbd8-e026-4f1b-990b-b053abd91215 tempest-VolumesDeleteCascade-296710616 None] Created reservations ['ef8c25b9-6345-4d1c-b4d7-41039bff5230', '6efe8dd5-432b-4781-8da7-e014658ea2bb', '8d68f262-c018-40a7-9c82-e0e6a0dac4e5', '0ca729ad-4d98-458b-ade7-f54a87b09f42'] {{(pid=86639) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 19:54:35 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-f8f1e554-a88c-4bc7-8ebf-887dc0574878 tempest-SnapshotsActionsTest-1617821023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-46d356a2-75af-4ae3-a828-0b1c37b99bae.info" returned: 0 in 0.862s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:54:35 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-f8f1e554-a88c-4bc7-8ebf-887dc0574878 tempest-SnapshotsActionsTest-1617821023 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.095s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:54:35 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-f8f1e554-a88c-4bc7-8ebf-887dc0574878 tempest-SnapshotsActionsTest-1617821023 None] Create snapshot completed successfully
Jul 02 19:54:35 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-2208bbd8-e026-4f1b-990b-b053abd91215 tempest-VolumesDeleteCascade-296710616 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:54:35 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-2208bbd8-e026-4f1b-990b-b053abd91215 tempest-VolumesDeleteCascade-296710616 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:54:35 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-2208bbd8-e026-4f1b-990b-b053abd91215 tempest-VolumesDeleteCascade-296710616 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 19:54:35 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-2208bbd8-e026-4f1b-990b-b053abd91215 tempest-VolumesDeleteCascade-296710616 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 19:54:35 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-2208bbd8-e026-4f1b-990b-b053abd91215 tempest-VolumesDeleteCascade-296710616 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:54:35 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-2208bbd8-e026-4f1b-990b-b053abd91215 tempest-VolumesDeleteCascade-296710616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:54:35 devstack sudo[98735]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e
Jul 02 19:54:35 devstack sudo[98735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:54:35 devstack sudo[98732]: pam_unix(sudo:session): session closed for user root
Jul 02 19:54:35 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-4aa21129-23ac-4813-92af-f8cde5f58909 tempest-TestInstancesWithCinderVolumes-1877930177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-9b318261-668e-4454-af8f-b593a15f2a15 1G" returned: 0 in 0.841s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:54:36 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[020f5901-0680-4525-bb79-e32416fabfff]: (4, 'raw') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 19:54:36 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-4aa21129-23ac-4813-92af-f8cde5f58909 tempest-TestInstancesWithCinderVolumes-1877930177 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-9b318261-668e-4454-af8f-b593a15f2a15 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:54:36 devstack sudo[98741]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-9b318261-668e-4454-af8f-b593a15f2a15
Jul 02 19:54:36 devstack sudo[98741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:54:36 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-68486817-9196-40ba-87c8-bd3493063207 tempest-SnapshotsActionsTest-1617821023 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:54:36 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-68486817-9196-40ba-87c8-bd3493063207 tempest-SnapshotsActionsTest-1617821023 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:54:36 devstack sudo[98735]: pam_unix(sudo:session): session closed for user root
Jul 02 19:54:36 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-2208bbd8-e026-4f1b-990b-b053abd91215 tempest-VolumesDeleteCascade-296710616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e" returned: 0 in 0.908s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:54:36 devstack cinder-volume[86639]: DEBUG cinder.manager [None req-2208bbd8-e026-4f1b-990b-b053abd91215 tempest-VolumesDeleteCascade-296710616 None] Notifying Schedulers of capabilities ... {{(pid=86639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 19:54:36 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-68486817-9196-40ba-87c8-bd3493063207 tempest-SnapshotsActionsTest-1617821023 None] Creating offline snapshot 0f582412-1295-4439-ac73-64337ff19a82 of volume 46d356a2-75af-4ae3-a828-0b1c37b99bae {{(pid=86639) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 02 19:54:36 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-2208bbd8-e026-4f1b-990b-b053abd91215 tempest-VolumesDeleteCascade-296710616 None] Deleted volume successfully.
Jul 02 19:54:36 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d1219e5-f50b-498e-813c-d111e4df8260]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 19:54:36 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-68486817-9196-40ba-87c8-bd3493063207 tempest-SnapshotsActionsTest-1617821023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-46d356a2-75af-4ae3-a828-0b1c37b99bae.7186926e-6740-4ea9-8d45-1f115e50ba78 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:54:36 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-2208bbd8-e026-4f1b-990b-b053abd91215 tempest-VolumesDeleteCascade-296710616 None] Lock "cinder-8717a525-587f-46ab-b35e-d8570ad56d7f-delete_volume" released by "delete_volume" :: held 3.189s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:54:36 devstack sudo[98744]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-46d356a2-75af-4ae3-a828-0b1c37b99bae.7186926e-6740-4ea9-8d45-1f115e50ba78
Jul 02 19:54:36 devstack sudo[98744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:54:36 devstack sudo[98741]: pam_unix(sudo:session): session closed for user root
Jul 02 19:54:36 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-4aa21129-23ac-4813-92af-f8cde5f58909 tempest-TestInstancesWithCinderVolumes-1877930177 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-9b318261-668e-4454-af8f-b593a15f2a15" returned: 0 in 0.976s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:54:36 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-4aa21129-23ac-4813-92af-f8cde5f58909 tempest-TestInstancesWithCinderVolumes-1877930177 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-9b318261-668e-4454-af8f-b593a15f2a15 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:54:37 devstack sudo[98748]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-9b318261-668e-4454-af8f-b593a15f2a15
Jul 02 19:54:37 devstack sudo[98748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:54:37 devstack sudo[98744]: pam_unix(sudo:session): session closed for user root
Jul 02 19:54:37 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-68486817-9196-40ba-87c8-bd3493063207 tempest-SnapshotsActionsTest-1617821023 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-46d356a2-75af-4ae3-a828-0b1c37b99bae.7186926e-6740-4ea9-8d45-1f115e50ba78" returned: 0 in 0.983s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:54:37 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-68486817-9196-40ba-87c8-bd3493063207 tempest-SnapshotsActionsTest-1617821023 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-46d356a2-75af-4ae3-a828-0b1c37b99bae(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86639) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 02 19:54:37 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-68486817-9196-40ba-87c8-bd3493063207 tempest-SnapshotsActionsTest-1617821023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-46d356a2-75af-4ae3-a828-0b1c37b99bae.7186926e-6740-4ea9-8d45-1f115e50ba78,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-46d356a2-75af-4ae3-a828-0b1c37b99bae.0f582412-1295-4439-ac73-64337ff19a82 1G {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:54:37 devstack sudo[98753]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-46d356a2-75af-4ae3-a828-0b1c37b99bae.7186926e-6740-4ea9-8d45-1f115e50ba78,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-46d356a2-75af-4ae3-a828-0b1c37b99bae.0f582412-1295-4439-ac73-64337ff19a82 1G
Jul 02 19:54:37 devstack sudo[98753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:54:37 devstack sudo[98748]: pam_unix(sudo:session): session closed for user root
Jul 02 19:54:37 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-4aa21129-23ac-4813-92af-f8cde5f58909 tempest-TestInstancesWithCinderVolumes-1877930177 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-9b318261-668e-4454-af8f-b593a15f2a15" returned: 1 in 0.867s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:54:37 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-4aa21129-23ac-4813-92af-f8cde5f58909 tempest-TestInstancesWithCinderVolumes-1877930177 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-9b318261-668e-4454-af8f-b593a15f2a15' failed. Not Retrying. {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 02 19:54:37 devstack cinder-volume[86639]: DEBUG cinder.volume.volume_utils [None req-4aa21129-23ac-4813-92af-f8cde5f58909 tempest-TestInstancesWithCinderVolumes-1877930177 None] Downloaded image fe594add-05cd-4167-8d69-b57ffac5f626 ((None, [{'url': 'file:///opt/stack/data/glance/images/fe594add-05cd-4167-8d69-b57ffac5f626', 'metadata': {}}])) to volume 9b318261-668e-4454-af8f-b593a15f2a15 successfully. {{(pid=86639) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jul 02 19:54:37 devstack cinder-volume[86639]: DEBUG cinder.image.image_utils [None req-4aa21129-23ac-4813-92af-f8cde5f58909 tempest-TestInstancesWithCinderVolumes-1877930177 None] Temporary image fe594add-05cd-4167-8d69-b57ffac5f626 for user e1047049d3b64224916be57eeeb35ddb is deleted. {{(pid=86639) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jul 02 19:54:37 devstack cinder-volume[86639]: DEBUG cinder.volume.volume_utils [None req-4aa21129-23ac-4813-92af-f8cde5f58909 tempest-TestInstancesWithCinderVolumes-1877930177 None] Marking volume 9b318261-668e-4454-af8f-b593a15f2a15 as bootable. {{(pid=86639) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jul 02 19:54:37 devstack cinder-volume[86639]: DEBUG cinder.volume.flows.manager.create_volume [None req-4aa21129-23ac-4813-92af-f8cde5f58909 tempest-TestInstancesWithCinderVolumes-1877930177 None] Copying metadata from image fe594add-05cd-4167-8d69-b57ffac5f626 to 9b318261-668e-4454-af8f-b593a15f2a15. {{(pid=86639) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jul 02 19:54:37 devstack cinder-volume[86639]: DEBUG cinder.volume.flows.manager.create_volume [None req-4aa21129-23ac-4813-92af-f8cde5f58909 tempest-TestInstancesWithCinderVolumes-1877930177 None] Creating volume glance metadata for volume 9b318261-668e-4454-af8f-b593a15f2a15 backed by image fe594add-05cd-4167-8d69-b57ffac5f626 with: {'image_id': 'fe594add-05cd-4167-8d69-b57ffac5f626', 'image_name': 'tempest-scenario-img--1890714012', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86639) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jul 02 19:54:37 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-4aa21129-23ac-4813-92af-f8cde5f58909 tempest-TestInstancesWithCinderVolumes-1877930177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5d80f57-0f62-4f00-ad49-25433d3bdaa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b318261-668e-4454-af8f-b593a15f2a15', 'volume_size': 1, 'image_id': 'fe594add-05cd-4167-8d69-b57ffac5f626', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fe594add-05cd-4167-8d69-b57ffac5f626', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1890714012', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '24ff03127e8c4c3db47ed4087bc99478', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'fe594add-05cd-4167-8d69-b57ffac5f626', 'created_at': datetime.datetime(2026, 7, 2, 17, 54, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 2, 17, 54, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fe594add-05cd-4167-8d69-b57ffac5f626/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fce8efbaff0>}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:54:37 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-4aa21129-23ac-4813-92af-f8cde5f58909 tempest-TestInstancesWithCinderVolumes-1877930177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (365a4212-da2c-4b9d-bb97-06c59f2d6e61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:54:37 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-4aa21129-23ac-4813-92af-f8cde5f58909 tempest-TestInstancesWithCinderVolumes-1877930177 None] Volume volume-9b318261-668e-4454-af8f-b593a15f2a15 (9b318261-668e-4454-af8f-b593a15f2a15): created successfully
Jul 02 19:54:37 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-4aa21129-23ac-4813-92af-f8cde5f58909 tempest-TestInstancesWithCinderVolumes-1877930177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (365a4212-da2c-4b9d-bb97-06c59f2d6e61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:54:38 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-4aa21129-23ac-4813-92af-f8cde5f58909 tempest-TestInstancesWithCinderVolumes-1877930177 None] Flow 'volume_create_manager' (5cd68f54-ad1b-4dd9-a763-a1e9db695f62) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 19:54:38 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-4aa21129-23ac-4813-92af-f8cde5f58909 tempest-TestInstancesWithCinderVolumes-1877930177 None] Created volume successfully.
Jul 02 19:54:38 devstack sudo[98753]: pam_unix(sudo:session): session closed for user root
Jul 02 19:54:38 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-68486817-9196-40ba-87c8-bd3493063207 tempest-SnapshotsActionsTest-1617821023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-46d356a2-75af-4ae3-a828-0b1c37b99bae.7186926e-6740-4ea9-8d45-1f115e50ba78,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-46d356a2-75af-4ae3-a828-0b1c37b99bae.0f582412-1295-4439-ac73-64337ff19a82 1G" returned: 0 in 0.944s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:54:38 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-68486817-9196-40ba-87c8-bd3493063207 tempest-SnapshotsActionsTest-1617821023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-46d356a2-75af-4ae3-a828-0b1c37b99bae.7186926e-6740-4ea9-8d45-1f115e50ba78 -F qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-46d356a2-75af-4ae3-a828-0b1c37b99bae.0f582412-1295-4439-ac73-64337ff19a82 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:54:38 devstack sudo[98762]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-46d356a2-75af-4ae3-a828-0b1c37b99bae.7186926e-6740-4ea9-8d45-1f115e50ba78 -F qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-46d356a2-75af-4ae3-a828-0b1c37b99bae.0f582412-1295-4439-ac73-64337ff19a82
Jul 02 19:54:38 devstack sudo[98762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:54:39 devstack sudo[98762]: pam_unix(sudo:session): session closed for user root
Jul 02 19:54:39 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-68486817-9196-40ba-87c8-bd3493063207 tempest-SnapshotsActionsTest-1617821023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-46d356a2-75af-4ae3-a828-0b1c37b99bae.7186926e-6740-4ea9-8d45-1f115e50ba78 -F qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-46d356a2-75af-4ae3-a828-0b1c37b99bae.0f582412-1295-4439-ac73-64337ff19a82" returned: 0 in 0.832s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:54:39 devstack cinder-volume[86639]: WARNING cinder.volume.drivers.remotefs [None req-68486817-9196-40ba-87c8-bd3493063207 tempest-SnapshotsActionsTest-1617821023 None] /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-46d356a2-75af-4ae3-a828-0b1c37b99bae.0f582412-1295-4439-ac73-64337ff19a82 is being set with open permissions: ugo+rw
Jul 02 19:54:39 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-68486817-9196-40ba-87c8-bd3493063207 tempest-SnapshotsActionsTest-1617821023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-46d356a2-75af-4ae3-a828-0b1c37b99bae.0f582412-1295-4439-ac73-64337ff19a82 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:54:39 devstack sudo[98767]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-46d356a2-75af-4ae3-a828-0b1c37b99bae.0f582412-1295-4439-ac73-64337ff19a82
Jul 02 19:54:39 devstack sudo[98767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:54:39 devstack sudo[98767]: pam_unix(sudo:session): session closed for user root
Jul 02 19:54:39 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-68486817-9196-40ba-87c8-bd3493063207 tempest-SnapshotsActionsTest-1617821023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-46d356a2-75af-4ae3-a828-0b1c37b99bae.0f582412-1295-4439-ac73-64337ff19a82" returned: 0 in 0.743s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:54:40 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-68486817-9196-40ba-87c8-bd3493063207 tempest-SnapshotsActionsTest-1617821023 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.652s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:54:40 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-68486817-9196-40ba-87c8-bd3493063207 tempest-SnapshotsActionsTest-1617821023 None] Create snapshot completed successfully
Jul 02 19:54:40 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-a9f5f7fe-dc9d-4020-a270-7a2ef533e28a tempest-SnapshotsActionsTest-1698233610 None] Acquiring lock "cinder-0f582412-1295-4439-ac73-64337ff19a82-delete_snapshot" by "delete_snapshot" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:54:40 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-a9f5f7fe-dc9d-4020-a270-7a2ef533e28a tempest-SnapshotsActionsTest-1698233610 None] Lock "cinder-0f582412-1295-4439-ac73-64337ff19a82-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:54:40 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-a9f5f7fe-dc9d-4020-a270-7a2ef533e28a tempest-SnapshotsActionsTest-1698233610 None] Acquiring lock "cinder-quobyte-46d356a2-75af-4ae3-a828-0b1c37b99bae" by "delete_snapshot" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:54:40 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-a9f5f7fe-dc9d-4020-a270-7a2ef533e28a tempest-SnapshotsActionsTest-1698233610 None] Lock "cinder-quobyte-46d356a2-75af-4ae3-a828-0b1c37b99bae" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:54:40 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-a9f5f7fe-dc9d-4020-a270-7a2ef533e28a tempest-SnapshotsActionsTest-1698233610 None] Acquiring lock "cinder-quobyte-0f582412-1295-4439-ac73-64337ff19a82" by "_delete_snapshot" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:54:40 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-a9f5f7fe-dc9d-4020-a270-7a2ef533e28a tempest-SnapshotsActionsTest-1698233610 None] Lock "cinder-quobyte-0f582412-1295-4439-ac73-64337ff19a82" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:54:40 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-a9f5f7fe-dc9d-4020-a270-7a2ef533e28a tempest-SnapshotsActionsTest-1698233610 None] Deleting offline snapshot 0f582412-1295-4439-ac73-64337ff19a82 of volume 46d356a2-75af-4ae3-a828-0b1c37b99bae {{(pid=86639) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 02 19:54:40 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-a9f5f7fe-dc9d-4020-a270-7a2ef533e28a tempest-SnapshotsActionsTest-1698233610 None] snapshot_file for this snap is: volume-46d356a2-75af-4ae3-a828-0b1c37b99bae.0f582412-1295-4439-ac73-64337ff19a82 {{(pid=86639) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 02 19:54:40 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[13384280-bf08-462e-b3c6-fe985f44b0e8]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 19:54:40 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-a9f5f7fe-dc9d-4020-a270-7a2ef533e28a tempest-SnapshotsActionsTest-1698233610 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-46d356a2-75af-4ae3-a828-0b1c37b99bae.0f582412-1295-4439-ac73-64337ff19a82 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:54:40 devstack cinder-volume[86639]: DEBUG cinder.volume.flows.manager.create_volume [None req-03359cc5-a9d8-4331-bb7a-9a4c87f409aa tempest-VolumesTransfersV355Test-1715106952 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 19:54:40 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-03359cc5-a9d8-4331-bb7a-9a4c87f409aa tempest-VolumesTransfersV355Test-1715106952 None] Flow 'volume_create_manager' (f7100503-163a-4ef0-b34b-6e0a7496c2a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 19:54:40 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-03359cc5-a9d8-4331-bb7a-9a4c87f409aa tempest-VolumesTransfersV355Test-1715106952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c52aaa5-0ac0-408d-a4fa-d65aaaf805dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:54:40 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-03359cc5-a9d8-4331-bb7a-9a4c87f409aa tempest-VolumesTransfersV355Test-1715106952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c52aaa5-0ac0-408d-a4fa-d65aaaf805dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T17:54:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1416247274',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14b529d9-8159-4574-ac00-ef62a68b3f0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a899e6ccd564102abd7133b6209f2c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T17:54:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T17:54:41Z,use_quota=True,user_id='52c729a2789f41dbad706db15e6621cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:54:40 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-03359cc5-a9d8-4331-bb7a-9a4c87f409aa tempest-VolumesTransfersV355Test-1715106952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a666bbec-54a2-499c-89df-ff3fdd6164e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:54:40 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-03359cc5-a9d8-4331-bb7a-9a4c87f409aa tempest-VolumesTransfersV355Test-1715106952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a666bbec-54a2-499c-89df-ff3fdd6164e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:54:40 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-03359cc5-a9d8-4331-bb7a-9a4c87f409aa tempest-VolumesTransfersV355Test-1715106952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee509f22-29e3-45e6-a5e7-83b4437bfb17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:54:40 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-03359cc5-a9d8-4331-bb7a-9a4c87f409aa tempest-VolumesTransfersV355Test-1715106952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee509f22-29e3-45e6-a5e7-83b4437bfb17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '14b529d9-8159-4574-ac00-ef62a68b3f0e', 'volume_name': 'volume-14b529d9-8159-4574-ac00-ef62a68b3f0e', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:54:40 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-03359cc5-a9d8-4331-bb7a-9a4c87f409aa tempest-VolumesTransfersV355Test-1715106952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (137a0637-9782-4e4c-9e92-ed473d12743a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:54:40 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-03359cc5-a9d8-4331-bb7a-9a4c87f409aa tempest-VolumesTransfersV355Test-1715106952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (137a0637-9782-4e4c-9e92-ed473d12743a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:54:40 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-03359cc5-a9d8-4331-bb7a-9a4c87f409aa tempest-VolumesTransfersV355Test-1715106952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0de0ab2-0f26-498b-9275-36b339f13b26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:54:40 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-03359cc5-a9d8-4331-bb7a-9a4c87f409aa tempest-VolumesTransfersV355Test-1715106952 None] Volume 14b529d9-8159-4574-ac00-ef62a68b3f0e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-14b529d9-8159-4574-ac00-ef62a68b3f0e', 'volume_size': 1}
Jul 02 19:54:40 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-03359cc5-a9d8-4331-bb7a-9a4c87f409aa tempest-VolumesTransfersV355Test-1715106952 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:54:40 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-03359cc5-a9d8-4331-bb7a-9a4c87f409aa tempest-VolumesTransfersV355Test-1715106952 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:54:40 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-03359cc5-a9d8-4331-bb7a-9a4c87f409aa tempest-VolumesTransfersV355Test-1715106952 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce906cb830>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T17:54:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1416247274',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14b529d9-8159-4574-ac00-ef62a68b3f0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a899e6ccd564102abd7133b6209f2c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T17:54:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T17:54:41Z,use_quota=True,user_id='52c729a2789f41dbad706db15e6621cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)}" {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 19:54:40 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-03359cc5-a9d8-4331-bb7a-9a4c87f409aa tempest-VolumesTransfersV355Test-1715106952 None] Creating volume 14b529d9-8159-4574-ac00-ef62a68b3f0e {{(pid=86639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 19:54:40 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-03359cc5-a9d8-4331-bb7a-9a4c87f409aa tempest-VolumesTransfersV355Test-1715106952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:54:40 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-03359cc5-a9d8-4331-bb7a-9a4c87f409aa tempest-VolumesTransfersV355Test-1715106952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:54:40 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-03359cc5-a9d8-4331-bb7a-9a4c87f409aa tempest-VolumesTransfersV355Test-1715106952 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 19:54:40 devstack sudo[98773]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-46d356a2-75af-4ae3-a828-0b1c37b99bae.0f582412-1295-4439-ac73-64337ff19a82
Jul 02 19:54:40 devstack sudo[98773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:54:40 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-03359cc5-a9d8-4331-bb7a-9a4c87f409aa tempest-VolumesTransfersV355Test-1715106952 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 19:54:40 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-03359cc5-a9d8-4331-bb7a-9a4c87f409aa tempest-VolumesTransfersV355Test-1715106952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:54:40 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-03359cc5-a9d8-4331-bb7a-9a4c87f409aa tempest-VolumesTransfersV355Test-1715106952 None] Selected osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92 as target Quobyte volume. {{(pid=86639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 19:54:40 devstack cinder-volume[86639]: INFO cinder.volume.drivers.remotefs [None req-03359cc5-a9d8-4331-bb7a-9a4c87f409aa tempest-VolumesTransfersV355Test-1715106952 None] casted to osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92
Jul 02 19:54:40 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-03359cc5-a9d8-4331-bb7a-9a4c87f409aa tempest-VolumesTransfersV355Test-1715106952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-14b529d9-8159-4574-ac00-ef62a68b3f0e 1073741824 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:54:40 devstack sudo[98775]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-14b529d9-8159-4574-ac00-ef62a68b3f0e 1073741824
Jul 02 19:54:40 devstack sudo[98775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:54:41 devstack cinder-volume[86639]: DEBUG oslo_service.periodic_task [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86639) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 02 19:54:41 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:54:41 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:54:41 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 19:54:41 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 19:54:41 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:54:41 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:54:41 devstack sudo[98783]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e
Jul 02 19:54:41 devstack sudo[98783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:54:41 devstack sudo[98773]: pam_unix(sudo:session): session closed for user root
Jul 02 19:54:41 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-a9f5f7fe-dc9d-4020-a270-7a2ef533e28a tempest-SnapshotsActionsTest-1698233610 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-46d356a2-75af-4ae3-a828-0b1c37b99bae.0f582412-1295-4439-ac73-64337ff19a82" returned: 0 in 0.867s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:54:41 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-a9f5f7fe-dc9d-4020-a270-7a2ef533e28a tempest-SnapshotsActionsTest-1698233610 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-46d356a2-75af-4ae3-a828-0b1c37b99bae(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86639) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 02 19:54:41 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[10984b67-2726-45d2-a7a1-4ad67b50487c]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 19:54:41 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-a9f5f7fe-dc9d-4020-a270-7a2ef533e28a tempest-SnapshotsActionsTest-1698233610 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-46d356a2-75af-4ae3-a828-0b1c37b99bae.7186926e-6740-4ea9-8d45-1f115e50ba78 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:54:41 devstack sudo[98787]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-46d356a2-75af-4ae3-a828-0b1c37b99bae.7186926e-6740-4ea9-8d45-1f115e50ba78
Jul 02 19:54:41 devstack sudo[98787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:54:41 devstack sudo[98775]: pam_unix(sudo:session): session closed for user root
Jul 02 19:54:41 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-03359cc5-a9d8-4331-bb7a-9a4c87f409aa tempest-VolumesTransfersV355Test-1715106952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-14b529d9-8159-4574-ac00-ef62a68b3f0e 1073741824" returned: 0 in 0.963s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:54:41 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-03359cc5-a9d8-4331-bb7a-9a4c87f409aa tempest-VolumesTransfersV355Test-1715106952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-14b529d9-8159-4574-ac00-ef62a68b3f0e {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:54:41 devstack sudo[98789]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-14b529d9-8159-4574-ac00-ef62a68b3f0e
Jul 02 19:54:41 devstack sudo[98789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:54:42 devstack sudo[98783]: pam_unix(sudo:session): session closed for user root
Jul 02 19:54:42 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e" returned: 0 in 0.889s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:54:42 devstack cinder-volume[86639]: DEBUG cinder.manager [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] Notifying Schedulers of capabilities ... {{(pid=86639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 19:54:42 devstack cinder-volume[86639]: DEBUG oslo_service.periodic_task [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] Running periodic task VolumeManager._thread_info {{(pid=86639) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 02 19:54:42 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] thread count: 28 {{(pid=86639) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 02 19:54:42 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] thread info: [<_MainThread(MainThread, started 140525261275264)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 140525150678016)>, <Thread(Thread-3 (stat_writer), started daemon 140525150025920)>, <Thread(Rabbit-heartbeat, started daemon 140525150500864)>, <Thread(Thread-5 (_runner), started daemon 140525149847296)>, <Thread(Thread-7 (_runner), started daemon 140525149863424)>, <Thread(fd_logger, started daemon 140525146589376)>, <Thread(privsep_reader, started daemon 140525144562432)>, <Thread(tpool_thread_0, started daemon 140525137151680)>, <Thread(tpool_thread_1, started daemon 140525128758976)>, <Thread(tpool_thread_2, started daemon 140525120349888)>, <Thread(tpool_thread_3, started daemon 140525111940800)>, <Thread(tpool_thread_4, started daemon 140525103531712)>, <Thread(tpool_thread_5, started daemon 140525095122624)>, <Thread(tpool_thread_6, started daemon 140525086713536)>, <Thread(tpool_thread_7, started daemon 140525078304448)>, <Thread(tpool_thread_8, started daemon 140525069895360)>, <Thread(tpool_thread_9, started daemon 140525061486272)>, <Thread(tpool_thread_10, started daemon 140525053077184)>, <Thread(tpool_thread_11, started daemon 140525044668096)>, <Thread(tpool_thread_12, started daemon 140525036259008)>, <Thread(tpool_thread_13, started daemon 140525027849920)>, <Thread(tpool_thread_14, started daemon 140525019440832)>, <Thread(tpool_thread_15, started daemon 140525011031744)>, <Thread(tpool_thread_16, started daemon 140525002622656)>, <Thread(tpool_thread_17, started daemon 140524994213568)>, <Thread(tpool_thread_18, started daemon 140524985804480)>, <Thread(tpool_thread_19, started daemon 140524977395392)>] {{(pid=86639) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 02 19:54:42 devstack sudo[98787]: pam_unix(sudo:session): session closed for user root
Jul 02 19:54:42 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-a9f5f7fe-dc9d-4020-a270-7a2ef533e28a tempest-SnapshotsActionsTest-1698233610 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-46d356a2-75af-4ae3-a828-0b1c37b99bae.7186926e-6740-4ea9-8d45-1f115e50ba78" returned: 0 in 0.876s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:54:42 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-a9f5f7fe-dc9d-4020-a270-7a2ef533e28a tempest-SnapshotsActionsTest-1698233610 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-46d356a2-75af-4ae3-a828-0b1c37b99bae(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86639) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 02 19:54:42 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-a9f5f7fe-dc9d-4020-a270-7a2ef533e28a tempest-SnapshotsActionsTest-1698233610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-46d356a2-75af-4ae3-a828-0b1c37b99bae.0f582412-1295-4439-ac73-64337ff19a82 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:54:42 devstack sudo[98796]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-46d356a2-75af-4ae3-a828-0b1c37b99bae.0f582412-1295-4439-ac73-64337ff19a82
Jul 02 19:54:42 devstack sudo[98796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:54:42 devstack sudo[98789]: pam_unix(sudo:session): session closed for user root
Jul 02 19:54:42 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-03359cc5-a9d8-4331-bb7a-9a4c87f409aa tempest-VolumesTransfersV355Test-1715106952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-14b529d9-8159-4574-ac00-ef62a68b3f0e" returned: 0 in 0.696s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:54:42 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-03359cc5-a9d8-4331-bb7a-9a4c87f409aa tempest-VolumesTransfersV355Test-1715106952 None] <== create_volume: return (1733ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'} {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 19:54:42 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-03359cc5-a9d8-4331-bb7a-9a4c87f409aa tempest-VolumesTransfersV355Test-1715106952 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.735s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:54:42 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-03359cc5-a9d8-4331-bb7a-9a4c87f409aa tempest-VolumesTransfersV355Test-1715106952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0de0ab2-0f26-498b-9275-36b339f13b26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-14b529d9-8159-4574-ac00-ef62a68b3f0e', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:54:42 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-03359cc5-a9d8-4331-bb7a-9a4c87f409aa tempest-VolumesTransfersV355Test-1715106952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7a56d4e-aeab-4109-8742-281711279140) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:54:42 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-03359cc5-a9d8-4331-bb7a-9a4c87f409aa tempest-VolumesTransfersV355Test-1715106952 None] Volume volume-14b529d9-8159-4574-ac00-ef62a68b3f0e (14b529d9-8159-4574-ac00-ef62a68b3f0e): created successfully
Jul 02 19:54:42 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-03359cc5-a9d8-4331-bb7a-9a4c87f409aa tempest-VolumesTransfersV355Test-1715106952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7a56d4e-aeab-4109-8742-281711279140) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:54:42 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-03359cc5-a9d8-4331-bb7a-9a4c87f409aa tempest-VolumesTransfersV355Test-1715106952 None] Flow 'volume_create_manager' (f7100503-163a-4ef0-b34b-6e0a7496c2a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 19:54:42 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-03359cc5-a9d8-4331-bb7a-9a4c87f409aa tempest-VolumesTransfersV355Test-1715106952 None] Created volume successfully.
Jul 02 19:54:43 devstack sudo[98796]: pam_unix(sudo:session): session closed for user root
Jul 02 19:54:43 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-a9f5f7fe-dc9d-4020-a270-7a2ef533e28a tempest-SnapshotsActionsTest-1698233610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-46d356a2-75af-4ae3-a828-0b1c37b99bae.0f582412-1295-4439-ac73-64337ff19a82" returned: 0 in 0.934s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:54:43 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-a9f5f7fe-dc9d-4020-a270-7a2ef533e28a tempest-SnapshotsActionsTest-1698233610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-46d356a2-75af-4ae3-a828-0b1c37b99bae.0f582412-1295-4439-ac73-64337ff19a82 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:54:43 devstack sudo[98802]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-46d356a2-75af-4ae3-a828-0b1c37b99bae.0f582412-1295-4439-ac73-64337ff19a82
Jul 02 19:54:43 devstack sudo[98802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:54:43 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-72e77985-2943-4b1f-9162-ce05229bf7da tempest-VolumesTransfersV355Test-1988341040 None] Transfer volume completed successfully.
Jul 02 19:54:44 devstack sudo[98802]: pam_unix(sudo:session): session closed for user root
Jul 02 19:54:44 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-a9f5f7fe-dc9d-4020-a270-7a2ef533e28a tempest-SnapshotsActionsTest-1698233610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-46d356a2-75af-4ae3-a828-0b1c37b99bae.0f582412-1295-4439-ac73-64337ff19a82" returned: 0 in 0.693s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:54:44 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-a9f5f7fe-dc9d-4020-a270-7a2ef533e28a tempest-SnapshotsActionsTest-1698233610 None] Lock "cinder-quobyte-0f582412-1295-4439-ac73-64337ff19a82" released by "_delete_snapshot" :: held 3.495s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:54:44 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-a9f5f7fe-dc9d-4020-a270-7a2ef533e28a tempest-SnapshotsActionsTest-1698233610 None] Lock "cinder-quobyte-46d356a2-75af-4ae3-a828-0b1c37b99bae" released by "delete_snapshot" :: held 3.526s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:54:44 devstack cinder-volume[86639]: DEBUG cinder.quota [None req-a9f5f7fe-dc9d-4020-a270-7a2ef533e28a tempest-SnapshotsActionsTest-1698233610 None] Created reservations ['2a93f1d6-82c0-4d85-b5f3-d77c1bbd0787', '0a892bd6-9582-4d5e-8343-c44eadb418e2', 'd594f64e-be73-4562-98ac-05723cf0e169', 'b173cdee-1d1c-48a9-a141-3ba96ecc8f49'] {{(pid=86639) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 19:54:44 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-a9f5f7fe-dc9d-4020-a270-7a2ef533e28a tempest-SnapshotsActionsTest-1698233610 None] Delete snapshot completed successfully.
Jul 02 19:54:44 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-a9f5f7fe-dc9d-4020-a270-7a2ef533e28a tempest-SnapshotsActionsTest-1698233610 None] Lock "cinder-0f582412-1295-4439-ac73-64337ff19a82-delete_snapshot" released by "delete_snapshot" :: held 3.713s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:54:45 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-478e5fac-98de-46e1-82db-a49a6448f40b tempest-VolumesTransfersV355Test-1317377988 None] Acquiring lock "cinder-14b529d9-8159-4574-ac00-ef62a68b3f0e-delete_volume" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:54:45 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-478e5fac-98de-46e1-82db-a49a6448f40b tempest-VolumesTransfersV355Test-1317377988 None] Lock "cinder-14b529d9-8159-4574-ac00-ef62a68b3f0e-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:54:45 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-478e5fac-98de-46e1-82db-a49a6448f40b tempest-VolumesTransfersV355Test-1317377988 None] Acquiring lock "cinder-quobyte-14b529d9-8159-4574-ac00-ef62a68b3f0e" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:54:45 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-478e5fac-98de-46e1-82db-a49a6448f40b tempest-VolumesTransfersV355Test-1317377988 None] Lock "cinder-quobyte-14b529d9-8159-4574-ac00-ef62a68b3f0e" acquired by "delete_volume" :: waited 0.022s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:54:45 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[19bd6ad3-229c-46bc-b759-945b17294893]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 19:54:45 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-478e5fac-98de-46e1-82db-a49a6448f40b tempest-VolumesTransfersV355Test-1317377988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-14b529d9-8159-4574-ac00-ef62a68b3f0e {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:54:45 devstack sudo[98806]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-14b529d9-8159-4574-ac00-ef62a68b3f0e
Jul 02 19:54:45 devstack sudo[98806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:54:45 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-60f62d4f-955a-4a7d-bfde-bf319bdd9558 tempest-SnapshotsActionsTest-1617821023 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:54:45 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-60f62d4f-955a-4a7d-bfde-bf319bdd9558 tempest-SnapshotsActionsTest-1617821023 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:54:45 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-60f62d4f-955a-4a7d-bfde-bf319bdd9558 tempest-SnapshotsActionsTest-1617821023 None] Creating offline snapshot 3c2ee6f9-ebd9-4a5d-aacd-24c8155ad380 of volume 46d356a2-75af-4ae3-a828-0b1c37b99bae {{(pid=86639) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 02 19:54:45 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c1df5bb-1acb-4b5e-9898-bddaaa1a76b5]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 19:54:45 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-60f62d4f-955a-4a7d-bfde-bf319bdd9558 tempest-SnapshotsActionsTest-1617821023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-46d356a2-75af-4ae3-a828-0b1c37b99bae.7186926e-6740-4ea9-8d45-1f115e50ba78 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:54:45 devstack sudo[98808]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-46d356a2-75af-4ae3-a828-0b1c37b99bae.7186926e-6740-4ea9-8d45-1f115e50ba78
Jul 02 19:54:45 devstack sudo[98808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:54:46 devstack sudo[98806]: pam_unix(sudo:session): session closed for user root
Jul 02 19:54:46 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-478e5fac-98de-46e1-82db-a49a6448f40b tempest-VolumesTransfersV355Test-1317377988 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-14b529d9-8159-4574-ac00-ef62a68b3f0e" returned: 0 in 1.125s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:54:46 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-478e5fac-98de-46e1-82db-a49a6448f40b tempest-VolumesTransfersV355Test-1317377988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-14b529d9-8159-4574-ac00-ef62a68b3f0e {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:54:46 devstack sudo[98813]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-14b529d9-8159-4574-ac00-ef62a68b3f0e
Jul 02 19:54:46 devstack sudo[98813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:54:46 devstack sudo[98808]: pam_unix(sudo:session): session closed for user root
Jul 02 19:54:46 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-60f62d4f-955a-4a7d-bfde-bf319bdd9558 tempest-SnapshotsActionsTest-1617821023 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-46d356a2-75af-4ae3-a828-0b1c37b99bae.7186926e-6740-4ea9-8d45-1f115e50ba78" returned: 0 in 1.221s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:54:46 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-60f62d4f-955a-4a7d-bfde-bf319bdd9558 tempest-SnapshotsActionsTest-1617821023 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-46d356a2-75af-4ae3-a828-0b1c37b99bae(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86639) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 02 19:54:46 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-60f62d4f-955a-4a7d-bfde-bf319bdd9558 tempest-SnapshotsActionsTest-1617821023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-46d356a2-75af-4ae3-a828-0b1c37b99bae.7186926e-6740-4ea9-8d45-1f115e50ba78,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-46d356a2-75af-4ae3-a828-0b1c37b99bae.3c2ee6f9-ebd9-4a5d-aacd-24c8155ad380 1G {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:54:46 devstack sudo[98826]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-46d356a2-75af-4ae3-a828-0b1c37b99bae.7186926e-6740-4ea9-8d45-1f115e50ba78,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-46d356a2-75af-4ae3-a828-0b1c37b99bae.3c2ee6f9-ebd9-4a5d-aacd-24c8155ad380 1G
Jul 02 19:54:46 devstack sudo[98826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:54:46 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [req-399cfe94-82f5-4aad-b392-10c7f50b546a req-2e607a86-214a-47ed-b8df-ae65bd01b8aa tempest-TestInstancesWithCinderVolumes-1877930177 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:54:47 devstack sudo[98813]: pam_unix(sudo:session): session closed for user root
Jul 02 19:54:47 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-478e5fac-98de-46e1-82db-a49a6448f40b tempest-VolumesTransfersV355Test-1317377988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-14b529d9-8159-4574-ac00-ef62a68b3f0e" returned: 0 in 0.763s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:54:47 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-478e5fac-98de-46e1-82db-a49a6448f40b tempest-VolumesTransfersV355Test-1317377988 None] Lock "cinder-quobyte-14b529d9-8159-4574-ac00-ef62a68b3f0e" released by "delete_volume" :: held 1.948s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:54:47 devstack cinder-volume[86639]: DEBUG cinder.quota [None req-478e5fac-98de-46e1-82db-a49a6448f40b tempest-VolumesTransfersV355Test-1317377988 None] Created reservations ['74423530-a49a-4207-91ba-d0843ab6f432', 'f6ca5f6f-e2be-4b83-9abd-6d842e6b495e', 'b6651fcd-634d-43f9-b476-41b4084f4501', '643e0697-83e7-4829-9da2-5efe02a904e5'] {{(pid=86639) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 19:54:47 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-478e5fac-98de-46e1-82db-a49a6448f40b tempest-VolumesTransfersV355Test-1317377988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:54:47 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-478e5fac-98de-46e1-82db-a49a6448f40b tempest-VolumesTransfersV355Test-1317377988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:54:47 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-478e5fac-98de-46e1-82db-a49a6448f40b tempest-VolumesTransfersV355Test-1317377988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 19:54:47 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-478e5fac-98de-46e1-82db-a49a6448f40b tempest-VolumesTransfersV355Test-1317377988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 19:54:47 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-478e5fac-98de-46e1-82db-a49a6448f40b tempest-VolumesTransfersV355Test-1317377988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:54:47 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-478e5fac-98de-46e1-82db-a49a6448f40b tempest-VolumesTransfersV355Test-1317377988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:54:47 devstack sudo[98829]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e
Jul 02 19:54:47 devstack sudo[98829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:54:47 devstack sudo[98826]: pam_unix(sudo:session): session closed for user root
Jul 02 19:54:47 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-60f62d4f-955a-4a7d-bfde-bf319bdd9558 tempest-SnapshotsActionsTest-1617821023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-46d356a2-75af-4ae3-a828-0b1c37b99bae.7186926e-6740-4ea9-8d45-1f115e50ba78,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-46d356a2-75af-4ae3-a828-0b1c37b99bae.3c2ee6f9-ebd9-4a5d-aacd-24c8155ad380 1G" returned: 0 in 1.211s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:54:47 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-60f62d4f-955a-4a7d-bfde-bf319bdd9558 tempest-SnapshotsActionsTest-1617821023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-46d356a2-75af-4ae3-a828-0b1c37b99bae.7186926e-6740-4ea9-8d45-1f115e50ba78 -F qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-46d356a2-75af-4ae3-a828-0b1c37b99bae.3c2ee6f9-ebd9-4a5d-aacd-24c8155ad380 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:54:48 devstack sudo[98836]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-46d356a2-75af-4ae3-a828-0b1c37b99bae.7186926e-6740-4ea9-8d45-1f115e50ba78 -F qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-46d356a2-75af-4ae3-a828-0b1c37b99bae.3c2ee6f9-ebd9-4a5d-aacd-24c8155ad380
Jul 02 19:54:48 devstack sudo[98836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:54:48 devstack cinder-volume[86639]: DEBUG cinder.volume.flows.manager.create_volume [None req-54fb80fc-200f-4a37-8ded-8274aa62a666 tempest-VolumesTransfersV355Test-1715106952 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 19:54:48 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-54fb80fc-200f-4a37-8ded-8274aa62a666 tempest-VolumesTransfersV355Test-1715106952 None] Flow 'volume_create_manager' (207c4e33-9775-4660-8ab1-252dfec0e1c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 19:54:48 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-54fb80fc-200f-4a37-8ded-8274aa62a666 tempest-VolumesTransfersV355Test-1715106952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9c629dc-e593-49eb-a114-d7857f1e0c38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:54:48 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-54fb80fc-200f-4a37-8ded-8274aa62a666 tempest-VolumesTransfersV355Test-1715106952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9c629dc-e593-49eb-a114-d7857f1e0c38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T17:54:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-543101486',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93ef89c1-794d-42a2-8504-b054cb62d051,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a899e6ccd564102abd7133b6209f2c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T17:54:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T17:54:48Z,use_quota=True,user_id='52c729a2789f41dbad706db15e6621cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:54:48 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-54fb80fc-200f-4a37-8ded-8274aa62a666 tempest-VolumesTransfersV355Test-1715106952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e7106ed-0f66-4996-9527-dd871784c5ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:54:48 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-54fb80fc-200f-4a37-8ded-8274aa62a666 tempest-VolumesTransfersV355Test-1715106952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e7106ed-0f66-4996-9527-dd871784c5ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:54:48 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-54fb80fc-200f-4a37-8ded-8274aa62a666 tempest-VolumesTransfersV355Test-1715106952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8761dfdb-55d1-4278-8926-7b32072bbd2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:54:48 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-54fb80fc-200f-4a37-8ded-8274aa62a666 tempest-VolumesTransfersV355Test-1715106952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8761dfdb-55d1-4278-8926-7b32072bbd2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '93ef89c1-794d-42a2-8504-b054cb62d051', 'volume_name': 'volume-93ef89c1-794d-42a2-8504-b054cb62d051', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:54:48 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-54fb80fc-200f-4a37-8ded-8274aa62a666 tempest-VolumesTransfersV355Test-1715106952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a440e8c1-8f95-4a41-8517-e73b6fb5183a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:54:48 devstack sudo[98829]: pam_unix(sudo:session): session closed for user root
Jul 02 19:54:48 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-54fb80fc-200f-4a37-8ded-8274aa62a666 tempest-VolumesTransfersV355Test-1715106952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a440e8c1-8f95-4a41-8517-e73b6fb5183a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:54:48 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-54fb80fc-200f-4a37-8ded-8274aa62a666 tempest-VolumesTransfersV355Test-1715106952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb194e90-4544-43f7-8d1f-af128e6d64d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:54:48 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-54fb80fc-200f-4a37-8ded-8274aa62a666 tempest-VolumesTransfersV355Test-1715106952 None] Volume 93ef89c1-794d-42a2-8504-b054cb62d051: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-93ef89c1-794d-42a2-8504-b054cb62d051', 'volume_size': 1}
Jul 02 19:54:48 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-54fb80fc-200f-4a37-8ded-8274aa62a666 tempest-VolumesTransfersV355Test-1715106952 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:54:48 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-478e5fac-98de-46e1-82db-a49a6448f40b tempest-VolumesTransfersV355Test-1317377988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e" returned: 0 in 0.953s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:54:48 devstack cinder-volume[86639]: DEBUG cinder.manager [None req-478e5fac-98de-46e1-82db-a49a6448f40b tempest-VolumesTransfersV355Test-1317377988 None] Notifying Schedulers of capabilities ... {{(pid=86639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 19:54:48 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-478e5fac-98de-46e1-82db-a49a6448f40b tempest-VolumesTransfersV355Test-1317377988 None] Deleted volume successfully.
Jul 02 19:54:48 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-478e5fac-98de-46e1-82db-a49a6448f40b tempest-VolumesTransfersV355Test-1317377988 None] Lock "cinder-14b529d9-8159-4574-ac00-ef62a68b3f0e-delete_volume" released by "delete_volume" :: held 3.242s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:54:48 devstack sudo[98836]: pam_unix(sudo:session): session closed for user root
Jul 02 19:54:48 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-60f62d4f-955a-4a7d-bfde-bf319bdd9558 tempest-SnapshotsActionsTest-1617821023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-46d356a2-75af-4ae3-a828-0b1c37b99bae.7186926e-6740-4ea9-8d45-1f115e50ba78 -F qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-46d356a2-75af-4ae3-a828-0b1c37b99bae.3c2ee6f9-ebd9-4a5d-aacd-24c8155ad380" returned: 0 in 0.739s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:54:48 devstack cinder-volume[86639]: WARNING cinder.volume.drivers.remotefs [None req-60f62d4f-955a-4a7d-bfde-bf319bdd9558 tempest-SnapshotsActionsTest-1617821023 None] /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-46d356a2-75af-4ae3-a828-0b1c37b99bae.3c2ee6f9-ebd9-4a5d-aacd-24c8155ad380 is being set with open permissions: ugo+rw
Jul 02 19:54:48 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-60f62d4f-955a-4a7d-bfde-bf319bdd9558 tempest-SnapshotsActionsTest-1617821023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-46d356a2-75af-4ae3-a828-0b1c37b99bae.3c2ee6f9-ebd9-4a5d-aacd-24c8155ad380 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:54:48 devstack sudo[98843]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-46d356a2-75af-4ae3-a828-0b1c37b99bae.3c2ee6f9-ebd9-4a5d-aacd-24c8155ad380
Jul 02 19:54:48 devstack sudo[98843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:54:49 devstack sudo[98843]: pam_unix(sudo:session): session closed for user root
Jul 02 19:54:49 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-60f62d4f-955a-4a7d-bfde-bf319bdd9558 tempest-SnapshotsActionsTest-1617821023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-46d356a2-75af-4ae3-a828-0b1c37b99bae.3c2ee6f9-ebd9-4a5d-aacd-24c8155ad380" returned: 0 in 0.663s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:54:49 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-60f62d4f-955a-4a7d-bfde-bf319bdd9558 tempest-SnapshotsActionsTest-1617821023 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.956s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:54:49 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [req-399cfe94-82f5-4aad-b392-10c7f50b546a req-2e607a86-214a-47ed-b8df-ae65bd01b8aa tempest-TestInstancesWithCinderVolumes-1877930177 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.610s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:54:49 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-60f62d4f-955a-4a7d-bfde-bf319bdd9558 tempest-SnapshotsActionsTest-1617821023 None] Create snapshot completed successfully
Jul 02 19:54:49 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[42381cc6-278d-49f7-b316-f82775e5a322]: (4, 'raw') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 19:54:49 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [req-399cfe94-82f5-4aad-b392-10c7f50b546a req-2e607a86-214a-47ed-b8df-ae65bd01b8aa tempest-TestInstancesWithCinderVolumes-1877930177 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-9b318261-668e-4454-af8f-b593a15f2a15 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:54:49 devstack sudo[98846]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-9b318261-668e-4454-af8f-b593a15f2a15
Jul 02 19:54:49 devstack sudo[98846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:54:50 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-141ac60b-fa75-4ff9-80aa-68cbab148e01 tempest-SnapshotsActionsTest-1698233610 None] Acquiring lock "cinder-3c2ee6f9-ebd9-4a5d-aacd-24c8155ad380-delete_snapshot" by "delete_snapshot" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:54:50 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-141ac60b-fa75-4ff9-80aa-68cbab148e01 tempest-SnapshotsActionsTest-1698233610 None] Lock "cinder-3c2ee6f9-ebd9-4a5d-aacd-24c8155ad380-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:54:50 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-141ac60b-fa75-4ff9-80aa-68cbab148e01 tempest-SnapshotsActionsTest-1698233610 None] Acquiring lock "cinder-quobyte-46d356a2-75af-4ae3-a828-0b1c37b99bae" by "delete_snapshot" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:54:50 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-141ac60b-fa75-4ff9-80aa-68cbab148e01 tempest-SnapshotsActionsTest-1698233610 None] Lock "cinder-quobyte-46d356a2-75af-4ae3-a828-0b1c37b99bae" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:54:50 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-141ac60b-fa75-4ff9-80aa-68cbab148e01 tempest-SnapshotsActionsTest-1698233610 None] Acquiring lock "cinder-quobyte-3c2ee6f9-ebd9-4a5d-aacd-24c8155ad380" by "_delete_snapshot" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:54:50 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-141ac60b-fa75-4ff9-80aa-68cbab148e01 tempest-SnapshotsActionsTest-1698233610 None] Lock "cinder-quobyte-3c2ee6f9-ebd9-4a5d-aacd-24c8155ad380" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:54:50 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-141ac60b-fa75-4ff9-80aa-68cbab148e01 tempest-SnapshotsActionsTest-1698233610 None] Deleting offline snapshot 3c2ee6f9-ebd9-4a5d-aacd-24c8155ad380 of volume 46d356a2-75af-4ae3-a828-0b1c37b99bae {{(pid=86639) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 02 19:54:50 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-141ac60b-fa75-4ff9-80aa-68cbab148e01 tempest-SnapshotsActionsTest-1698233610 None] snapshot_file for this snap is: volume-46d356a2-75af-4ae3-a828-0b1c37b99bae.3c2ee6f9-ebd9-4a5d-aacd-24c8155ad380 {{(pid=86639) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 02 19:54:50 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[37f53082-a5ca-4660-b70d-9bd97c76b1c9]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 19:54:50 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-141ac60b-fa75-4ff9-80aa-68cbab148e01 tempest-SnapshotsActionsTest-1698233610 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-46d356a2-75af-4ae3-a828-0b1c37b99bae.3c2ee6f9-ebd9-4a5d-aacd-24c8155ad380 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:54:50 devstack sudo[98846]: pam_unix(sudo:session): session closed for user root
Jul 02 19:54:50 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [req-399cfe94-82f5-4aad-b392-10c7f50b546a req-2e607a86-214a-47ed-b8df-ae65bd01b8aa tempest-TestInstancesWithCinderVolumes-1877930177 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-9b318261-668e-4454-af8f-b593a15f2a15" returned: 0 in 0.924s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:54:50 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [req-399cfe94-82f5-4aad-b392-10c7f50b546a req-2e607a86-214a-47ed-b8df-ae65bd01b8aa tempest-TestInstancesWithCinderVolumes-1877930177 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-9b318261-668e-4454-af8f-b593a15f2a15 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:54:50 devstack sudo[98850]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-46d356a2-75af-4ae3-a828-0b1c37b99bae.3c2ee6f9-ebd9-4a5d-aacd-24c8155ad380
Jul 02 19:54:50 devstack sudo[98850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:54:50 devstack sudo[98851]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-9b318261-668e-4454-af8f-b593a15f2a15
Jul 02 19:54:50 devstack sudo[98851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:54:51 devstack sudo[98851]: pam_unix(sudo:session): session closed for user root
Jul 02 19:54:51 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [req-399cfe94-82f5-4aad-b392-10c7f50b546a req-2e607a86-214a-47ed-b8df-ae65bd01b8aa tempest-TestInstancesWithCinderVolumes-1877930177 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-9b318261-668e-4454-af8f-b593a15f2a15" returned: 1 in 0.754s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:54:51 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [req-399cfe94-82f5-4aad-b392-10c7f50b546a req-2e607a86-214a-47ed-b8df-ae65bd01b8aa tempest-TestInstancesWithCinderVolumes-1877930177 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-9b318261-668e-4454-af8f-b593a15f2a15' failed. Not Retrying. {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 02 19:54:51 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [req-399cfe94-82f5-4aad-b392-10c7f50b546a req-2e607a86-214a-47ed-b8df-ae65bd01b8aa tempest-TestInstancesWithCinderVolumes-1877930177 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.717s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:54:51 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-54fb80fc-200f-4a37-8ded-8274aa62a666 tempest-VolumesTransfersV355Test-1715106952 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.925s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:54:51 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-54fb80fc-200f-4a37-8ded-8274aa62a666 tempest-VolumesTransfersV355Test-1715106952 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce906cb830>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T17:54:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-543101486',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93ef89c1-794d-42a2-8504-b054cb62d051,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a899e6ccd564102abd7133b6209f2c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T17:54:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T17:54:48Z,use_quota=True,user_id='52c729a2789f41dbad706db15e6621cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)}" {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 19:54:51 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-54fb80fc-200f-4a37-8ded-8274aa62a666 tempest-VolumesTransfersV355Test-1715106952 None] Creating volume 93ef89c1-794d-42a2-8504-b054cb62d051 {{(pid=86639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 19:54:51 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-54fb80fc-200f-4a37-8ded-8274aa62a666 tempest-VolumesTransfersV355Test-1715106952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:54:51 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-54fb80fc-200f-4a37-8ded-8274aa62a666 tempest-VolumesTransfersV355Test-1715106952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:54:51 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-54fb80fc-200f-4a37-8ded-8274aa62a666 tempest-VolumesTransfersV355Test-1715106952 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 19:54:51 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-54fb80fc-200f-4a37-8ded-8274aa62a666 tempest-VolumesTransfersV355Test-1715106952 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 19:54:51 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-54fb80fc-200f-4a37-8ded-8274aa62a666 tempest-VolumesTransfersV355Test-1715106952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:54:51 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-54fb80fc-200f-4a37-8ded-8274aa62a666 tempest-VolumesTransfersV355Test-1715106952 None] Selected osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92 as target Quobyte volume. {{(pid=86639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 19:54:51 devstack cinder-volume[86639]: INFO cinder.volume.drivers.remotefs [None req-54fb80fc-200f-4a37-8ded-8274aa62a666 tempest-VolumesTransfersV355Test-1715106952 None] casted to osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92
Jul 02 19:54:51 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-54fb80fc-200f-4a37-8ded-8274aa62a666 tempest-VolumesTransfersV355Test-1715106952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-93ef89c1-794d-42a2-8504-b054cb62d051 1073741824 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:54:51 devstack sudo[98860]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-93ef89c1-794d-42a2-8504-b054cb62d051 1073741824
Jul 02 19:54:51 devstack sudo[98860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:54:51 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [req-399cfe94-82f5-4aad-b392-10c7f50b546a req-2e607a86-214a-47ed-b8df-ae65bd01b8aa tempest-TestInstancesWithCinderVolumes-1877930177 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92', 'name': 'volume-9b318261-668e-4454-af8f-b593a15f2a15', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0d8bae0f-61aa-48d6-9124-5aa7846a5928', 'enforce_multipath': True} {{(pid=86639) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 02 19:54:51 devstack sudo[98850]: pam_unix(sudo:session): session closed for user root
Jul 02 19:54:51 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-141ac60b-fa75-4ff9-80aa-68cbab148e01 tempest-SnapshotsActionsTest-1698233610 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-46d356a2-75af-4ae3-a828-0b1c37b99bae.3c2ee6f9-ebd9-4a5d-aacd-24c8155ad380" returned: 0 in 0.925s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:54:51 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-141ac60b-fa75-4ff9-80aa-68cbab148e01 tempest-SnapshotsActionsTest-1698233610 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-46d356a2-75af-4ae3-a828-0b1c37b99bae(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86639) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 02 19:54:51 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[c70de310-0db3-4ee0-8b41-75082d13d1e4]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 19:54:51 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-141ac60b-fa75-4ff9-80aa-68cbab148e01 tempest-SnapshotsActionsTest-1698233610 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-46d356a2-75af-4ae3-a828-0b1c37b99bae.7186926e-6740-4ea9-8d45-1f115e50ba78 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:54:51 devstack cinder-volume[86639]: INFO cinder.volume.manager [req-399cfe94-82f5-4aad-b392-10c7f50b546a req-2e607a86-214a-47ed-b8df-ae65bd01b8aa tempest-TestInstancesWithCinderVolumes-1877930177 None] attachment_update completed successfully.
Jul 02 19:54:51 devstack sudo[98862]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-46d356a2-75af-4ae3-a828-0b1c37b99bae.7186926e-6740-4ea9-8d45-1f115e50ba78
Jul 02 19:54:51 devstack sudo[98862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:54:52 devstack sudo[98862]: pam_unix(sudo:session): session closed for user root
Jul 02 19:54:52 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-141ac60b-fa75-4ff9-80aa-68cbab148e01 tempest-SnapshotsActionsTest-1698233610 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-46d356a2-75af-4ae3-a828-0b1c37b99bae.7186926e-6740-4ea9-8d45-1f115e50ba78" returned: 0 in 0.832s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:54:52 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-141ac60b-fa75-4ff9-80aa-68cbab148e01 tempest-SnapshotsActionsTest-1698233610 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-46d356a2-75af-4ae3-a828-0b1c37b99bae(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86639) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 02 19:54:52 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-141ac60b-fa75-4ff9-80aa-68cbab148e01 tempest-SnapshotsActionsTest-1698233610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-46d356a2-75af-4ae3-a828-0b1c37b99bae.3c2ee6f9-ebd9-4a5d-aacd-24c8155ad380 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:54:52 devstack sudo[98860]: pam_unix(sudo:session): session closed for user root
Jul 02 19:54:52 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-54fb80fc-200f-4a37-8ded-8274aa62a666 tempest-VolumesTransfersV355Test-1715106952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-93ef89c1-794d-42a2-8504-b054cb62d051 1073741824" returned: 0 in 0.982s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:54:52 devstack sudo[98871]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-46d356a2-75af-4ae3-a828-0b1c37b99bae.3c2ee6f9-ebd9-4a5d-aacd-24c8155ad380
Jul 02 19:54:52 devstack sudo[98871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:54:52 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-54fb80fc-200f-4a37-8ded-8274aa62a666 tempest-VolumesTransfersV355Test-1715106952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-93ef89c1-794d-42a2-8504-b054cb62d051 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:54:52 devstack sudo[98874]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-93ef89c1-794d-42a2-8504-b054cb62d051
Jul 02 19:54:52 devstack sudo[98874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:54:52 devstack sudo[98874]: pam_unix(sudo:session): session closed for user root
Jul 02 19:54:52 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-54fb80fc-200f-4a37-8ded-8274aa62a666 tempest-VolumesTransfersV355Test-1715106952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-93ef89c1-794d-42a2-8504-b054cb62d051" returned: 0 in 0.715s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:54:52 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-54fb80fc-200f-4a37-8ded-8274aa62a666 tempest-VolumesTransfersV355Test-1715106952 None] <== create_volume: return (1745ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'} {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 19:54:52 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-54fb80fc-200f-4a37-8ded-8274aa62a666 tempest-VolumesTransfersV355Test-1715106952 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.749s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:54:52 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-54fb80fc-200f-4a37-8ded-8274aa62a666 tempest-VolumesTransfersV355Test-1715106952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb194e90-4544-43f7-8d1f-af128e6d64d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-93ef89c1-794d-42a2-8504-b054cb62d051', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:54:52 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-54fb80fc-200f-4a37-8ded-8274aa62a666 tempest-VolumesTransfersV355Test-1715106952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb0d392b-d479-4e7b-9059-4845e924c3a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:54:52 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-54fb80fc-200f-4a37-8ded-8274aa62a666 tempest-VolumesTransfersV355Test-1715106952 None] Volume volume-93ef89c1-794d-42a2-8504-b054cb62d051 (93ef89c1-794d-42a2-8504-b054cb62d051): created successfully
Jul 02 19:54:52 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-54fb80fc-200f-4a37-8ded-8274aa62a666 tempest-VolumesTransfersV355Test-1715106952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb0d392b-d479-4e7b-9059-4845e924c3a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:54:52 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-54fb80fc-200f-4a37-8ded-8274aa62a666 tempest-VolumesTransfersV355Test-1715106952 None] Flow 'volume_create_manager' (207c4e33-9775-4660-8ab1-252dfec0e1c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 19:54:52 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-54fb80fc-200f-4a37-8ded-8274aa62a666 tempest-VolumesTransfersV355Test-1715106952 None] Created volume successfully.
Jul 02 19:54:53 devstack sudo[98871]: pam_unix(sudo:session): session closed for user root
Jul 02 19:54:53 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-141ac60b-fa75-4ff9-80aa-68cbab148e01 tempest-SnapshotsActionsTest-1698233610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-46d356a2-75af-4ae3-a828-0b1c37b99bae.3c2ee6f9-ebd9-4a5d-aacd-24c8155ad380" returned: 0 in 0.997s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:54:53 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-141ac60b-fa75-4ff9-80aa-68cbab148e01 tempest-SnapshotsActionsTest-1698233610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-46d356a2-75af-4ae3-a828-0b1c37b99bae.3c2ee6f9-ebd9-4a5d-aacd-24c8155ad380 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:54:53 devstack sudo[98881]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-46d356a2-75af-4ae3-a828-0b1c37b99bae.3c2ee6f9-ebd9-4a5d-aacd-24c8155ad380
Jul 02 19:54:53 devstack sudo[98881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:54:53 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-b47d6404-d606-4979-8b25-44d839e2d694 tempest-VolumesTransfersV355Test-1317377988 None] Acquiring lock "cinder-93ef89c1-794d-42a2-8504-b054cb62d051-delete_volume" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:54:53 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-b47d6404-d606-4979-8b25-44d839e2d694 tempest-VolumesTransfersV355Test-1317377988 None] Lock "cinder-93ef89c1-794d-42a2-8504-b054cb62d051-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:54:53 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-b47d6404-d606-4979-8b25-44d839e2d694 tempest-VolumesTransfersV355Test-1317377988 None] Acquiring lock "cinder-quobyte-93ef89c1-794d-42a2-8504-b054cb62d051" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:54:53 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-b47d6404-d606-4979-8b25-44d839e2d694 tempest-VolumesTransfersV355Test-1317377988 None] Lock "cinder-quobyte-93ef89c1-794d-42a2-8504-b054cb62d051" acquired by "delete_volume" :: waited 0.019s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:54:53 devstack sudo[98881]: pam_unix(sudo:session): session closed for user root
Jul 02 19:54:53 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[68c59e4f-1310-4269-91ae-df40a13d78ee]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 19:54:53 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-b47d6404-d606-4979-8b25-44d839e2d694 tempest-VolumesTransfersV355Test-1317377988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-93ef89c1-794d-42a2-8504-b054cb62d051 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:54:53 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-141ac60b-fa75-4ff9-80aa-68cbab148e01 tempest-SnapshotsActionsTest-1698233610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-46d356a2-75af-4ae3-a828-0b1c37b99bae.3c2ee6f9-ebd9-4a5d-aacd-24c8155ad380" returned: 0 in 0.776s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:54:53 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-141ac60b-fa75-4ff9-80aa-68cbab148e01 tempest-SnapshotsActionsTest-1698233610 None] Lock "cinder-quobyte-3c2ee6f9-ebd9-4a5d-aacd-24c8155ad380" released by "_delete_snapshot" :: held 3.644s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:54:53 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-141ac60b-fa75-4ff9-80aa-68cbab148e01 tempest-SnapshotsActionsTest-1698233610 None] Lock "cinder-quobyte-46d356a2-75af-4ae3-a828-0b1c37b99bae" released by "delete_snapshot" :: held 3.677s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:54:53 devstack cinder-volume[86639]: DEBUG cinder.quota [None req-141ac60b-fa75-4ff9-80aa-68cbab148e01 tempest-SnapshotsActionsTest-1698233610 None] Created reservations ['69af8097-16e0-4ae8-9424-dc7d9f22b071', '9c3d5231-08ae-427e-a4cd-3e7e3cb9e070', 'b6c3f444-6433-4a4e-8d1d-382070ee0878', '9034c8dc-3ba7-4cee-b9f1-8a39a93dbb43'] {{(pid=86639) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 19:54:54 devstack sudo[98952]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-93ef89c1-794d-42a2-8504-b054cb62d051
Jul 02 19:54:54 devstack sudo[98952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:54:54 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-141ac60b-fa75-4ff9-80aa-68cbab148e01 tempest-SnapshotsActionsTest-1698233610 None] Delete snapshot completed successfully.
Jul 02 19:54:54 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-141ac60b-fa75-4ff9-80aa-68cbab148e01 tempest-SnapshotsActionsTest-1698233610 None] Lock "cinder-3c2ee6f9-ebd9-4a5d-aacd-24c8155ad380-delete_snapshot" released by "delete_snapshot" :: held 3.844s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:54:54 devstack sudo[98952]: pam_unix(sudo:session): session closed for user root
Jul 02 19:54:54 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-b47d6404-d606-4979-8b25-44d839e2d694 tempest-VolumesTransfersV355Test-1317377988 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-93ef89c1-794d-42a2-8504-b054cb62d051" returned: 0 in 0.829s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:54:54 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-b47d6404-d606-4979-8b25-44d839e2d694 tempest-VolumesTransfersV355Test-1317377988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-93ef89c1-794d-42a2-8504-b054cb62d051 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:54:54 devstack sudo[98957]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-93ef89c1-794d-42a2-8504-b054cb62d051
Jul 02 19:54:54 devstack sudo[98957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:54:54 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-324920d9-78cb-4775-82d7-28fcc440422c tempest-SnapshotsActionsTest-1617821023 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:54:54 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-324920d9-78cb-4775-82d7-28fcc440422c tempest-SnapshotsActionsTest-1617821023 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:54:54 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-324920d9-78cb-4775-82d7-28fcc440422c tempest-SnapshotsActionsTest-1617821023 None] Creating offline snapshot 1ddc0acd-67d4-45c8-ab98-2bb76ba4299b of volume 46d356a2-75af-4ae3-a828-0b1c37b99bae {{(pid=86639) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 02 19:54:54 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cd4cbe3-2560-42b3-bdd2-ba071a1596db]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 19:54:54 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-324920d9-78cb-4775-82d7-28fcc440422c tempest-SnapshotsActionsTest-1617821023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-46d356a2-75af-4ae3-a828-0b1c37b99bae.7186926e-6740-4ea9-8d45-1f115e50ba78 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:54:54 devstack sudo[98962]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-46d356a2-75af-4ae3-a828-0b1c37b99bae.7186926e-6740-4ea9-8d45-1f115e50ba78
Jul 02 19:54:54 devstack sudo[98962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:54:55 devstack sudo[98957]: pam_unix(sudo:session): session closed for user root
Jul 02 19:54:55 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-b47d6404-d606-4979-8b25-44d839e2d694 tempest-VolumesTransfersV355Test-1317377988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-93ef89c1-794d-42a2-8504-b054cb62d051" returned: 0 in 0.742s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:54:55 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-b47d6404-d606-4979-8b25-44d839e2d694 tempest-VolumesTransfersV355Test-1317377988 None] Lock "cinder-quobyte-93ef89c1-794d-42a2-8504-b054cb62d051" released by "delete_volume" :: held 1.620s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:54:55 devstack cinder-volume[86639]: DEBUG cinder.quota [None req-b47d6404-d606-4979-8b25-44d839e2d694 tempest-VolumesTransfersV355Test-1317377988 None] Created reservations ['4aba6ea8-4e44-4ca4-a5a6-af26861e1cbe', 'd501c909-0764-4360-87c1-e2692fd1969d', '95d432fa-3855-4942-921f-fff95958df16', '0aee1324-aeda-4e92-8bcc-87b89f779884'] {{(pid=86639) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 19:54:55 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-b47d6404-d606-4979-8b25-44d839e2d694 tempest-VolumesTransfersV355Test-1317377988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:54:55 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-b47d6404-d606-4979-8b25-44d839e2d694 tempest-VolumesTransfersV355Test-1317377988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:54:55 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-b47d6404-d606-4979-8b25-44d839e2d694 tempest-VolumesTransfersV355Test-1317377988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 19:54:55 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-b47d6404-d606-4979-8b25-44d839e2d694 tempest-VolumesTransfersV355Test-1317377988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 19:54:55 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-b47d6404-d606-4979-8b25-44d839e2d694 tempest-VolumesTransfersV355Test-1317377988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:54:55 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-b47d6404-d606-4979-8b25-44d839e2d694 tempest-VolumesTransfersV355Test-1317377988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:54:55 devstack sudo[98970]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e
Jul 02 19:54:55 devstack sudo[98970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:54:55 devstack sudo[98962]: pam_unix(sudo:session): session closed for user root
Jul 02 19:54:55 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-324920d9-78cb-4775-82d7-28fcc440422c tempest-SnapshotsActionsTest-1617821023 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-46d356a2-75af-4ae3-a828-0b1c37b99bae.7186926e-6740-4ea9-8d45-1f115e50ba78" returned: 0 in 0.786s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:54:55 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-324920d9-78cb-4775-82d7-28fcc440422c tempest-SnapshotsActionsTest-1617821023 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-46d356a2-75af-4ae3-a828-0b1c37b99bae(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86639) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 02 19:54:55 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-324920d9-78cb-4775-82d7-28fcc440422c tempest-SnapshotsActionsTest-1617821023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-46d356a2-75af-4ae3-a828-0b1c37b99bae.7186926e-6740-4ea9-8d45-1f115e50ba78,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-46d356a2-75af-4ae3-a828-0b1c37b99bae.1ddc0acd-67d4-45c8-ab98-2bb76ba4299b 1G {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:54:55 devstack sudo[98972]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-46d356a2-75af-4ae3-a828-0b1c37b99bae.7186926e-6740-4ea9-8d45-1f115e50ba78,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-46d356a2-75af-4ae3-a828-0b1c37b99bae.1ddc0acd-67d4-45c8-ab98-2bb76ba4299b 1G
Jul 02 19:54:55 devstack sudo[98972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:54:56 devstack sudo[98970]: pam_unix(sudo:session): session closed for user root
Jul 02 19:54:56 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-b47d6404-d606-4979-8b25-44d839e2d694 tempest-VolumesTransfersV355Test-1317377988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e" returned: 0 in 0.697s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:54:56 devstack cinder-volume[86639]: DEBUG cinder.manager [None req-b47d6404-d606-4979-8b25-44d839e2d694 tempest-VolumesTransfersV355Test-1317377988 None] Notifying Schedulers of capabilities ... {{(pid=86639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 19:54:56 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-b47d6404-d606-4979-8b25-44d839e2d694 tempest-VolumesTransfersV355Test-1317377988 None] Deleted volume successfully.
Jul 02 19:54:56 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-b47d6404-d606-4979-8b25-44d839e2d694 tempest-VolumesTransfersV355Test-1317377988 None] Lock "cinder-93ef89c1-794d-42a2-8504-b054cb62d051-delete_volume" released by "delete_volume" :: held 2.541s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:54:56 devstack sudo[98972]: pam_unix(sudo:session): session closed for user root
Jul 02 19:54:56 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-324920d9-78cb-4775-82d7-28fcc440422c tempest-SnapshotsActionsTest-1617821023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-46d356a2-75af-4ae3-a828-0b1c37b99bae.7186926e-6740-4ea9-8d45-1f115e50ba78,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-46d356a2-75af-4ae3-a828-0b1c37b99bae.1ddc0acd-67d4-45c8-ab98-2bb76ba4299b 1G" returned: 0 in 1.121s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:54:56 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-324920d9-78cb-4775-82d7-28fcc440422c tempest-SnapshotsActionsTest-1617821023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-46d356a2-75af-4ae3-a828-0b1c37b99bae.7186926e-6740-4ea9-8d45-1f115e50ba78 -F qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-46d356a2-75af-4ae3-a828-0b1c37b99bae.1ddc0acd-67d4-45c8-ab98-2bb76ba4299b {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:54:56 devstack sudo[99227]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-46d356a2-75af-4ae3-a828-0b1c37b99bae.7186926e-6740-4ea9-8d45-1f115e50ba78 -F qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-46d356a2-75af-4ae3-a828-0b1c37b99bae.1ddc0acd-67d4-45c8-ab98-2bb76ba4299b
Jul 02 19:54:56 devstack sudo[99227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:54:57 devstack sudo[99227]: pam_unix(sudo:session): session closed for user root
Jul 02 19:54:57 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-324920d9-78cb-4775-82d7-28fcc440422c tempest-SnapshotsActionsTest-1617821023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-46d356a2-75af-4ae3-a828-0b1c37b99bae.7186926e-6740-4ea9-8d45-1f115e50ba78 -F qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-46d356a2-75af-4ae3-a828-0b1c37b99bae.1ddc0acd-67d4-45c8-ab98-2bb76ba4299b" returned: 0 in 1.203s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:54:57 devstack cinder-volume[86639]: WARNING cinder.volume.drivers.remotefs [None req-324920d9-78cb-4775-82d7-28fcc440422c tempest-SnapshotsActionsTest-1617821023 None] /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-46d356a2-75af-4ae3-a828-0b1c37b99bae.1ddc0acd-67d4-45c8-ab98-2bb76ba4299b is being set with open permissions: ugo+rw
Jul 02 19:54:57 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-324920d9-78cb-4775-82d7-28fcc440422c tempest-SnapshotsActionsTest-1617821023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-46d356a2-75af-4ae3-a828-0b1c37b99bae.1ddc0acd-67d4-45c8-ab98-2bb76ba4299b {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:54:57 devstack sudo[99359]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-46d356a2-75af-4ae3-a828-0b1c37b99bae.1ddc0acd-67d4-45c8-ab98-2bb76ba4299b
Jul 02 19:54:57 devstack sudo[99359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:54:58 devstack sudo[99359]: pam_unix(sudo:session): session closed for user root
Jul 02 19:54:58 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-324920d9-78cb-4775-82d7-28fcc440422c tempest-SnapshotsActionsTest-1617821023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-46d356a2-75af-4ae3-a828-0b1c37b99bae.1ddc0acd-67d4-45c8-ab98-2bb76ba4299b" returned: 0 in 1.017s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:54:59 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-324920d9-78cb-4775-82d7-28fcc440422c tempest-SnapshotsActionsTest-1617821023 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.253s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:54:59 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-324920d9-78cb-4775-82d7-28fcc440422c tempest-SnapshotsActionsTest-1617821023 None] Create snapshot completed successfully
Jul 02 19:55:00 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-02f77b0d-1a87-40c9-b7e0-c58d4fc481f3 tempest-SnapshotsActionsTest-1698233610 None] Acquiring lock "cinder-1ddc0acd-67d4-45c8-ab98-2bb76ba4299b-delete_snapshot" by "delete_snapshot" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:55:00 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-02f77b0d-1a87-40c9-b7e0-c58d4fc481f3 tempest-SnapshotsActionsTest-1698233610 None] Lock "cinder-1ddc0acd-67d4-45c8-ab98-2bb76ba4299b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:55:00 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-02f77b0d-1a87-40c9-b7e0-c58d4fc481f3 tempest-SnapshotsActionsTest-1698233610 None] Acquiring lock "cinder-quobyte-46d356a2-75af-4ae3-a828-0b1c37b99bae" by "delete_snapshot" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:55:00 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-02f77b0d-1a87-40c9-b7e0-c58d4fc481f3 tempest-SnapshotsActionsTest-1698233610 None] Lock "cinder-quobyte-46d356a2-75af-4ae3-a828-0b1c37b99bae" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:55:00 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-02f77b0d-1a87-40c9-b7e0-c58d4fc481f3 tempest-SnapshotsActionsTest-1698233610 None] Acquiring lock "cinder-quobyte-1ddc0acd-67d4-45c8-ab98-2bb76ba4299b" by "_delete_snapshot" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:55:00 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-02f77b0d-1a87-40c9-b7e0-c58d4fc481f3 tempest-SnapshotsActionsTest-1698233610 None] Lock "cinder-quobyte-1ddc0acd-67d4-45c8-ab98-2bb76ba4299b" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:55:00 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-02f77b0d-1a87-40c9-b7e0-c58d4fc481f3 tempest-SnapshotsActionsTest-1698233610 None] Deleting offline snapshot 1ddc0acd-67d4-45c8-ab98-2bb76ba4299b of volume 46d356a2-75af-4ae3-a828-0b1c37b99bae {{(pid=86639) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 02 19:55:00 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-02f77b0d-1a87-40c9-b7e0-c58d4fc481f3 tempest-SnapshotsActionsTest-1698233610 None] snapshot_file for this snap is: volume-46d356a2-75af-4ae3-a828-0b1c37b99bae.1ddc0acd-67d4-45c8-ab98-2bb76ba4299b {{(pid=86639) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 02 19:55:00 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[84fce20c-0e10-4d31-bcc1-bd1f6068e871]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 19:55:00 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-02f77b0d-1a87-40c9-b7e0-c58d4fc481f3 tempest-SnapshotsActionsTest-1698233610 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-46d356a2-75af-4ae3-a828-0b1c37b99bae.1ddc0acd-67d4-45c8-ab98-2bb76ba4299b {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:55:00 devstack sudo[99364]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-46d356a2-75af-4ae3-a828-0b1c37b99bae.1ddc0acd-67d4-45c8-ab98-2bb76ba4299b
Jul 02 19:55:00 devstack sudo[99364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:55:01 devstack sudo[99364]: pam_unix(sudo:session): session closed for user root
Jul 02 19:55:01 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-02f77b0d-1a87-40c9-b7e0-c58d4fc481f3 tempest-SnapshotsActionsTest-1698233610 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-46d356a2-75af-4ae3-a828-0b1c37b99bae.1ddc0acd-67d4-45c8-ab98-2bb76ba4299b" returned: 0 in 0.984s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:55:01 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-02f77b0d-1a87-40c9-b7e0-c58d4fc481f3 tempest-SnapshotsActionsTest-1698233610 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-46d356a2-75af-4ae3-a828-0b1c37b99bae(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86639) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 02 19:55:01 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[9884cd1a-7fcb-4270-bb2a-d2c190e45713]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 19:55:01 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-02f77b0d-1a87-40c9-b7e0-c58d4fc481f3 tempest-SnapshotsActionsTest-1698233610 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-46d356a2-75af-4ae3-a828-0b1c37b99bae.7186926e-6740-4ea9-8d45-1f115e50ba78 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:55:01 devstack sudo[99372]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-46d356a2-75af-4ae3-a828-0b1c37b99bae.7186926e-6740-4ea9-8d45-1f115e50ba78
Jul 02 19:55:01 devstack sudo[99372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:55:02 devstack sudo[99372]: pam_unix(sudo:session): session closed for user root
Jul 02 19:55:02 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-02f77b0d-1a87-40c9-b7e0-c58d4fc481f3 tempest-SnapshotsActionsTest-1698233610 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-46d356a2-75af-4ae3-a828-0b1c37b99bae.7186926e-6740-4ea9-8d45-1f115e50ba78" returned: 0 in 1.140s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:55:02 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-02f77b0d-1a87-40c9-b7e0-c58d4fc481f3 tempest-SnapshotsActionsTest-1698233610 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-46d356a2-75af-4ae3-a828-0b1c37b99bae(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86639) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 02 19:55:02 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-02f77b0d-1a87-40c9-b7e0-c58d4fc481f3 tempest-SnapshotsActionsTest-1698233610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-46d356a2-75af-4ae3-a828-0b1c37b99bae.1ddc0acd-67d4-45c8-ab98-2bb76ba4299b {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:55:02 devstack sudo[99377]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-46d356a2-75af-4ae3-a828-0b1c37b99bae.1ddc0acd-67d4-45c8-ab98-2bb76ba4299b
Jul 02 19:55:02 devstack sudo[99377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:55:04 devstack sudo[99377]: pam_unix(sudo:session): session closed for user root
Jul 02 19:55:04 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-02f77b0d-1a87-40c9-b7e0-c58d4fc481f3 tempest-SnapshotsActionsTest-1698233610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-46d356a2-75af-4ae3-a828-0b1c37b99bae.1ddc0acd-67d4-45c8-ab98-2bb76ba4299b" returned: 0 in 1.665s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:55:04 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-02f77b0d-1a87-40c9-b7e0-c58d4fc481f3 tempest-SnapshotsActionsTest-1698233610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-46d356a2-75af-4ae3-a828-0b1c37b99bae.1ddc0acd-67d4-45c8-ab98-2bb76ba4299b {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:55:04 devstack sudo[99389]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-46d356a2-75af-4ae3-a828-0b1c37b99bae.1ddc0acd-67d4-45c8-ab98-2bb76ba4299b
Jul 02 19:55:04 devstack sudo[99389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:55:05 devstack sudo[99389]: pam_unix(sudo:session): session closed for user root
Jul 02 19:55:05 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-02f77b0d-1a87-40c9-b7e0-c58d4fc481f3 tempest-SnapshotsActionsTest-1698233610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-46d356a2-75af-4ae3-a828-0b1c37b99bae.1ddc0acd-67d4-45c8-ab98-2bb76ba4299b" returned: 0 in 1.133s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:55:05 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-02f77b0d-1a87-40c9-b7e0-c58d4fc481f3 tempest-SnapshotsActionsTest-1698233610 None] Lock "cinder-quobyte-1ddc0acd-67d4-45c8-ab98-2bb76ba4299b" released by "_delete_snapshot" :: held 5.108s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:55:05 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-02f77b0d-1a87-40c9-b7e0-c58d4fc481f3 tempest-SnapshotsActionsTest-1698233610 None] Lock "cinder-quobyte-46d356a2-75af-4ae3-a828-0b1c37b99bae" released by "delete_snapshot" :: held 5.158s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:55:05 devstack cinder-volume[86639]: DEBUG cinder.quota [None req-02f77b0d-1a87-40c9-b7e0-c58d4fc481f3 tempest-SnapshotsActionsTest-1698233610 None] Created reservations ['6ee7bd4d-6abe-40a1-b842-d93f3e3ac5dc', '9d5115f7-1915-4dfe-88ae-d1d82c943245', 'f18210d6-a849-4c7e-a530-52574e4d84ce', 'fd2e013a-14b7-43fe-94ea-d387625654f2'] {{(pid=86639) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 19:55:05 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-02f77b0d-1a87-40c9-b7e0-c58d4fc481f3 tempest-SnapshotsActionsTest-1698233610 None] Delete snapshot completed successfully.
Jul 02 19:55:05 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-02f77b0d-1a87-40c9-b7e0-c58d4fc481f3 tempest-SnapshotsActionsTest-1698233610 None] Lock "cinder-1ddc0acd-67d4-45c8-ab98-2bb76ba4299b-delete_snapshot" released by "delete_snapshot" :: held 5.581s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:55:07 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-09b71327-8065-49ad-be29-b3b4ae6271c3 tempest-SnapshotsActionsTest-1617821023 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:55:07 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-09b71327-8065-49ad-be29-b3b4ae6271c3 tempest-SnapshotsActionsTest-1617821023 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:55:07 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-09b71327-8065-49ad-be29-b3b4ae6271c3 tempest-SnapshotsActionsTest-1617821023 None] Creating offline snapshot cef38454-b7d7-4e2b-969c-575c9eabd001 of volume 46d356a2-75af-4ae3-a828-0b1c37b99bae {{(pid=86639) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 02 19:55:07 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[4efe0cf0-85cc-4838-87dd-e1683c560711]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 19:55:07 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-09b71327-8065-49ad-be29-b3b4ae6271c3 tempest-SnapshotsActionsTest-1617821023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-46d356a2-75af-4ae3-a828-0b1c37b99bae.7186926e-6740-4ea9-8d45-1f115e50ba78 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:55:07 devstack sudo[99392]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-46d356a2-75af-4ae3-a828-0b1c37b99bae.7186926e-6740-4ea9-8d45-1f115e50ba78
Jul 02 19:55:07 devstack sudo[99392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:55:08 devstack sudo[99392]: pam_unix(sudo:session): session closed for user root
Jul 02 19:55:09 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-09b71327-8065-49ad-be29-b3b4ae6271c3 tempest-SnapshotsActionsTest-1617821023 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-46d356a2-75af-4ae3-a828-0b1c37b99bae.7186926e-6740-4ea9-8d45-1f115e50ba78" returned: 0 in 1.433s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:55:09 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-09b71327-8065-49ad-be29-b3b4ae6271c3 tempest-SnapshotsActionsTest-1617821023 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-46d356a2-75af-4ae3-a828-0b1c37b99bae(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86639) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 02 19:55:09 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-09b71327-8065-49ad-be29-b3b4ae6271c3 tempest-SnapshotsActionsTest-1617821023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-46d356a2-75af-4ae3-a828-0b1c37b99bae.7186926e-6740-4ea9-8d45-1f115e50ba78,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-46d356a2-75af-4ae3-a828-0b1c37b99bae.cef38454-b7d7-4e2b-969c-575c9eabd001 1G {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:55:09 devstack sudo[99402]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-46d356a2-75af-4ae3-a828-0b1c37b99bae.7186926e-6740-4ea9-8d45-1f115e50ba78,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-46d356a2-75af-4ae3-a828-0b1c37b99bae.cef38454-b7d7-4e2b-969c-575c9eabd001 1G
Jul 02 19:55:09 devstack sudo[99402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:55:09 devstack cinder-volume[86639]: DEBUG cinder.volume.flows.manager.create_volume [None req-f751d1f5-2d0b-4ec9-8016-629e8bda2b25 tempest-VolumesNegativeTest-64812371 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 19:55:09 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-f751d1f5-2d0b-4ec9-8016-629e8bda2b25 tempest-VolumesNegativeTest-64812371 None] Flow 'volume_create_manager' (147ba385-3ab1-473b-904e-1931babce65f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 19:55:09 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-f751d1f5-2d0b-4ec9-8016-629e8bda2b25 tempest-VolumesNegativeTest-64812371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (894f5b0c-9315-43f2-946e-7bfbf6b89c98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:55:09 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-f751d1f5-2d0b-4ec9-8016-629e8bda2b25 tempest-VolumesNegativeTest-64812371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (894f5b0c-9315-43f2-946e-7bfbf6b89c98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T17:55:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-753398960',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea6ab7ae-e8ed-453f-96c1-61d1a71542bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b69350b7e2ed4921a9b785ec4a1bba1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T17:55:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T17:55:10Z,use_quota=True,user_id='be81605a87df40a4b71d025d7c7c5c3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:55:09 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-f751d1f5-2d0b-4ec9-8016-629e8bda2b25 tempest-VolumesNegativeTest-64812371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76428e97-6c25-4ef5-ac10-976fa6525b98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:55:09 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-f751d1f5-2d0b-4ec9-8016-629e8bda2b25 tempest-VolumesNegativeTest-64812371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76428e97-6c25-4ef5-ac10-976fa6525b98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:55:09 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-f751d1f5-2d0b-4ec9-8016-629e8bda2b25 tempest-VolumesNegativeTest-64812371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3831154c-a961-433b-b46d-239bc79c9ecc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:55:09 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-f751d1f5-2d0b-4ec9-8016-629e8bda2b25 tempest-VolumesNegativeTest-64812371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3831154c-a961-433b-b46d-239bc79c9ecc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea6ab7ae-e8ed-453f-96c1-61d1a71542bc', 'volume_name': 'volume-ea6ab7ae-e8ed-453f-96c1-61d1a71542bc', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:55:09 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-f751d1f5-2d0b-4ec9-8016-629e8bda2b25 tempest-VolumesNegativeTest-64812371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc2340a0-ac25-4cab-88b5-b1d6b19bedc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:55:09 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-f751d1f5-2d0b-4ec9-8016-629e8bda2b25 tempest-VolumesNegativeTest-64812371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc2340a0-ac25-4cab-88b5-b1d6b19bedc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:55:09 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-f751d1f5-2d0b-4ec9-8016-629e8bda2b25 tempest-VolumesNegativeTest-64812371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c147334e-14c0-4a4d-a69c-7d2bddae92c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:55:09 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-f751d1f5-2d0b-4ec9-8016-629e8bda2b25 tempest-VolumesNegativeTest-64812371 None] Volume ea6ab7ae-e8ed-453f-96c1-61d1a71542bc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea6ab7ae-e8ed-453f-96c1-61d1a71542bc', 'volume_size': 1}
Jul 02 19:55:09 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-f751d1f5-2d0b-4ec9-8016-629e8bda2b25 tempest-VolumesNegativeTest-64812371 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:55:10 devstack sudo[99402]: pam_unix(sudo:session): session closed for user root
Jul 02 19:55:10 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-09b71327-8065-49ad-be29-b3b4ae6271c3 tempest-SnapshotsActionsTest-1617821023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-46d356a2-75af-4ae3-a828-0b1c37b99bae.7186926e-6740-4ea9-8d45-1f115e50ba78,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-46d356a2-75af-4ae3-a828-0b1c37b99bae.cef38454-b7d7-4e2b-969c-575c9eabd001 1G" returned: 0 in 1.328s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:55:10 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-09b71327-8065-49ad-be29-b3b4ae6271c3 tempest-SnapshotsActionsTest-1617821023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-46d356a2-75af-4ae3-a828-0b1c37b99bae.7186926e-6740-4ea9-8d45-1f115e50ba78 -F qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-46d356a2-75af-4ae3-a828-0b1c37b99bae.cef38454-b7d7-4e2b-969c-575c9eabd001 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:55:10 devstack sudo[99407]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-46d356a2-75af-4ae3-a828-0b1c37b99bae.7186926e-6740-4ea9-8d45-1f115e50ba78 -F qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-46d356a2-75af-4ae3-a828-0b1c37b99bae.cef38454-b7d7-4e2b-969c-575c9eabd001
Jul 02 19:55:10 devstack sudo[99407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:55:11 devstack sudo[99407]: pam_unix(sudo:session): session closed for user root
Jul 02 19:55:11 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-09b71327-8065-49ad-be29-b3b4ae6271c3 tempest-SnapshotsActionsTest-1617821023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-46d356a2-75af-4ae3-a828-0b1c37b99bae.7186926e-6740-4ea9-8d45-1f115e50ba78 -F qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-46d356a2-75af-4ae3-a828-0b1c37b99bae.cef38454-b7d7-4e2b-969c-575c9eabd001" returned: 0 in 0.785s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:55:11 devstack cinder-volume[86639]: WARNING cinder.volume.drivers.remotefs [None req-09b71327-8065-49ad-be29-b3b4ae6271c3 tempest-SnapshotsActionsTest-1617821023 None] /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-46d356a2-75af-4ae3-a828-0b1c37b99bae.cef38454-b7d7-4e2b-969c-575c9eabd001 is being set with open permissions: ugo+rw
Jul 02 19:55:11 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-09b71327-8065-49ad-be29-b3b4ae6271c3 tempest-SnapshotsActionsTest-1617821023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-46d356a2-75af-4ae3-a828-0b1c37b99bae.cef38454-b7d7-4e2b-969c-575c9eabd001 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:55:11 devstack sudo[99412]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-46d356a2-75af-4ae3-a828-0b1c37b99bae.cef38454-b7d7-4e2b-969c-575c9eabd001
Jul 02 19:55:11 devstack sudo[99412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:55:11 devstack sudo[99412]: pam_unix(sudo:session): session closed for user root
Jul 02 19:55:11 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-09b71327-8065-49ad-be29-b3b4ae6271c3 tempest-SnapshotsActionsTest-1617821023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-46d356a2-75af-4ae3-a828-0b1c37b99bae.cef38454-b7d7-4e2b-969c-575c9eabd001" returned: 0 in 0.838s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:55:12 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-09b71327-8065-49ad-be29-b3b4ae6271c3 tempest-SnapshotsActionsTest-1617821023 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.557s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:55:12 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-f751d1f5-2d0b-4ec9-8016-629e8bda2b25 tempest-VolumesNegativeTest-64812371 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.027s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:55:12 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-f751d1f5-2d0b-4ec9-8016-629e8bda2b25 tempest-VolumesNegativeTest-64812371 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce906cb830>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T17:55:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-753398960',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea6ab7ae-e8ed-453f-96c1-61d1a71542bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b69350b7e2ed4921a9b785ec4a1bba1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T17:55:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T17:55:10Z,use_quota=True,user_id='be81605a87df40a4b71d025d7c7c5c3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)}" {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 19:55:12 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-f751d1f5-2d0b-4ec9-8016-629e8bda2b25 tempest-VolumesNegativeTest-64812371 None] Creating volume ea6ab7ae-e8ed-453f-96c1-61d1a71542bc {{(pid=86639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 19:55:12 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-f751d1f5-2d0b-4ec9-8016-629e8bda2b25 tempest-VolumesNegativeTest-64812371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:55:12 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-f751d1f5-2d0b-4ec9-8016-629e8bda2b25 tempest-VolumesNegativeTest-64812371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:55:12 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-f751d1f5-2d0b-4ec9-8016-629e8bda2b25 tempest-VolumesNegativeTest-64812371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 19:55:12 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-f751d1f5-2d0b-4ec9-8016-629e8bda2b25 tempest-VolumesNegativeTest-64812371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 19:55:12 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-f751d1f5-2d0b-4ec9-8016-629e8bda2b25 tempest-VolumesNegativeTest-64812371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:55:12 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-f751d1f5-2d0b-4ec9-8016-629e8bda2b25 tempest-VolumesNegativeTest-64812371 None] Selected osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92 as target Quobyte volume. {{(pid=86639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 19:55:12 devstack cinder-volume[86639]: INFO cinder.volume.drivers.remotefs [None req-f751d1f5-2d0b-4ec9-8016-629e8bda2b25 tempest-VolumesNegativeTest-64812371 None] casted to osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92
Jul 02 19:55:12 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-f751d1f5-2d0b-4ec9-8016-629e8bda2b25 tempest-VolumesNegativeTest-64812371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-ea6ab7ae-e8ed-453f-96c1-61d1a71542bc 1073741824 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:55:12 devstack sudo[99447]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-ea6ab7ae-e8ed-453f-96c1-61d1a71542bc 1073741824
Jul 02 19:55:12 devstack sudo[99447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:55:12 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-09b71327-8065-49ad-be29-b3b4ae6271c3 tempest-SnapshotsActionsTest-1617821023 None] Create snapshot completed successfully
Jul 02 19:55:12 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-2d696fd9-15f7-42ab-ba9e-2ea4cb648e46 tempest-SnapshotsActionsTest-1698233610 None] Acquiring lock "cinder-cef38454-b7d7-4e2b-969c-575c9eabd001-delete_snapshot" by "delete_snapshot" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:55:12 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-2d696fd9-15f7-42ab-ba9e-2ea4cb648e46 tempest-SnapshotsActionsTest-1698233610 None] Lock "cinder-cef38454-b7d7-4e2b-969c-575c9eabd001-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:55:12 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-2d696fd9-15f7-42ab-ba9e-2ea4cb648e46 tempest-SnapshotsActionsTest-1698233610 None] Acquiring lock "cinder-quobyte-46d356a2-75af-4ae3-a828-0b1c37b99bae" by "delete_snapshot" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:55:12 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-2d696fd9-15f7-42ab-ba9e-2ea4cb648e46 tempest-SnapshotsActionsTest-1698233610 None] Lock "cinder-quobyte-46d356a2-75af-4ae3-a828-0b1c37b99bae" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:55:12 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-2d696fd9-15f7-42ab-ba9e-2ea4cb648e46 tempest-SnapshotsActionsTest-1698233610 None] Acquiring lock "cinder-quobyte-cef38454-b7d7-4e2b-969c-575c9eabd001" by "_delete_snapshot" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:55:13 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-2d696fd9-15f7-42ab-ba9e-2ea4cb648e46 tempest-SnapshotsActionsTest-1698233610 None] Lock "cinder-quobyte-cef38454-b7d7-4e2b-969c-575c9eabd001" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:55:13 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-2d696fd9-15f7-42ab-ba9e-2ea4cb648e46 tempest-SnapshotsActionsTest-1698233610 None] Deleting offline snapshot cef38454-b7d7-4e2b-969c-575c9eabd001 of volume 46d356a2-75af-4ae3-a828-0b1c37b99bae {{(pid=86639) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 02 19:55:13 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-2d696fd9-15f7-42ab-ba9e-2ea4cb648e46 tempest-SnapshotsActionsTest-1698233610 None] snapshot_file for this snap is: volume-46d356a2-75af-4ae3-a828-0b1c37b99bae.cef38454-b7d7-4e2b-969c-575c9eabd001 {{(pid=86639) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 02 19:55:13 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3c0d6c5-0f76-49c8-91ee-3cdbce03e225]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 19:55:13 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-2d696fd9-15f7-42ab-ba9e-2ea4cb648e46 tempest-SnapshotsActionsTest-1698233610 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-46d356a2-75af-4ae3-a828-0b1c37b99bae.cef38454-b7d7-4e2b-969c-575c9eabd001 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:55:13 devstack sudo[99836]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-46d356a2-75af-4ae3-a828-0b1c37b99bae.cef38454-b7d7-4e2b-969c-575c9eabd001
Jul 02 19:55:13 devstack sudo[99836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:55:13 devstack sudo[99447]: pam_unix(sudo:session): session closed for user root
Jul 02 19:55:13 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-f751d1f5-2d0b-4ec9-8016-629e8bda2b25 tempest-VolumesNegativeTest-64812371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-ea6ab7ae-e8ed-453f-96c1-61d1a71542bc 1073741824" returned: 0 in 1.225s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:55:13 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-f751d1f5-2d0b-4ec9-8016-629e8bda2b25 tempest-VolumesNegativeTest-64812371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-ea6ab7ae-e8ed-453f-96c1-61d1a71542bc {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:55:13 devstack sudo[99838]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-ea6ab7ae-e8ed-453f-96c1-61d1a71542bc
Jul 02 19:55:13 devstack sudo[99838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:55:13 devstack sudo[99836]: pam_unix(sudo:session): session closed for user root
Jul 02 19:55:13 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-2d696fd9-15f7-42ab-ba9e-2ea4cb648e46 tempest-SnapshotsActionsTest-1698233610 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-46d356a2-75af-4ae3-a828-0b1c37b99bae.cef38454-b7d7-4e2b-969c-575c9eabd001" returned: 0 in 0.832s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:55:13 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-2d696fd9-15f7-42ab-ba9e-2ea4cb648e46 tempest-SnapshotsActionsTest-1698233610 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-46d356a2-75af-4ae3-a828-0b1c37b99bae(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86639) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 02 19:55:13 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[b71b3bef-4310-44e5-a92f-5178c41427ff]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 19:55:13 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-2d696fd9-15f7-42ab-ba9e-2ea4cb648e46 tempest-SnapshotsActionsTest-1698233610 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-46d356a2-75af-4ae3-a828-0b1c37b99bae.7186926e-6740-4ea9-8d45-1f115e50ba78 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:55:14 devstack sudo[99868]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-46d356a2-75af-4ae3-a828-0b1c37b99bae.7186926e-6740-4ea9-8d45-1f115e50ba78
Jul 02 19:55:14 devstack sudo[99868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:55:14 devstack sudo[99838]: pam_unix(sudo:session): session closed for user root
Jul 02 19:55:14 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-f751d1f5-2d0b-4ec9-8016-629e8bda2b25 tempest-VolumesNegativeTest-64812371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-ea6ab7ae-e8ed-453f-96c1-61d1a71542bc" returned: 0 in 0.791s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:55:14 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-f751d1f5-2d0b-4ec9-8016-629e8bda2b25 tempest-VolumesNegativeTest-64812371 None] <== create_volume: return (2089ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'} {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 19:55:14 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-f751d1f5-2d0b-4ec9-8016-629e8bda2b25 tempest-VolumesNegativeTest-64812371 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.094s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:55:14 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-f751d1f5-2d0b-4ec9-8016-629e8bda2b25 tempest-VolumesNegativeTest-64812371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c147334e-14c0-4a4d-a69c-7d2bddae92c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea6ab7ae-e8ed-453f-96c1-61d1a71542bc', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:55:14 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-f751d1f5-2d0b-4ec9-8016-629e8bda2b25 tempest-VolumesNegativeTest-64812371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3cdc9e0-5ec2-4cbb-a1b7-3fb717bb7aba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:55:14 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-f751d1f5-2d0b-4ec9-8016-629e8bda2b25 tempest-VolumesNegativeTest-64812371 None] Volume volume-ea6ab7ae-e8ed-453f-96c1-61d1a71542bc (ea6ab7ae-e8ed-453f-96c1-61d1a71542bc): created successfully
Jul 02 19:55:14 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-f751d1f5-2d0b-4ec9-8016-629e8bda2b25 tempest-VolumesNegativeTest-64812371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3cdc9e0-5ec2-4cbb-a1b7-3fb717bb7aba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:55:14 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-f751d1f5-2d0b-4ec9-8016-629e8bda2b25 tempest-VolumesNegativeTest-64812371 None] Flow 'volume_create_manager' (147ba385-3ab1-473b-904e-1931babce65f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 19:55:14 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-f751d1f5-2d0b-4ec9-8016-629e8bda2b25 tempest-VolumesNegativeTest-64812371 None] Created volume successfully.
Jul 02 19:55:14 devstack sudo[99868]: pam_unix(sudo:session): session closed for user root
Jul 02 19:55:14 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-2d696fd9-15f7-42ab-ba9e-2ea4cb648e46 tempest-SnapshotsActionsTest-1698233610 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-46d356a2-75af-4ae3-a828-0b1c37b99bae.7186926e-6740-4ea9-8d45-1f115e50ba78" returned: 0 in 0.850s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:55:14 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-2d696fd9-15f7-42ab-ba9e-2ea4cb648e46 tempest-SnapshotsActionsTest-1698233610 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-46d356a2-75af-4ae3-a828-0b1c37b99bae(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86639) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 02 19:55:14 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-2d696fd9-15f7-42ab-ba9e-2ea4cb648e46 tempest-SnapshotsActionsTest-1698233610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-46d356a2-75af-4ae3-a828-0b1c37b99bae.cef38454-b7d7-4e2b-969c-575c9eabd001 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:55:14 devstack sudo[99922]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-46d356a2-75af-4ae3-a828-0b1c37b99bae.cef38454-b7d7-4e2b-969c-575c9eabd001
Jul 02 19:55:14 devstack sudo[99922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:55:15 devstack sudo[99922]: pam_unix(sudo:session): session closed for user root
Jul 02 19:55:15 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-2d696fd9-15f7-42ab-ba9e-2ea4cb648e46 tempest-SnapshotsActionsTest-1698233610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-46d356a2-75af-4ae3-a828-0b1c37b99bae.cef38454-b7d7-4e2b-969c-575c9eabd001" returned: 0 in 1.009s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:55:15 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-2d696fd9-15f7-42ab-ba9e-2ea4cb648e46 tempest-SnapshotsActionsTest-1698233610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-46d356a2-75af-4ae3-a828-0b1c37b99bae.cef38454-b7d7-4e2b-969c-575c9eabd001 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:55:15 devstack sudo[99949]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-46d356a2-75af-4ae3-a828-0b1c37b99bae.cef38454-b7d7-4e2b-969c-575c9eabd001
Jul 02 19:55:15 devstack sudo[99949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:55:16 devstack sudo[99949]: pam_unix(sudo:session): session closed for user root
Jul 02 19:55:16 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-2d696fd9-15f7-42ab-ba9e-2ea4cb648e46 tempest-SnapshotsActionsTest-1698233610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-46d356a2-75af-4ae3-a828-0b1c37b99bae.cef38454-b7d7-4e2b-969c-575c9eabd001" returned: 0 in 0.703s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:55:16 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-2d696fd9-15f7-42ab-ba9e-2ea4cb648e46 tempest-SnapshotsActionsTest-1698233610 None] Lock "cinder-quobyte-cef38454-b7d7-4e2b-969c-575c9eabd001" released by "_delete_snapshot" :: held 3.528s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:55:16 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-2d696fd9-15f7-42ab-ba9e-2ea4cb648e46 tempest-SnapshotsActionsTest-1698233610 None] Lock "cinder-quobyte-46d356a2-75af-4ae3-a828-0b1c37b99bae" released by "delete_snapshot" :: held 3.561s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:55:16 devstack cinder-volume[86639]: DEBUG cinder.quota [None req-2d696fd9-15f7-42ab-ba9e-2ea4cb648e46 tempest-SnapshotsActionsTest-1698233610 None] Created reservations ['c0569959-6e0c-44e0-843b-20e210bd7865', '31298579-bf48-4171-baec-7f0817a58925', '782ab254-a2e5-4f60-a04d-7378c4951ee3', 'fb747126-70c9-44b0-bbd5-9711e8255244'] {{(pid=86639) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 19:55:16 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-2d696fd9-15f7-42ab-ba9e-2ea4cb648e46 tempest-SnapshotsActionsTest-1698233610 None] Delete snapshot completed successfully.
Jul 02 19:55:16 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-2d696fd9-15f7-42ab-ba9e-2ea4cb648e46 tempest-SnapshotsActionsTest-1698233610 None] Lock "cinder-cef38454-b7d7-4e2b-969c-575c9eabd001-delete_snapshot" released by "delete_snapshot" :: held 3.752s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:55:17 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-17feda95-5c06-47cd-8b3f-2dedf2de5c3e tempest-SnapshotsActionsTest-1617821023 None] Acquiring lock "cinder-7186926e-6740-4ea9-8d45-1f115e50ba78-delete_snapshot" by "delete_snapshot" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:55:17 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-17feda95-5c06-47cd-8b3f-2dedf2de5c3e tempest-SnapshotsActionsTest-1617821023 None] Lock "cinder-7186926e-6740-4ea9-8d45-1f115e50ba78-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:55:17 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-17feda95-5c06-47cd-8b3f-2dedf2de5c3e tempest-SnapshotsActionsTest-1617821023 None] Acquiring lock "cinder-quobyte-46d356a2-75af-4ae3-a828-0b1c37b99bae" by "delete_snapshot" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:55:17 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-17feda95-5c06-47cd-8b3f-2dedf2de5c3e tempest-SnapshotsActionsTest-1617821023 None] Lock "cinder-quobyte-46d356a2-75af-4ae3-a828-0b1c37b99bae" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:55:17 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-17feda95-5c06-47cd-8b3f-2dedf2de5c3e tempest-SnapshotsActionsTest-1617821023 None] Acquiring lock "cinder-quobyte-7186926e-6740-4ea9-8d45-1f115e50ba78" by "_delete_snapshot" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:55:17 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-17feda95-5c06-47cd-8b3f-2dedf2de5c3e tempest-SnapshotsActionsTest-1617821023 None] Lock "cinder-quobyte-7186926e-6740-4ea9-8d45-1f115e50ba78" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:55:17 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-17feda95-5c06-47cd-8b3f-2dedf2de5c3e tempest-SnapshotsActionsTest-1617821023 None] Deleting offline snapshot 7186926e-6740-4ea9-8d45-1f115e50ba78 of volume 46d356a2-75af-4ae3-a828-0b1c37b99bae {{(pid=86639) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 02 19:55:17 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-17feda95-5c06-47cd-8b3f-2dedf2de5c3e tempest-SnapshotsActionsTest-1617821023 None] snapshot_file for this snap is: volume-46d356a2-75af-4ae3-a828-0b1c37b99bae.7186926e-6740-4ea9-8d45-1f115e50ba78 {{(pid=86639) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 02 19:55:17 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a94c832-a128-446a-8c3a-92677bb28e70]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 19:55:17 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-17feda95-5c06-47cd-8b3f-2dedf2de5c3e tempest-SnapshotsActionsTest-1617821023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-46d356a2-75af-4ae3-a828-0b1c37b99bae.7186926e-6740-4ea9-8d45-1f115e50ba78 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:55:17 devstack sudo[99954]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-46d356a2-75af-4ae3-a828-0b1c37b99bae.7186926e-6740-4ea9-8d45-1f115e50ba78
Jul 02 19:55:17 devstack sudo[99954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:55:18 devstack sudo[99954]: pam_unix(sudo:session): session closed for user root
Jul 02 19:55:18 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-17feda95-5c06-47cd-8b3f-2dedf2de5c3e tempest-SnapshotsActionsTest-1617821023 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-46d356a2-75af-4ae3-a828-0b1c37b99bae.7186926e-6740-4ea9-8d45-1f115e50ba78" returned: 0 in 0.766s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:55:18 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-17feda95-5c06-47cd-8b3f-2dedf2de5c3e tempest-SnapshotsActionsTest-1617821023 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-46d356a2-75af-4ae3-a828-0b1c37b99bae(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86639) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 02 19:55:18 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[22350a6f-b2df-4dcc-b686-d3590a79fecb]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 19:55:18 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-17feda95-5c06-47cd-8b3f-2dedf2de5c3e tempest-SnapshotsActionsTest-1617821023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-46d356a2-75af-4ae3-a828-0b1c37b99bae {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:55:18 devstack sudo[99959]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-46d356a2-75af-4ae3-a828-0b1c37b99bae
Jul 02 19:55:18 devstack sudo[99959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:55:19 devstack sudo[99959]: pam_unix(sudo:session): session closed for user root
Jul 02 19:55:19 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-17feda95-5c06-47cd-8b3f-2dedf2de5c3e tempest-SnapshotsActionsTest-1617821023 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-46d356a2-75af-4ae3-a828-0b1c37b99bae" returned: 0 in 0.751s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:55:19 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-17feda95-5c06-47cd-8b3f-2dedf2de5c3e tempest-SnapshotsActionsTest-1617821023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-46d356a2-75af-4ae3-a828-0b1c37b99bae.7186926e-6740-4ea9-8d45-1f115e50ba78 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:55:19 devstack sudo[99964]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-46d356a2-75af-4ae3-a828-0b1c37b99bae.7186926e-6740-4ea9-8d45-1f115e50ba78
Jul 02 19:55:19 devstack sudo[99964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:55:20 devstack sudo[99964]: pam_unix(sudo:session): session closed for user root
Jul 02 19:55:20 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-17feda95-5c06-47cd-8b3f-2dedf2de5c3e tempest-SnapshotsActionsTest-1617821023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-46d356a2-75af-4ae3-a828-0b1c37b99bae.7186926e-6740-4ea9-8d45-1f115e50ba78" returned: 0 in 0.782s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:55:20 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-17feda95-5c06-47cd-8b3f-2dedf2de5c3e tempest-SnapshotsActionsTest-1617821023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-46d356a2-75af-4ae3-a828-0b1c37b99bae.7186926e-6740-4ea9-8d45-1f115e50ba78 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:55:20 devstack sudo[99969]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-46d356a2-75af-4ae3-a828-0b1c37b99bae.7186926e-6740-4ea9-8d45-1f115e50ba78
Jul 02 19:55:20 devstack sudo[99969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:55:20 devstack sudo[99969]: pam_unix(sudo:session): session closed for user root
Jul 02 19:55:20 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-17feda95-5c06-47cd-8b3f-2dedf2de5c3e tempest-SnapshotsActionsTest-1617821023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-46d356a2-75af-4ae3-a828-0b1c37b99bae.7186926e-6740-4ea9-8d45-1f115e50ba78" returned: 0 in 0.741s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:55:20 devstack cinder-volume[86639]: DEBUG dbcounter [-] [86639] Writing DB stats cinder:INSERT=28,cinder:SELECT=81,cinder:UPDATE=79,cinder:DELETE=8 {{(pid=86639) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 02 19:55:20 devstack cinder-volume[86639]: DEBUG dbcounter [-] [86639] Writing DB stats cinder:UPDATE=89,cinder:DELETE=7,cinder:SELECT=74,cinder:INSERT=23 {{(pid=86639) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 02 19:55:20 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-17feda95-5c06-47cd-8b3f-2dedf2de5c3e tempest-SnapshotsActionsTest-1617821023 None] Lock "cinder-quobyte-7186926e-6740-4ea9-8d45-1f115e50ba78" released by "_delete_snapshot" :: held 3.163s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:55:20 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-17feda95-5c06-47cd-8b3f-2dedf2de5c3e tempest-SnapshotsActionsTest-1617821023 None] Lock "cinder-quobyte-46d356a2-75af-4ae3-a828-0b1c37b99bae" released by "delete_snapshot" :: held 3.191s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:55:20 devstack cinder-volume[86639]: DEBUG cinder.quota [None req-17feda95-5c06-47cd-8b3f-2dedf2de5c3e tempest-SnapshotsActionsTest-1617821023 None] Created reservations ['938ba530-ce25-49d4-a9aa-8daaff2dc10d', 'a9cd08f2-6898-4d91-b43e-a316ec90ddf0', 'deb3982e-a99f-4ca0-9ef2-c2f17f753f5d', 'd3b63b50-5f0f-4aa4-8fa3-f5daf1f5026e'] {{(pid=86639) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 19:55:20 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-17feda95-5c06-47cd-8b3f-2dedf2de5c3e tempest-SnapshotsActionsTest-1617821023 None] Delete snapshot completed successfully.
Jul 02 19:55:20 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-17feda95-5c06-47cd-8b3f-2dedf2de5c3e tempest-SnapshotsActionsTest-1617821023 None] Lock "cinder-7186926e-6740-4ea9-8d45-1f115e50ba78-delete_snapshot" released by "delete_snapshot" :: held 3.357s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:55:21 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-1094a629-9bc2-49e7-90c7-f90f676a02af tempest-SnapshotsActionsTest-1617821023 None] Acquiring lock "cinder-46d356a2-75af-4ae3-a828-0b1c37b99bae-delete_volume" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:55:21 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-1094a629-9bc2-49e7-90c7-f90f676a02af tempest-SnapshotsActionsTest-1617821023 None] Lock "cinder-46d356a2-75af-4ae3-a828-0b1c37b99bae-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:55:21 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-1094a629-9bc2-49e7-90c7-f90f676a02af tempest-SnapshotsActionsTest-1617821023 None] Acquiring lock "cinder-quobyte-46d356a2-75af-4ae3-a828-0b1c37b99bae" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:55:21 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-1094a629-9bc2-49e7-90c7-f90f676a02af tempest-SnapshotsActionsTest-1617821023 None] Lock "cinder-quobyte-46d356a2-75af-4ae3-a828-0b1c37b99bae" acquired by "delete_volume" :: waited 0.024s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:55:22 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[37d129d0-8066-4841-9f17-c4cb3d8b68f2]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 19:55:22 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-1094a629-9bc2-49e7-90c7-f90f676a02af tempest-SnapshotsActionsTest-1617821023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-46d356a2-75af-4ae3-a828-0b1c37b99bae {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:55:22 devstack sudo[99973]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-46d356a2-75af-4ae3-a828-0b1c37b99bae
Jul 02 19:55:22 devstack sudo[99973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:55:23 devstack sudo[99973]: pam_unix(sudo:session): session closed for user root
Jul 02 19:55:23 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-1094a629-9bc2-49e7-90c7-f90f676a02af tempest-SnapshotsActionsTest-1617821023 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-46d356a2-75af-4ae3-a828-0b1c37b99bae" returned: 0 in 0.992s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:55:23 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-1094a629-9bc2-49e7-90c7-f90f676a02af tempest-SnapshotsActionsTest-1617821023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-46d356a2-75af-4ae3-a828-0b1c37b99bae {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:55:23 devstack sudo[99993]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-46d356a2-75af-4ae3-a828-0b1c37b99bae
Jul 02 19:55:23 devstack sudo[99993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:55:23 devstack sudo[99993]: pam_unix(sudo:session): session closed for user root
Jul 02 19:55:23 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-1094a629-9bc2-49e7-90c7-f90f676a02af tempest-SnapshotsActionsTest-1617821023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-46d356a2-75af-4ae3-a828-0b1c37b99bae" returned: 0 in 0.836s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:55:23 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-1094a629-9bc2-49e7-90c7-f90f676a02af tempest-SnapshotsActionsTest-1617821023 None] Lock "cinder-quobyte-46d356a2-75af-4ae3-a828-0b1c37b99bae" released by "delete_volume" :: held 1.921s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:55:23 devstack cinder-volume[86639]: DEBUG cinder.quota [None req-1094a629-9bc2-49e7-90c7-f90f676a02af tempest-SnapshotsActionsTest-1617821023 None] Created reservations ['3468e9ca-aae3-441c-99ad-b707283d839d', '738d5713-6e99-4948-af7d-fcc909df1f39', '8ecc3b86-e9c9-408b-8675-92ee53395306', '6147752f-792c-43e0-b30b-b4828dd75457'] {{(pid=86639) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 19:55:24 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-1094a629-9bc2-49e7-90c7-f90f676a02af tempest-SnapshotsActionsTest-1617821023 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:55:24 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-1094a629-9bc2-49e7-90c7-f90f676a02af tempest-SnapshotsActionsTest-1617821023 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:55:24 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-1094a629-9bc2-49e7-90c7-f90f676a02af tempest-SnapshotsActionsTest-1617821023 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 19:55:24 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-1094a629-9bc2-49e7-90c7-f90f676a02af tempest-SnapshotsActionsTest-1617821023 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 19:55:24 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-1094a629-9bc2-49e7-90c7-f90f676a02af tempest-SnapshotsActionsTest-1617821023 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:55:24 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-1094a629-9bc2-49e7-90c7-f90f676a02af tempest-SnapshotsActionsTest-1617821023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:55:24 devstack sudo[100000]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e
Jul 02 19:55:24 devstack sudo[100000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:55:24 devstack sudo[100000]: pam_unix(sudo:session): session closed for user root
Jul 02 19:55:24 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-1094a629-9bc2-49e7-90c7-f90f676a02af tempest-SnapshotsActionsTest-1617821023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e" returned: 0 in 0.768s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:55:24 devstack cinder-volume[86639]: DEBUG cinder.manager [None req-1094a629-9bc2-49e7-90c7-f90f676a02af tempest-SnapshotsActionsTest-1617821023 None] Notifying Schedulers of capabilities ... {{(pid=86639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 19:55:24 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-1094a629-9bc2-49e7-90c7-f90f676a02af tempest-SnapshotsActionsTest-1617821023 None] Deleted volume successfully.
Jul 02 19:55:24 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-1094a629-9bc2-49e7-90c7-f90f676a02af tempest-SnapshotsActionsTest-1617821023 None] Lock "cinder-46d356a2-75af-4ae3-a828-0b1c37b99bae-delete_volume" released by "delete_volume" :: held 2.968s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:55:33 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [req-f229cdce-9e73-438e-96ff-2c8a7fc7209c req-332ecc8a-74d0-4d0a-8aa4-3b8cfb4eaa53 tempest-TestInstancesWithCinderVolumes-1877930177 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:55:33 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [req-f229cdce-9e73-438e-96ff-2c8a7fc7209c req-332ecc8a-74d0-4d0a-8aa4-3b8cfb4eaa53 tempest-TestInstancesWithCinderVolumes-1877930177 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:55:33 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b5fdb96-56db-4e16-a33e-dab9082faaf3]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 19:55:33 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [req-f229cdce-9e73-438e-96ff-2c8a7fc7209c req-332ecc8a-74d0-4d0a-8aa4-3b8cfb4eaa53 tempest-TestInstancesWithCinderVolumes-1877930177 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-7b98fbaa-0a48-4707-b29f-ccc6f6169273 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:55:33 devstack sudo[100130]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-7b98fbaa-0a48-4707-b29f-ccc6f6169273
Jul 02 19:55:33 devstack sudo[100130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:55:34 devstack sudo[100130]: pam_unix(sudo:session): session closed for user root
Jul 02 19:55:34 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [req-f229cdce-9e73-438e-96ff-2c8a7fc7209c req-332ecc8a-74d0-4d0a-8aa4-3b8cfb4eaa53 tempest-TestInstancesWithCinderVolumes-1877930177 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-7b98fbaa-0a48-4707-b29f-ccc6f6169273" returned: 0 in 1.152s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:55:34 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [req-f229cdce-9e73-438e-96ff-2c8a7fc7209c req-332ecc8a-74d0-4d0a-8aa4-3b8cfb4eaa53 tempest-TestInstancesWithCinderVolumes-1877930177 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.194s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:55:34 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [req-f229cdce-9e73-438e-96ff-2c8a7fc7209c req-332ecc8a-74d0-4d0a-8aa4-3b8cfb4eaa53 tempest-TestInstancesWithCinderVolumes-1877930177 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92', 'name': 'volume-7b98fbaa-0a48-4707-b29f-ccc6f6169273', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '779410f7-722a-4241-b8fb-084eb234ebca', 'enforce_multipath': True} {{(pid=86639) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 02 19:55:34 devstack cinder-volume[86639]: INFO cinder.volume.manager [req-f229cdce-9e73-438e-96ff-2c8a7fc7209c req-332ecc8a-74d0-4d0a-8aa4-3b8cfb4eaa53 tempest-TestInstancesWithCinderVolumes-1877930177 None] attachment_update completed successfully.
Jul 02 19:55:39 devstack cinder-volume[86639]: DEBUG cinder.volume.flows.manager.create_volume [None req-7bd39837-93f8-4cf5-936f-855066e6fa2c tempest-VolumeQuotasAdminTestJSON-584760915 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 19:55:39 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-7bd39837-93f8-4cf5-936f-855066e6fa2c tempest-VolumeQuotasAdminTestJSON-584760915 None] Flow 'volume_create_manager' (b6048026-eaed-4046-9be0-0e2829d8cc5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 19:55:39 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-7bd39837-93f8-4cf5-936f-855066e6fa2c tempest-VolumeQuotasAdminTestJSON-584760915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cda11012-77d3-4adb-81a7-7caa5716638f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:55:39 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-7bd39837-93f8-4cf5-936f-855066e6fa2c tempest-VolumeQuotasAdminTestJSON-584760915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cda11012-77d3-4adb-81a7-7caa5716638f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T17:55:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-995466813',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7b20975-7644-4f8e-bd30-06df455de0c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90433994127c48e39eb397d7e5b2db44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T17:55:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T17:55:39Z,use_quota=True,user_id='6103b85022cb4700bd9a0213b4b316b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:55:39 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-7bd39837-93f8-4cf5-936f-855066e6fa2c tempest-VolumeQuotasAdminTestJSON-584760915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9007d26e-cf9b-4ee6-9e2d-d09257c5e096) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:55:39 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-7bd39837-93f8-4cf5-936f-855066e6fa2c tempest-VolumeQuotasAdminTestJSON-584760915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9007d26e-cf9b-4ee6-9e2d-d09257c5e096) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:55:39 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-7bd39837-93f8-4cf5-936f-855066e6fa2c tempest-VolumeQuotasAdminTestJSON-584760915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c51918e2-6a86-495d-b9fa-c283b45822f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:55:39 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-7bd39837-93f8-4cf5-936f-855066e6fa2c tempest-VolumeQuotasAdminTestJSON-584760915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c51918e2-6a86-495d-b9fa-c283b45822f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd7b20975-7644-4f8e-bd30-06df455de0c4', 'volume_name': 'volume-d7b20975-7644-4f8e-bd30-06df455de0c4', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:55:39 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-7bd39837-93f8-4cf5-936f-855066e6fa2c tempest-VolumeQuotasAdminTestJSON-584760915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f4b274a-2e25-4501-bcea-c049650659ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:55:39 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-7bd39837-93f8-4cf5-936f-855066e6fa2c tempest-VolumeQuotasAdminTestJSON-584760915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f4b274a-2e25-4501-bcea-c049650659ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:55:39 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-7bd39837-93f8-4cf5-936f-855066e6fa2c tempest-VolumeQuotasAdminTestJSON-584760915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0923f066-997c-476d-905a-d41eb4f92d22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:55:39 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-7bd39837-93f8-4cf5-936f-855066e6fa2c tempest-VolumeQuotasAdminTestJSON-584760915 None] Volume d7b20975-7644-4f8e-bd30-06df455de0c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d7b20975-7644-4f8e-bd30-06df455de0c4', 'volume_size': 1}
Jul 02 19:55:39 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-7bd39837-93f8-4cf5-936f-855066e6fa2c tempest-VolumeQuotasAdminTestJSON-584760915 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:55:39 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-7bd39837-93f8-4cf5-936f-855066e6fa2c tempest-VolumeQuotasAdminTestJSON-584760915 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:55:39 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-7bd39837-93f8-4cf5-936f-855066e6fa2c tempest-VolumeQuotasAdminTestJSON-584760915 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce906cb830>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T17:55:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-995466813',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7b20975-7644-4f8e-bd30-06df455de0c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90433994127c48e39eb397d7e5b2db44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T17:55:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T17:55:39Z,use_quota=True,user_id='6103b85022cb4700bd9a0213b4b316b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)}" {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 19:55:39 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-7bd39837-93f8-4cf5-936f-855066e6fa2c tempest-VolumeQuotasAdminTestJSON-584760915 None] Creating volume d7b20975-7644-4f8e-bd30-06df455de0c4 {{(pid=86639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 19:55:39 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-7bd39837-93f8-4cf5-936f-855066e6fa2c tempest-VolumeQuotasAdminTestJSON-584760915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:55:39 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-7bd39837-93f8-4cf5-936f-855066e6fa2c tempest-VolumeQuotasAdminTestJSON-584760915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:55:39 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-7bd39837-93f8-4cf5-936f-855066e6fa2c tempest-VolumeQuotasAdminTestJSON-584760915 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 19:55:39 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-7bd39837-93f8-4cf5-936f-855066e6fa2c tempest-VolumeQuotasAdminTestJSON-584760915 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 19:55:39 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-7bd39837-93f8-4cf5-936f-855066e6fa2c tempest-VolumeQuotasAdminTestJSON-584760915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:55:39 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-7bd39837-93f8-4cf5-936f-855066e6fa2c tempest-VolumeQuotasAdminTestJSON-584760915 None] Selected osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92 as target Quobyte volume. {{(pid=86639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 19:55:39 devstack cinder-volume[86639]: INFO cinder.volume.drivers.remotefs [None req-7bd39837-93f8-4cf5-936f-855066e6fa2c tempest-VolumeQuotasAdminTestJSON-584760915 None] casted to osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92
Jul 02 19:55:39 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-7bd39837-93f8-4cf5-936f-855066e6fa2c tempest-VolumeQuotasAdminTestJSON-584760915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-d7b20975-7644-4f8e-bd30-06df455de0c4 1073741824 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:55:39 devstack sudo[100178]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-d7b20975-7644-4f8e-bd30-06df455de0c4 1073741824
Jul 02 19:55:39 devstack sudo[100178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:55:39 devstack sudo[100178]: pam_unix(sudo:session): session closed for user root
Jul 02 19:55:39 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-7bd39837-93f8-4cf5-936f-855066e6fa2c tempest-VolumeQuotasAdminTestJSON-584760915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-d7b20975-7644-4f8e-bd30-06df455de0c4 1073741824" returned: 0 in 0.870s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:55:40 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-7bd39837-93f8-4cf5-936f-855066e6fa2c tempest-VolumeQuotasAdminTestJSON-584760915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-d7b20975-7644-4f8e-bd30-06df455de0c4 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:55:40 devstack sudo[100193]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-d7b20975-7644-4f8e-bd30-06df455de0c4
Jul 02 19:55:40 devstack sudo[100193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:55:40 devstack sudo[100193]: pam_unix(sudo:session): session closed for user root
Jul 02 19:55:40 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-7bd39837-93f8-4cf5-936f-855066e6fa2c tempest-VolumeQuotasAdminTestJSON-584760915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-d7b20975-7644-4f8e-bd30-06df455de0c4" returned: 0 in 0.646s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:55:40 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-7bd39837-93f8-4cf5-936f-855066e6fa2c tempest-VolumeQuotasAdminTestJSON-584760915 None] <== create_volume: return (1558ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'} {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 19:55:40 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-7bd39837-93f8-4cf5-936f-855066e6fa2c tempest-VolumeQuotasAdminTestJSON-584760915 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.560s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:55:40 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-7bd39837-93f8-4cf5-936f-855066e6fa2c tempest-VolumeQuotasAdminTestJSON-584760915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0923f066-997c-476d-905a-d41eb4f92d22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d7b20975-7644-4f8e-bd30-06df455de0c4', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:55:40 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-7bd39837-93f8-4cf5-936f-855066e6fa2c tempest-VolumeQuotasAdminTestJSON-584760915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f59dd08-bddf-493c-8a66-aaac3e95353c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:55:40 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-7bd39837-93f8-4cf5-936f-855066e6fa2c tempest-VolumeQuotasAdminTestJSON-584760915 None] Volume volume-d7b20975-7644-4f8e-bd30-06df455de0c4 (d7b20975-7644-4f8e-bd30-06df455de0c4): created successfully
Jul 02 19:55:40 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-7bd39837-93f8-4cf5-936f-855066e6fa2c tempest-VolumeQuotasAdminTestJSON-584760915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f59dd08-bddf-493c-8a66-aaac3e95353c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:55:40 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-7bd39837-93f8-4cf5-936f-855066e6fa2c tempest-VolumeQuotasAdminTestJSON-584760915 None] Flow 'volume_create_manager' (b6048026-eaed-4046-9be0-0e2829d8cc5c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 19:55:40 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-7bd39837-93f8-4cf5-936f-855066e6fa2c tempest-VolumeQuotasAdminTestJSON-584760915 None] Created volume successfully.
Jul 02 19:55:41 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-5e5d5740-ea84-4267-b964-3db8b2086a81 tempest-VolumeQuotasAdminTestJSON-584760915 None] Acquiring lock "cinder-d7b20975-7644-4f8e-bd30-06df455de0c4-delete_volume" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:55:41 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-5e5d5740-ea84-4267-b964-3db8b2086a81 tempest-VolumeQuotasAdminTestJSON-584760915 None] Lock "cinder-d7b20975-7644-4f8e-bd30-06df455de0c4-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:55:41 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-5e5d5740-ea84-4267-b964-3db8b2086a81 tempest-VolumeQuotasAdminTestJSON-584760915 None] Acquiring lock "cinder-quobyte-d7b20975-7644-4f8e-bd30-06df455de0c4" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:55:41 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-5e5d5740-ea84-4267-b964-3db8b2086a81 tempest-VolumeQuotasAdminTestJSON-584760915 None] Lock "cinder-quobyte-d7b20975-7644-4f8e-bd30-06df455de0c4" acquired by "delete_volume" :: waited 0.013s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:55:41 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[236f3377-68d5-4a2e-832e-b291e148342d]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 19:55:41 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-5e5d5740-ea84-4267-b964-3db8b2086a81 tempest-VolumeQuotasAdminTestJSON-584760915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-d7b20975-7644-4f8e-bd30-06df455de0c4 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:55:41 devstack sudo[100196]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-d7b20975-7644-4f8e-bd30-06df455de0c4
Jul 02 19:55:41 devstack sudo[100196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:55:41 devstack cinder-volume[86639]: DEBUG oslo_service.periodic_task [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86639) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 02 19:55:41 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:55:41 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:55:41 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 19:55:41 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 19:55:41 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:55:41 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:55:41 devstack sudo[100198]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e
Jul 02 19:55:41 devstack sudo[100198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:55:42 devstack sudo[100196]: pam_unix(sudo:session): session closed for user root
Jul 02 19:55:42 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-5e5d5740-ea84-4267-b964-3db8b2086a81 tempest-VolumeQuotasAdminTestJSON-584760915 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-d7b20975-7644-4f8e-bd30-06df455de0c4" returned: 0 in 0.837s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:55:42 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-5e5d5740-ea84-4267-b964-3db8b2086a81 tempest-VolumeQuotasAdminTestJSON-584760915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-d7b20975-7644-4f8e-bd30-06df455de0c4 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:55:42 devstack sudo[100203]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-d7b20975-7644-4f8e-bd30-06df455de0c4
Jul 02 19:55:42 devstack sudo[100203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:55:42 devstack sudo[100198]: pam_unix(sudo:session): session closed for user root
Jul 02 19:55:42 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e" returned: 0 in 0.751s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:55:42 devstack cinder-volume[86639]: DEBUG cinder.manager [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] Notifying Schedulers of capabilities ... {{(pid=86639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 19:55:42 devstack cinder-volume[86639]: DEBUG oslo_service.periodic_task [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] Running periodic task VolumeManager._thread_info {{(pid=86639) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 02 19:55:42 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] thread count: 28 {{(pid=86639) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 02 19:55:42 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] thread info: [<_MainThread(MainThread, started 140525261275264)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 140525150678016)>, <Thread(Thread-3 (stat_writer), started daemon 140525150025920)>, <Thread(Rabbit-heartbeat, started daemon 140525150500864)>, <Thread(Thread-5 (_runner), started daemon 140525149847296)>, <Thread(Thread-7 (_runner), started daemon 140525149863424)>, <Thread(fd_logger, started daemon 140525146589376)>, <Thread(privsep_reader, started daemon 140525144562432)>, <Thread(tpool_thread_0, started daemon 140525137151680)>, <Thread(tpool_thread_1, started daemon 140525128758976)>, <Thread(tpool_thread_2, started daemon 140525120349888)>, <Thread(tpool_thread_3, started daemon 140525111940800)>, <Thread(tpool_thread_4, started daemon 140525103531712)>, <Thread(tpool_thread_5, started daemon 140525095122624)>, <Thread(tpool_thread_6, started daemon 140525086713536)>, <Thread(tpool_thread_7, started daemon 140525078304448)>, <Thread(tpool_thread_8, started daemon 140525069895360)>, <Thread(tpool_thread_9, started daemon 140525061486272)>, <Thread(tpool_thread_10, started daemon 140525053077184)>, <Thread(tpool_thread_11, started daemon 140525044668096)>, <Thread(tpool_thread_12, started daemon 140525036259008)>, <Thread(tpool_thread_13, started daemon 140525027849920)>, <Thread(tpool_thread_14, started daemon 140525019440832)>, <Thread(tpool_thread_15, started daemon 140525011031744)>, <Thread(tpool_thread_16, started daemon 140525002622656)>, <Thread(tpool_thread_17, started daemon 140524994213568)>, <Thread(tpool_thread_18, started daemon 140524985804480)>, <Thread(tpool_thread_19, started daemon 140524977395392)>] {{(pid=86639) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 02 19:55:42 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [req-c1e97736-5370-496b-ba27-eee4de1b65e5 req-9e3c8871-67ef-44a1-b847-772f708e5242 tempest-TestInstancesWithCinderVolumes-1877930177 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:55:42 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [req-c1e97736-5370-496b-ba27-eee4de1b65e5 req-9e3c8871-67ef-44a1-b847-772f708e5242 tempest-TestInstancesWithCinderVolumes-1877930177 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:55:42 devstack sudo[100203]: pam_unix(sudo:session): session closed for user root
Jul 02 19:55:42 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-5e5d5740-ea84-4267-b964-3db8b2086a81 tempest-VolumeQuotasAdminTestJSON-584760915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-d7b20975-7644-4f8e-bd30-06df455de0c4" returned: 0 in 0.739s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:55:42 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[b469fa2d-1cb4-441c-806b-1f99e801490a]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 19:55:42 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [req-c1e97736-5370-496b-ba27-eee4de1b65e5 req-9e3c8871-67ef-44a1-b847-772f708e5242 tempest-TestInstancesWithCinderVolumes-1877930177 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-ff18f3bf-1e66-42c5-bccc-3e2b41e1dcf0 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:55:42 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-5e5d5740-ea84-4267-b964-3db8b2086a81 tempest-VolumeQuotasAdminTestJSON-584760915 None] Lock "cinder-quobyte-d7b20975-7644-4f8e-bd30-06df455de0c4" released by "delete_volume" :: held 1.636s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:55:42 devstack cinder-volume[86639]: DEBUG cinder.quota [None req-5e5d5740-ea84-4267-b964-3db8b2086a81 tempest-VolumeQuotasAdminTestJSON-584760915 None] Created reservations ['3acebe35-57c4-44f9-9d66-b3e9b48ec93e', '666d7f4c-43cc-4ccb-ab30-f07f9ac3f478', '46f65dcd-3566-45e4-8357-9cf9b5ffc034', '89831048-1469-4655-8361-a7b42e53088a'] {{(pid=86639) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 19:55:42 devstack sudo[100215]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-ff18f3bf-1e66-42c5-bccc-3e2b41e1dcf0
Jul 02 19:55:42 devstack sudo[100215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:55:43 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-5e5d5740-ea84-4267-b964-3db8b2086a81 tempest-VolumeQuotasAdminTestJSON-584760915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:55:43 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-5e5d5740-ea84-4267-b964-3db8b2086a81 tempest-VolumeQuotasAdminTestJSON-584760915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:55:43 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-5e5d5740-ea84-4267-b964-3db8b2086a81 tempest-VolumeQuotasAdminTestJSON-584760915 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 19:55:43 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-5e5d5740-ea84-4267-b964-3db8b2086a81 tempest-VolumeQuotasAdminTestJSON-584760915 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 19:55:43 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-5e5d5740-ea84-4267-b964-3db8b2086a81 tempest-VolumeQuotasAdminTestJSON-584760915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:55:43 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-5e5d5740-ea84-4267-b964-3db8b2086a81 tempest-VolumeQuotasAdminTestJSON-584760915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:55:43 devstack sudo[100217]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e
Jul 02 19:55:43 devstack sudo[100217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:55:43 devstack sudo[100217]: pam_unix(sudo:session): session closed for user root
Jul 02 19:55:43 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-5e5d5740-ea84-4267-b964-3db8b2086a81 tempest-VolumeQuotasAdminTestJSON-584760915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e" returned: 0 in 0.730s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:55:43 devstack cinder-volume[86639]: DEBUG cinder.manager [None req-5e5d5740-ea84-4267-b964-3db8b2086a81 tempest-VolumeQuotasAdminTestJSON-584760915 None] Notifying Schedulers of capabilities ... {{(pid=86639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 19:55:43 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-5e5d5740-ea84-4267-b964-3db8b2086a81 tempest-VolumeQuotasAdminTestJSON-584760915 None] Deleted volume successfully.
Jul 02 19:55:43 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-5e5d5740-ea84-4267-b964-3db8b2086a81 tempest-VolumeQuotasAdminTestJSON-584760915 None] Lock "cinder-d7b20975-7644-4f8e-bd30-06df455de0c4-delete_volume" released by "delete_volume" :: held 2.613s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:55:43 devstack sudo[100215]: pam_unix(sudo:session): session closed for user root
Jul 02 19:55:43 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [req-c1e97736-5370-496b-ba27-eee4de1b65e5 req-9e3c8871-67ef-44a1-b847-772f708e5242 tempest-TestInstancesWithCinderVolumes-1877930177 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-ff18f3bf-1e66-42c5-bccc-3e2b41e1dcf0" returned: 0 in 0.959s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:55:43 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [req-c1e97736-5370-496b-ba27-eee4de1b65e5 req-9e3c8871-67ef-44a1-b847-772f708e5242 tempest-TestInstancesWithCinderVolumes-1877930177 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.989s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:55:43 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [req-c1e97736-5370-496b-ba27-eee4de1b65e5 req-9e3c8871-67ef-44a1-b847-772f708e5242 tempest-TestInstancesWithCinderVolumes-1877930177 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92', 'name': 'volume-ff18f3bf-1e66-42c5-bccc-3e2b41e1dcf0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b000c183-b753-4ba6-9355-0909f6956572', 'enforce_multipath': True} {{(pid=86639) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 02 19:55:43 devstack cinder-volume[86639]: INFO cinder.volume.manager [req-c1e97736-5370-496b-ba27-eee4de1b65e5 req-9e3c8871-67ef-44a1-b847-772f708e5242 tempest-TestInstancesWithCinderVolumes-1877930177 None] attachment_update completed successfully.
Jul 02 19:55:44 devstack cinder-volume[86639]: DEBUG cinder.volume.flows.manager.create_volume [None req-2493022b-5abf-43a4-8df1-23667d2fc355 tempest-VolumeQuotasAdminTestJSON-584760915 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 19:55:44 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-2493022b-5abf-43a4-8df1-23667d2fc355 tempest-VolumeQuotasAdminTestJSON-584760915 None] Flow 'volume_create_manager' (10cc6b91-d92b-4f0e-b1c8-1b06238435f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 19:55:44 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-2493022b-5abf-43a4-8df1-23667d2fc355 tempest-VolumeQuotasAdminTestJSON-584760915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b97a3bf-c1e6-413a-a372-f4f291f2d3c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:55:44 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-2493022b-5abf-43a4-8df1-23667d2fc355 tempest-VolumeQuotasAdminTestJSON-584760915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b97a3bf-c1e6-413a-a372-f4f291f2d3c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T17:55:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1567838511',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1763855-4043-4518-8cda-29a277fd4de9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90433994127c48e39eb397d7e5b2db44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T17:55:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T17:55:44Z,use_quota=True,user_id='6103b85022cb4700bd9a0213b4b316b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:55:44 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-2493022b-5abf-43a4-8df1-23667d2fc355 tempest-VolumeQuotasAdminTestJSON-584760915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ea0e7e5-d499-4bd3-8b41-889af496e21c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:55:44 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-2493022b-5abf-43a4-8df1-23667d2fc355 tempest-VolumeQuotasAdminTestJSON-584760915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ea0e7e5-d499-4bd3-8b41-889af496e21c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:55:44 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-2493022b-5abf-43a4-8df1-23667d2fc355 tempest-VolumeQuotasAdminTestJSON-584760915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3350846d-3f73-43f8-a07e-3f773b44fb2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:55:44 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-2493022b-5abf-43a4-8df1-23667d2fc355 tempest-VolumeQuotasAdminTestJSON-584760915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3350846d-3f73-43f8-a07e-3f773b44fb2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e1763855-4043-4518-8cda-29a277fd4de9', 'volume_name': 'volume-e1763855-4043-4518-8cda-29a277fd4de9', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:55:44 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-2493022b-5abf-43a4-8df1-23667d2fc355 tempest-VolumeQuotasAdminTestJSON-584760915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fd1f67b-297f-41d1-9b95-c85fa554d43b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:55:44 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-2493022b-5abf-43a4-8df1-23667d2fc355 tempest-VolumeQuotasAdminTestJSON-584760915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fd1f67b-297f-41d1-9b95-c85fa554d43b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:55:44 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-2493022b-5abf-43a4-8df1-23667d2fc355 tempest-VolumeQuotasAdminTestJSON-584760915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (852977bf-0fcc-404f-bcf7-54b23ac9ba2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:55:44 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-2493022b-5abf-43a4-8df1-23667d2fc355 tempest-VolumeQuotasAdminTestJSON-584760915 None] Volume e1763855-4043-4518-8cda-29a277fd4de9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e1763855-4043-4518-8cda-29a277fd4de9', 'volume_size': 1}
Jul 02 19:55:44 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-2493022b-5abf-43a4-8df1-23667d2fc355 tempest-VolumeQuotasAdminTestJSON-584760915 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:55:44 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-2493022b-5abf-43a4-8df1-23667d2fc355 tempest-VolumeQuotasAdminTestJSON-584760915 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:55:44 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-2493022b-5abf-43a4-8df1-23667d2fc355 tempest-VolumeQuotasAdminTestJSON-584760915 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce906cb830>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T17:55:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1567838511',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1763855-4043-4518-8cda-29a277fd4de9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90433994127c48e39eb397d7e5b2db44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T17:55:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T17:55:44Z,use_quota=True,user_id='6103b85022cb4700bd9a0213b4b316b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)}" {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 19:55:44 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-2493022b-5abf-43a4-8df1-23667d2fc355 tempest-VolumeQuotasAdminTestJSON-584760915 None] Creating volume e1763855-4043-4518-8cda-29a277fd4de9 {{(pid=86639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 19:55:44 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-2493022b-5abf-43a4-8df1-23667d2fc355 tempest-VolumeQuotasAdminTestJSON-584760915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:55:44 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-2493022b-5abf-43a4-8df1-23667d2fc355 tempest-VolumeQuotasAdminTestJSON-584760915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:55:44 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-2493022b-5abf-43a4-8df1-23667d2fc355 tempest-VolumeQuotasAdminTestJSON-584760915 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 19:55:44 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-2493022b-5abf-43a4-8df1-23667d2fc355 tempest-VolumeQuotasAdminTestJSON-584760915 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 19:55:44 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-2493022b-5abf-43a4-8df1-23667d2fc355 tempest-VolumeQuotasAdminTestJSON-584760915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:55:44 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-2493022b-5abf-43a4-8df1-23667d2fc355 tempest-VolumeQuotasAdminTestJSON-584760915 None] Selected osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92 as target Quobyte volume. {{(pid=86639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 19:55:44 devstack cinder-volume[86639]: INFO cinder.volume.drivers.remotefs [None req-2493022b-5abf-43a4-8df1-23667d2fc355 tempest-VolumeQuotasAdminTestJSON-584760915 None] casted to osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92
Jul 02 19:55:44 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-2493022b-5abf-43a4-8df1-23667d2fc355 tempest-VolumeQuotasAdminTestJSON-584760915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-e1763855-4043-4518-8cda-29a277fd4de9 1073741824 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:55:44 devstack sudo[100227]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-e1763855-4043-4518-8cda-29a277fd4de9 1073741824
Jul 02 19:55:44 devstack sudo[100227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:55:45 devstack sudo[100227]: pam_unix(sudo:session): session closed for user root
Jul 02 19:55:45 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-2493022b-5abf-43a4-8df1-23667d2fc355 tempest-VolumeQuotasAdminTestJSON-584760915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-e1763855-4043-4518-8cda-29a277fd4de9 1073741824" returned: 0 in 1.040s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:55:45 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-2493022b-5abf-43a4-8df1-23667d2fc355 tempest-VolumeQuotasAdminTestJSON-584760915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-e1763855-4043-4518-8cda-29a277fd4de9 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:55:45 devstack sudo[100236]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-e1763855-4043-4518-8cda-29a277fd4de9
Jul 02 19:55:45 devstack sudo[100236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:55:46 devstack sudo[100236]: pam_unix(sudo:session): session closed for user root
Jul 02 19:55:46 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-2493022b-5abf-43a4-8df1-23667d2fc355 tempest-VolumeQuotasAdminTestJSON-584760915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-e1763855-4043-4518-8cda-29a277fd4de9" returned: 0 in 0.713s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:55:46 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-2493022b-5abf-43a4-8df1-23667d2fc355 tempest-VolumeQuotasAdminTestJSON-584760915 None] <== create_volume: return (1811ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'} {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 19:55:46 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-2493022b-5abf-43a4-8df1-23667d2fc355 tempest-VolumeQuotasAdminTestJSON-584760915 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.814s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:55:46 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-2493022b-5abf-43a4-8df1-23667d2fc355 tempest-VolumeQuotasAdminTestJSON-584760915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (852977bf-0fcc-404f-bcf7-54b23ac9ba2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1763855-4043-4518-8cda-29a277fd4de9', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:55:46 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-2493022b-5abf-43a4-8df1-23667d2fc355 tempest-VolumeQuotasAdminTestJSON-584760915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71ae6049-d0aa-4eab-8d5d-8dd9a1d929d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:55:46 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-2493022b-5abf-43a4-8df1-23667d2fc355 tempest-VolumeQuotasAdminTestJSON-584760915 None] Volume volume-e1763855-4043-4518-8cda-29a277fd4de9 (e1763855-4043-4518-8cda-29a277fd4de9): created successfully
Jul 02 19:55:46 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-2493022b-5abf-43a4-8df1-23667d2fc355 tempest-VolumeQuotasAdminTestJSON-584760915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71ae6049-d0aa-4eab-8d5d-8dd9a1d929d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:55:46 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-2493022b-5abf-43a4-8df1-23667d2fc355 tempest-VolumeQuotasAdminTestJSON-584760915 None] Flow 'volume_create_manager' (10cc6b91-d92b-4f0e-b1c8-1b06238435f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 19:55:46 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-2493022b-5abf-43a4-8df1-23667d2fc355 tempest-VolumeQuotasAdminTestJSON-584760915 None] Created volume successfully.
Jul 02 19:55:47 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-8be470e1-1685-4fae-8b15-722483e0b37f tempest-VolumeQuotasAdminTestJSON-374534589 None] Transfer volume completed successfully.
Jul 02 19:55:48 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-e3251ebf-88d4-4f28-9518-7b7b54fcdc05 tempest-VolumeQuotasAdminTestJSON-1228206893 None] Acquiring lock "cinder-e1763855-4043-4518-8cda-29a277fd4de9-delete_volume" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:55:48 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-e3251ebf-88d4-4f28-9518-7b7b54fcdc05 tempest-VolumeQuotasAdminTestJSON-1228206893 None] Lock "cinder-e1763855-4043-4518-8cda-29a277fd4de9-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:55:48 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-e3251ebf-88d4-4f28-9518-7b7b54fcdc05 tempest-VolumeQuotasAdminTestJSON-1228206893 None] Acquiring lock "cinder-quobyte-e1763855-4043-4518-8cda-29a277fd4de9" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:55:48 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-e3251ebf-88d4-4f28-9518-7b7b54fcdc05 tempest-VolumeQuotasAdminTestJSON-1228206893 None] Lock "cinder-quobyte-e1763855-4043-4518-8cda-29a277fd4de9" acquired by "delete_volume" :: waited 0.018s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:55:48 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-043bceb0-02f0-4f6f-9b12-67985df494bb tempest-VolumesNegativeTest-64812371 None] Acquiring lock "cinder-ea6ab7ae-e8ed-453f-96c1-61d1a71542bc-delete_volume" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:55:48 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-043bceb0-02f0-4f6f-9b12-67985df494bb tempest-VolumesNegativeTest-64812371 None] Lock "cinder-ea6ab7ae-e8ed-453f-96c1-61d1a71542bc-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:55:48 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[15908328-25d8-435e-a0bf-c38f31d8f3d1]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 19:55:48 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-e3251ebf-88d4-4f28-9518-7b7b54fcdc05 tempest-VolumeQuotasAdminTestJSON-1228206893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-e1763855-4043-4518-8cda-29a277fd4de9 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:55:48 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-043bceb0-02f0-4f6f-9b12-67985df494bb tempest-VolumesNegativeTest-64812371 None] Acquiring lock "cinder-quobyte-ea6ab7ae-e8ed-453f-96c1-61d1a71542bc" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:55:48 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-043bceb0-02f0-4f6f-9b12-67985df494bb tempest-VolumesNegativeTest-64812371 None] Lock "cinder-quobyte-ea6ab7ae-e8ed-453f-96c1-61d1a71542bc" acquired by "delete_volume" :: waited 0.018s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:55:48 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[4382d652-28ea-4a7a-b686-3c66c0bcf957]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 19:55:48 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-043bceb0-02f0-4f6f-9b12-67985df494bb tempest-VolumesNegativeTest-64812371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-ea6ab7ae-e8ed-453f-96c1-61d1a71542bc {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:55:48 devstack sudo[100247]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-e1763855-4043-4518-8cda-29a277fd4de9
Jul 02 19:55:48 devstack sudo[100247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:55:48 devstack sudo[100248]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-ea6ab7ae-e8ed-453f-96c1-61d1a71542bc
Jul 02 19:55:48 devstack sudo[100248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:55:49 devstack sudo[100247]: pam_unix(sudo:session): session closed for user root
Jul 02 19:55:49 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-e3251ebf-88d4-4f28-9518-7b7b54fcdc05 tempest-VolumeQuotasAdminTestJSON-1228206893 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-e1763855-4043-4518-8cda-29a277fd4de9" returned: 0 in 0.839s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:55:49 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-e3251ebf-88d4-4f28-9518-7b7b54fcdc05 tempest-VolumeQuotasAdminTestJSON-1228206893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-e1763855-4043-4518-8cda-29a277fd4de9 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:55:49 devstack sudo[100257]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-e1763855-4043-4518-8cda-29a277fd4de9
Jul 02 19:55:49 devstack sudo[100257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:55:49 devstack sudo[100248]: pam_unix(sudo:session): session closed for user root
Jul 02 19:55:49 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-043bceb0-02f0-4f6f-9b12-67985df494bb tempest-VolumesNegativeTest-64812371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-ea6ab7ae-e8ed-453f-96c1-61d1a71542bc" returned: 0 in 0.822s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:55:49 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-043bceb0-02f0-4f6f-9b12-67985df494bb tempest-VolumesNegativeTest-64812371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-ea6ab7ae-e8ed-453f-96c1-61d1a71542bc {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:55:49 devstack sudo[100259]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-ea6ab7ae-e8ed-453f-96c1-61d1a71542bc
Jul 02 19:55:49 devstack sudo[100259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:55:50 devstack sudo[100257]: pam_unix(sudo:session): session closed for user root
Jul 02 19:55:50 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-e3251ebf-88d4-4f28-9518-7b7b54fcdc05 tempest-VolumeQuotasAdminTestJSON-1228206893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-e1763855-4043-4518-8cda-29a277fd4de9" returned: 0 in 0.715s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:55:50 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-e3251ebf-88d4-4f28-9518-7b7b54fcdc05 tempest-VolumeQuotasAdminTestJSON-1228206893 None] Lock "cinder-quobyte-e1763855-4043-4518-8cda-29a277fd4de9" released by "delete_volume" :: held 1.618s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:55:50 devstack cinder-volume[86639]: DEBUG cinder.quota [None req-e3251ebf-88d4-4f28-9518-7b7b54fcdc05 tempest-VolumeQuotasAdminTestJSON-1228206893 None] Created reservations ['7b6c5f06-3b9b-4f80-89c0-dca51e7d3c6e', 'a4e43c3d-26d3-4050-a004-8d0e9105be6c', 'a543f59c-188f-45b0-bfc6-353c395fe14d', 'a920aad4-305f-43a1-908c-4a0d01bb4c96'] {{(pid=86639) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 19:55:50 devstack sudo[100259]: pam_unix(sudo:session): session closed for user root
Jul 02 19:55:50 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-043bceb0-02f0-4f6f-9b12-67985df494bb tempest-VolumesNegativeTest-64812371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-ea6ab7ae-e8ed-453f-96c1-61d1a71542bc" returned: 0 in 0.770s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:55:50 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-043bceb0-02f0-4f6f-9b12-67985df494bb tempest-VolumesNegativeTest-64812371 None] Lock "cinder-quobyte-ea6ab7ae-e8ed-453f-96c1-61d1a71542bc" released by "delete_volume" :: held 1.634s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:55:50 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-e3251ebf-88d4-4f28-9518-7b7b54fcdc05 tempest-VolumeQuotasAdminTestJSON-1228206893 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:55:50 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-e3251ebf-88d4-4f28-9518-7b7b54fcdc05 tempest-VolumeQuotasAdminTestJSON-1228206893 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:55:50 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-e3251ebf-88d4-4f28-9518-7b7b54fcdc05 tempest-VolumeQuotasAdminTestJSON-1228206893 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 19:55:50 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-e3251ebf-88d4-4f28-9518-7b7b54fcdc05 tempest-VolumeQuotasAdminTestJSON-1228206893 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 19:55:50 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-e3251ebf-88d4-4f28-9518-7b7b54fcdc05 tempest-VolumeQuotasAdminTestJSON-1228206893 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:55:50 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-e3251ebf-88d4-4f28-9518-7b7b54fcdc05 tempest-VolumeQuotasAdminTestJSON-1228206893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:55:50 devstack sudo[100265]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e
Jul 02 19:55:50 devstack sudo[100265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:55:50 devstack cinder-volume[86639]: DEBUG cinder.quota [None req-043bceb0-02f0-4f6f-9b12-67985df494bb tempest-VolumesNegativeTest-64812371 None] Created reservations ['62273db2-3e42-4649-ab59-ae0d019a2a5f', '0badfba1-5f59-41f8-bf8a-aa1a0e3be61c', '96697a03-fe9c-454a-a9d1-24872049e64c', '928c2b2c-dd88-49a8-ad2a-30464b8ed0ce'] {{(pid=86639) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 19:55:50 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-043bceb0-02f0-4f6f-9b12-67985df494bb tempest-VolumesNegativeTest-64812371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:55:50 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-043bceb0-02f0-4f6f-9b12-67985df494bb tempest-VolumesNegativeTest-64812371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:55:50 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-043bceb0-02f0-4f6f-9b12-67985df494bb tempest-VolumesNegativeTest-64812371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 19:55:50 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-043bceb0-02f0-4f6f-9b12-67985df494bb tempest-VolumesNegativeTest-64812371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 19:55:50 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-043bceb0-02f0-4f6f-9b12-67985df494bb tempest-VolumesNegativeTest-64812371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:55:50 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-043bceb0-02f0-4f6f-9b12-67985df494bb tempest-VolumesNegativeTest-64812371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:55:50 devstack sudo[100269]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e
Jul 02 19:55:50 devstack sudo[100269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:55:50 devstack sudo[100265]: pam_unix(sudo:session): session closed for user root
Jul 02 19:55:50 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-e3251ebf-88d4-4f28-9518-7b7b54fcdc05 tempest-VolumeQuotasAdminTestJSON-1228206893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e" returned: 0 in 0.790s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:55:50 devstack cinder-volume[86639]: DEBUG cinder.manager [None req-e3251ebf-88d4-4f28-9518-7b7b54fcdc05 tempest-VolumeQuotasAdminTestJSON-1228206893 None] Notifying Schedulers of capabilities ... {{(pid=86639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 19:55:50 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-e3251ebf-88d4-4f28-9518-7b7b54fcdc05 tempest-VolumeQuotasAdminTestJSON-1228206893 None] Deleted volume successfully.
Jul 02 19:55:51 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-e3251ebf-88d4-4f28-9518-7b7b54fcdc05 tempest-VolumeQuotasAdminTestJSON-1228206893 None] Lock "cinder-e1763855-4043-4518-8cda-29a277fd4de9-delete_volume" released by "delete_volume" :: held 2.694s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:55:51 devstack sudo[100269]: pam_unix(sudo:session): session closed for user root
Jul 02 19:55:51 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-043bceb0-02f0-4f6f-9b12-67985df494bb tempest-VolumesNegativeTest-64812371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e" returned: 0 in 0.888s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:55:51 devstack cinder-volume[86639]: DEBUG cinder.manager [None req-043bceb0-02f0-4f6f-9b12-67985df494bb tempest-VolumesNegativeTest-64812371 None] Notifying Schedulers of capabilities ... {{(pid=86639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 19:55:51 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-043bceb0-02f0-4f6f-9b12-67985df494bb tempest-VolumesNegativeTest-64812371 None] Deleted volume successfully.
Jul 02 19:55:51 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-043bceb0-02f0-4f6f-9b12-67985df494bb tempest-VolumesNegativeTest-64812371 None] Lock "cinder-ea6ab7ae-e8ed-453f-96c1-61d1a71542bc-delete_volume" released by "delete_volume" :: held 2.805s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:55:53 devstack cinder-volume[86639]: INFO cinder.volume.manager [req-b617c267-2d4a-4fee-b429-f2d78b99ae16 req-14df3885-11ae-43b3-9976-90ca32f135a6 tempest-TestInstancesWithCinderVolumes-1877930177 None] Terminate volume connection completed successfully.
Jul 02 19:55:53 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [req-b617c267-2d4a-4fee-b429-f2d78b99ae16 req-14df3885-11ae-43b3-9976-90ca32f135a6 tempest-TestInstancesWithCinderVolumes-1877930177 None] Deleting attachment 779410f7-722a-4241-b8fb-084eb234ebca. {{(pid=86639) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 02 19:55:55 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-fc93b3da-05cc-4854-b394-0fb7cdcd014c tempest-TestInstancesWithCinderVolumes-1877930177 None] Acquiring lock "cinder-7b98fbaa-0a48-4707-b29f-ccc6f6169273-delete_volume" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:55:55 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-fc93b3da-05cc-4854-b394-0fb7cdcd014c tempest-TestInstancesWithCinderVolumes-1877930177 None] Lock "cinder-7b98fbaa-0a48-4707-b29f-ccc6f6169273-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:55:55 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-fc93b3da-05cc-4854-b394-0fb7cdcd014c tempest-TestInstancesWithCinderVolumes-1877930177 None] Acquiring lock "cinder-quobyte-7b98fbaa-0a48-4707-b29f-ccc6f6169273" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:55:55 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-fc93b3da-05cc-4854-b394-0fb7cdcd014c tempest-TestInstancesWithCinderVolumes-1877930177 None] Lock "cinder-quobyte-7b98fbaa-0a48-4707-b29f-ccc6f6169273" acquired by "delete_volume" :: waited 0.028s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:55:55 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0298c06-52c3-4cab-b7b7-4ec16c6e90f7]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 19:55:55 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-fc93b3da-05cc-4854-b394-0fb7cdcd014c tempest-TestInstancesWithCinderVolumes-1877930177 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-7b98fbaa-0a48-4707-b29f-ccc6f6169273 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:55:55 devstack sudo[100303]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-7b98fbaa-0a48-4707-b29f-ccc6f6169273
Jul 02 19:55:55 devstack sudo[100303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:55:56 devstack sudo[100303]: pam_unix(sudo:session): session closed for user root
Jul 02 19:55:56 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-fc93b3da-05cc-4854-b394-0fb7cdcd014c tempest-TestInstancesWithCinderVolumes-1877930177 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-7b98fbaa-0a48-4707-b29f-ccc6f6169273" returned: 0 in 1.146s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:55:56 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-fc93b3da-05cc-4854-b394-0fb7cdcd014c tempest-TestInstancesWithCinderVolumes-1877930177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-7b98fbaa-0a48-4707-b29f-ccc6f6169273 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:55:56 devstack sudo[100308]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-7b98fbaa-0a48-4707-b29f-ccc6f6169273
Jul 02 19:55:56 devstack sudo[100308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:55:57 devstack sudo[100308]: pam_unix(sudo:session): session closed for user root
Jul 02 19:55:57 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-fc93b3da-05cc-4854-b394-0fb7cdcd014c tempest-TestInstancesWithCinderVolumes-1877930177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-7b98fbaa-0a48-4707-b29f-ccc6f6169273" returned: 0 in 0.837s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:55:57 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-fc93b3da-05cc-4854-b394-0fb7cdcd014c tempest-TestInstancesWithCinderVolumes-1877930177 None] Lock "cinder-quobyte-7b98fbaa-0a48-4707-b29f-ccc6f6169273" released by "delete_volume" :: held 2.062s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:55:57 devstack cinder-volume[86639]: WARNING cinder.quota [None req-fc93b3da-05cc-4854-b394-0fb7cdcd014c tempest-TestInstancesWithCinderVolumes-1877930177 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1418560101-386828801 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1418560101-386828801, it is now deprecated. Please use the default quota class for default quota.
Jul 02 19:55:57 devstack cinder-volume[86639]: WARNING cinder.quota [None req-fc93b3da-05cc-4854-b394-0fb7cdcd014c tempest-TestInstancesWithCinderVolumes-1877930177 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1418560101-386828801 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1418560101-386828801, it is now deprecated. Please use the default quota class for default quota.
Jul 02 19:55:57 devstack cinder-volume[86639]: DEBUG cinder.quota [None req-fc93b3da-05cc-4854-b394-0fb7cdcd014c tempest-TestInstancesWithCinderVolumes-1877930177 None] Created reservations ['2468e53a-fd02-410a-b26e-69f32f31cef6', 'ae095ce4-6b39-4cdf-8160-e725882b76cc', '49c5a3fd-1f81-4f53-8fc3-0bfd0631c160', 'c6c93514-35cd-41c1-a0fd-061e65695fb7'] {{(pid=86639) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 19:55:57 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-fc93b3da-05cc-4854-b394-0fb7cdcd014c tempest-TestInstancesWithCinderVolumes-1877930177 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:55:57 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-fc93b3da-05cc-4854-b394-0fb7cdcd014c tempest-TestInstancesWithCinderVolumes-1877930177 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:55:57 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-fc93b3da-05cc-4854-b394-0fb7cdcd014c tempest-TestInstancesWithCinderVolumes-1877930177 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 19:55:57 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-fc93b3da-05cc-4854-b394-0fb7cdcd014c tempest-TestInstancesWithCinderVolumes-1877930177 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 19:55:57 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-fc93b3da-05cc-4854-b394-0fb7cdcd014c tempest-TestInstancesWithCinderVolumes-1877930177 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:55:57 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-fc93b3da-05cc-4854-b394-0fb7cdcd014c tempest-TestInstancesWithCinderVolumes-1877930177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:55:57 devstack sudo[100312]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e
Jul 02 19:55:57 devstack sudo[100312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:55:58 devstack sudo[100312]: pam_unix(sudo:session): session closed for user root
Jul 02 19:55:58 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-fc93b3da-05cc-4854-b394-0fb7cdcd014c tempest-TestInstancesWithCinderVolumes-1877930177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e" returned: 0 in 0.930s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:55:58 devstack cinder-volume[86639]: DEBUG cinder.manager [None req-fc93b3da-05cc-4854-b394-0fb7cdcd014c tempest-TestInstancesWithCinderVolumes-1877930177 None] Notifying Schedulers of capabilities ... {{(pid=86639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 19:55:58 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-fc93b3da-05cc-4854-b394-0fb7cdcd014c tempest-TestInstancesWithCinderVolumes-1877930177 None] Deleted volume successfully.
Jul 02 19:55:58 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-fc93b3da-05cc-4854-b394-0fb7cdcd014c tempest-TestInstancesWithCinderVolumes-1877930177 None] Lock "cinder-7b98fbaa-0a48-4707-b29f-ccc6f6169273-delete_volume" released by "delete_volume" :: held 3.301s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:55:59 devstack cinder-volume[86639]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4bd07bb-1a1f-4b0d-81f4-fb5bbafd2e1a tempest-VolumeRetypeWithoutMigrationTest-1125923272 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 19:55:59 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-e4bd07bb-1a1f-4b0d-81f4-fb5bbafd2e1a tempest-VolumeRetypeWithoutMigrationTest-1125923272 None] Flow 'volume_create_manager' (ebc93889-8528-493d-82a6-f0b706a44b30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 19:55:59 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-e4bd07bb-1a1f-4b0d-81f4-fb5bbafd2e1a tempest-VolumeRetypeWithoutMigrationTest-1125923272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a406a1c-a39c-4303-ab90-a18e9e50130e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:55:59 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-e4bd07bb-1a1f-4b0d-81f4-fb5bbafd2e1a tempest-VolumeRetypeWithoutMigrationTest-1125923272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a406a1c-a39c-4303-ab90-a18e9e50130e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T17:55:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-967248650',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4b1bf21-ceed-49f6-a83f-fda36d370fd7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20030033a9044c70b7c9b9ad59319603',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T17:55:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T17:55:59Z,use_quota=True,user_id='30e0a45d7e8b4fdfac1ce74a7718ac5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5935a144-0b20-4c67-bd97-13c4d51440c6),volume_type_id=5935a144-0b20-4c67-bd97-13c4d51440c6)' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:55:59 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-e4bd07bb-1a1f-4b0d-81f4-fb5bbafd2e1a tempest-VolumeRetypeWithoutMigrationTest-1125923272 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7963ae55-81a5-4eb7-9602-84f7b244bc3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:55:59 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-e4bd07bb-1a1f-4b0d-81f4-fb5bbafd2e1a tempest-VolumeRetypeWithoutMigrationTest-1125923272 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7963ae55-81a5-4eb7-9602-84f7b244bc3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:55:59 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-e4bd07bb-1a1f-4b0d-81f4-fb5bbafd2e1a tempest-VolumeRetypeWithoutMigrationTest-1125923272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5640c18-7e71-43a1-8266-c542d168fb1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:55:59 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-e4bd07bb-1a1f-4b0d-81f4-fb5bbafd2e1a tempest-VolumeRetypeWithoutMigrationTest-1125923272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5640c18-7e71-43a1-8266-c542d168fb1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f4b1bf21-ceed-49f6-a83f-fda36d370fd7', 'volume_name': 'volume-f4b1bf21-ceed-49f6-a83f-fda36d370fd7', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:55:59 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-e4bd07bb-1a1f-4b0d-81f4-fb5bbafd2e1a tempest-VolumeRetypeWithoutMigrationTest-1125923272 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6d8736e-dfb7-4cf8-b714-3ae8851c7302) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:55:59 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-e4bd07bb-1a1f-4b0d-81f4-fb5bbafd2e1a tempest-VolumeRetypeWithoutMigrationTest-1125923272 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6d8736e-dfb7-4cf8-b714-3ae8851c7302) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:55:59 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-e4bd07bb-1a1f-4b0d-81f4-fb5bbafd2e1a tempest-VolumeRetypeWithoutMigrationTest-1125923272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3325b29-b117-4393-9b59-daff5630f525) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:55:59 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-e4bd07bb-1a1f-4b0d-81f4-fb5bbafd2e1a tempest-VolumeRetypeWithoutMigrationTest-1125923272 None] Volume f4b1bf21-ceed-49f6-a83f-fda36d370fd7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f4b1bf21-ceed-49f6-a83f-fda36d370fd7', 'volume_size': 1}
Jul 02 19:55:59 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-e4bd07bb-1a1f-4b0d-81f4-fb5bbafd2e1a tempest-VolumeRetypeWithoutMigrationTest-1125923272 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:55:59 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-e4bd07bb-1a1f-4b0d-81f4-fb5bbafd2e1a tempest-VolumeRetypeWithoutMigrationTest-1125923272 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:55:59 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-e4bd07bb-1a1f-4b0d-81f4-fb5bbafd2e1a tempest-VolumeRetypeWithoutMigrationTest-1125923272 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce906cb830>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T17:55:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-967248650',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4b1bf21-ceed-49f6-a83f-fda36d370fd7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20030033a9044c70b7c9b9ad59319603',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T17:55:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T17:55:59Z,use_quota=True,user_id='30e0a45d7e8b4fdfac1ce74a7718ac5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5935a144-0b20-4c67-bd97-13c4d51440c6),volume_type_id=5935a144-0b20-4c67-bd97-13c4d51440c6)}" {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 19:55:59 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-e4bd07bb-1a1f-4b0d-81f4-fb5bbafd2e1a tempest-VolumeRetypeWithoutMigrationTest-1125923272 None] Creating volume f4b1bf21-ceed-49f6-a83f-fda36d370fd7 {{(pid=86639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 19:55:59 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-e4bd07bb-1a1f-4b0d-81f4-fb5bbafd2e1a tempest-VolumeRetypeWithoutMigrationTest-1125923272 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:55:59 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-e4bd07bb-1a1f-4b0d-81f4-fb5bbafd2e1a tempest-VolumeRetypeWithoutMigrationTest-1125923272 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:55:59 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-e4bd07bb-1a1f-4b0d-81f4-fb5bbafd2e1a tempest-VolumeRetypeWithoutMigrationTest-1125923272 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 19:55:59 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-e4bd07bb-1a1f-4b0d-81f4-fb5bbafd2e1a tempest-VolumeRetypeWithoutMigrationTest-1125923272 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 19:55:59 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-e4bd07bb-1a1f-4b0d-81f4-fb5bbafd2e1a tempest-VolumeRetypeWithoutMigrationTest-1125923272 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:55:59 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-e4bd07bb-1a1f-4b0d-81f4-fb5bbafd2e1a tempest-VolumeRetypeWithoutMigrationTest-1125923272 None] Selected osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92 as target Quobyte volume. {{(pid=86639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 19:55:59 devstack cinder-volume[86639]: INFO cinder.volume.drivers.remotefs [None req-e4bd07bb-1a1f-4b0d-81f4-fb5bbafd2e1a tempest-VolumeRetypeWithoutMigrationTest-1125923272 None] casted to osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92
Jul 02 19:55:59 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-e4bd07bb-1a1f-4b0d-81f4-fb5bbafd2e1a tempest-VolumeRetypeWithoutMigrationTest-1125923272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-f4b1bf21-ceed-49f6-a83f-fda36d370fd7 1073741824 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:55:59 devstack sudo[100335]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-f4b1bf21-ceed-49f6-a83f-fda36d370fd7 1073741824
Jul 02 19:55:59 devstack sudo[100335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:56:00 devstack sudo[100335]: pam_unix(sudo:session): session closed for user root
Jul 02 19:56:00 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-e4bd07bb-1a1f-4b0d-81f4-fb5bbafd2e1a tempest-VolumeRetypeWithoutMigrationTest-1125923272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-f4b1bf21-ceed-49f6-a83f-fda36d370fd7 1073741824" returned: 0 in 1.031s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:56:00 devstack cinder-volume[86639]: INFO cinder.volume.manager [req-dff037ad-367e-4866-9b03-ec810853414a req-b4cf98b2-f40c-4e5a-9c9e-9f2347470972 tempest-TestInstancesWithCinderVolumes-1877930177 None] Terminate volume connection completed successfully.
Jul 02 19:56:00 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [req-dff037ad-367e-4866-9b03-ec810853414a req-b4cf98b2-f40c-4e5a-9c9e-9f2347470972 tempest-TestInstancesWithCinderVolumes-1877930177 None] Deleting attachment b000c183-b753-4ba6-9355-0909f6956572. {{(pid=86639) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 02 19:56:00 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-e4bd07bb-1a1f-4b0d-81f4-fb5bbafd2e1a tempest-VolumeRetypeWithoutMigrationTest-1125923272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-f4b1bf21-ceed-49f6-a83f-fda36d370fd7 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:56:00 devstack sudo[100344]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-f4b1bf21-ceed-49f6-a83f-fda36d370fd7
Jul 02 19:56:00 devstack sudo[100344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:56:01 devstack sudo[100344]: pam_unix(sudo:session): session closed for user root
Jul 02 19:56:01 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-e4bd07bb-1a1f-4b0d-81f4-fb5bbafd2e1a tempest-VolumeRetypeWithoutMigrationTest-1125923272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-f4b1bf21-ceed-49f6-a83f-fda36d370fd7" returned: 0 in 0.682s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:56:01 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-e4bd07bb-1a1f-4b0d-81f4-fb5bbafd2e1a tempest-VolumeRetypeWithoutMigrationTest-1125923272 None] <== create_volume: return (1775ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'} {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 19:56:01 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-e4bd07bb-1a1f-4b0d-81f4-fb5bbafd2e1a tempest-VolumeRetypeWithoutMigrationTest-1125923272 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.778s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:56:01 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-e4bd07bb-1a1f-4b0d-81f4-fb5bbafd2e1a tempest-VolumeRetypeWithoutMigrationTest-1125923272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3325b29-b117-4393-9b59-daff5630f525) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f4b1bf21-ceed-49f6-a83f-fda36d370fd7', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:56:01 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-e4bd07bb-1a1f-4b0d-81f4-fb5bbafd2e1a tempest-VolumeRetypeWithoutMigrationTest-1125923272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70324572-5366-49e6-a204-e14a5524d7d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:56:01 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-e4bd07bb-1a1f-4b0d-81f4-fb5bbafd2e1a tempest-VolumeRetypeWithoutMigrationTest-1125923272 None] Volume volume-f4b1bf21-ceed-49f6-a83f-fda36d370fd7 (f4b1bf21-ceed-49f6-a83f-fda36d370fd7): created successfully
Jul 02 19:56:01 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-e4bd07bb-1a1f-4b0d-81f4-fb5bbafd2e1a tempest-VolumeRetypeWithoutMigrationTest-1125923272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70324572-5366-49e6-a204-e14a5524d7d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:56:01 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-e4bd07bb-1a1f-4b0d-81f4-fb5bbafd2e1a tempest-VolumeRetypeWithoutMigrationTest-1125923272 None] Flow 'volume_create_manager' (ebc93889-8528-493d-82a6-f0b706a44b30) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 19:56:01 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-e4bd07bb-1a1f-4b0d-81f4-fb5bbafd2e1a tempest-VolumeRetypeWithoutMigrationTest-1125923272 None] Created volume successfully.
Jul 02 19:56:02 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-75ad89ac-d992-4ca5-abb2-695d902e5aed tempest-TestInstancesWithCinderVolumes-1877930177 None] Acquiring lock "cinder-ff18f3bf-1e66-42c5-bccc-3e2b41e1dcf0-delete_volume" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:56:02 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-75ad89ac-d992-4ca5-abb2-695d902e5aed tempest-TestInstancesWithCinderVolumes-1877930177 None] Lock "cinder-ff18f3bf-1e66-42c5-bccc-3e2b41e1dcf0-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:56:02 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-75ad89ac-d992-4ca5-abb2-695d902e5aed tempest-TestInstancesWithCinderVolumes-1877930177 None] Acquiring lock "cinder-quobyte-ff18f3bf-1e66-42c5-bccc-3e2b41e1dcf0" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:56:02 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-75ad89ac-d992-4ca5-abb2-695d902e5aed tempest-TestInstancesWithCinderVolumes-1877930177 None] Lock "cinder-quobyte-ff18f3bf-1e66-42c5-bccc-3e2b41e1dcf0" acquired by "delete_volume" :: waited 0.026s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:56:02 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f46f80d-f733-43f7-a20e-e17674c92577]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 19:56:02 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-75ad89ac-d992-4ca5-abb2-695d902e5aed tempest-TestInstancesWithCinderVolumes-1877930177 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-ff18f3bf-1e66-42c5-bccc-3e2b41e1dcf0 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:56:03 devstack sudo[100347]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-ff18f3bf-1e66-42c5-bccc-3e2b41e1dcf0
Jul 02 19:56:03 devstack sudo[100347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:56:03 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-524fe3d8-60c1-43d3-89cb-0e5eb749e1ad tempest-VolumeRetypeWithoutMigrationTest-1125923272 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:56:03 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-524fe3d8-60c1-43d3-89cb-0e5eb749e1ad tempest-VolumeRetypeWithoutMigrationTest-1125923272 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:56:03 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-524fe3d8-60c1-43d3-89cb-0e5eb749e1ad tempest-VolumeRetypeWithoutMigrationTest-1125923272 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 19:56:03 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-524fe3d8-60c1-43d3-89cb-0e5eb749e1ad tempest-VolumeRetypeWithoutMigrationTest-1125923272 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 19:56:03 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-524fe3d8-60c1-43d3-89cb-0e5eb749e1ad tempest-VolumeRetypeWithoutMigrationTest-1125923272 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:56:03 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-524fe3d8-60c1-43d3-89cb-0e5eb749e1ad tempest-VolumeRetypeWithoutMigrationTest-1125923272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:56:03 devstack sudo[100349]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e
Jul 02 19:56:03 devstack sudo[100349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:56:03 devstack sudo[100347]: pam_unix(sudo:session): session closed for user root
Jul 02 19:56:03 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-75ad89ac-d992-4ca5-abb2-695d902e5aed tempest-TestInstancesWithCinderVolumes-1877930177 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-ff18f3bf-1e66-42c5-bccc-3e2b41e1dcf0" returned: 0 in 1.019s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:56:03 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-75ad89ac-d992-4ca5-abb2-695d902e5aed tempest-TestInstancesWithCinderVolumes-1877930177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-ff18f3bf-1e66-42c5-bccc-3e2b41e1dcf0 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:56:03 devstack sudo[100355]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-ff18f3bf-1e66-42c5-bccc-3e2b41e1dcf0
Jul 02 19:56:03 devstack sudo[100355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:56:04 devstack sudo[100349]: pam_unix(sudo:session): session closed for user root
Jul 02 19:56:04 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-524fe3d8-60c1-43d3-89cb-0e5eb749e1ad tempest-VolumeRetypeWithoutMigrationTest-1125923272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e" returned: 0 in 0.833s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:56:04 devstack cinder-volume[86639]: DEBUG cinder.manager [None req-524fe3d8-60c1-43d3-89cb-0e5eb749e1ad tempest-VolumeRetypeWithoutMigrationTest-1125923272 None] Notifying Schedulers of capabilities ... {{(pid=86639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 19:56:04 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-524fe3d8-60c1-43d3-89cb-0e5eb749e1ad tempest-VolumeRetypeWithoutMigrationTest-1125923272 None] Retype volume completed successfully.
Jul 02 19:56:04 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-518c4237-056f-487f-a906-b5f8f118f46f tempest-VolumeRetypeWithoutMigrationTest-1125923272 None] Acquiring lock "cinder-f4b1bf21-ceed-49f6-a83f-fda36d370fd7-delete_volume" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:56:04 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-518c4237-056f-487f-a906-b5f8f118f46f tempest-VolumeRetypeWithoutMigrationTest-1125923272 None] Lock "cinder-f4b1bf21-ceed-49f6-a83f-fda36d370fd7-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:56:04 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-518c4237-056f-487f-a906-b5f8f118f46f tempest-VolumeRetypeWithoutMigrationTest-1125923272 None] Acquiring lock "cinder-quobyte-f4b1bf21-ceed-49f6-a83f-fda36d370fd7" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:56:04 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-518c4237-056f-487f-a906-b5f8f118f46f tempest-VolumeRetypeWithoutMigrationTest-1125923272 None] Lock "cinder-quobyte-f4b1bf21-ceed-49f6-a83f-fda36d370fd7" acquired by "delete_volume" :: waited 0.027s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:56:04 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[245f6d63-da85-451b-8652-759d8d6af7b5]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 19:56:04 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-518c4237-056f-487f-a906-b5f8f118f46f tempest-VolumeRetypeWithoutMigrationTest-1125923272 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-f4b1bf21-ceed-49f6-a83f-fda36d370fd7 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:56:04 devstack sudo[100358]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-f4b1bf21-ceed-49f6-a83f-fda36d370fd7
Jul 02 19:56:04 devstack sudo[100358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:56:04 devstack sudo[100355]: pam_unix(sudo:session): session closed for user root
Jul 02 19:56:04 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-75ad89ac-d992-4ca5-abb2-695d902e5aed tempest-TestInstancesWithCinderVolumes-1877930177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-ff18f3bf-1e66-42c5-bccc-3e2b41e1dcf0" returned: 0 in 1.012s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:56:04 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-75ad89ac-d992-4ca5-abb2-695d902e5aed tempest-TestInstancesWithCinderVolumes-1877930177 None] Lock "cinder-quobyte-ff18f3bf-1e66-42c5-bccc-3e2b41e1dcf0" released by "delete_volume" :: held 2.096s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:56:04 devstack cinder-volume[86639]: WARNING cinder.quota [None req-75ad89ac-d992-4ca5-abb2-695d902e5aed tempest-TestInstancesWithCinderVolumes-1877930177 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-352537619-35158439 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-352537619-35158439, it is now deprecated. Please use the default quota class for default quota.
Jul 02 19:56:04 devstack cinder-volume[86639]: WARNING cinder.quota [None req-75ad89ac-d992-4ca5-abb2-695d902e5aed tempest-TestInstancesWithCinderVolumes-1877930177 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-352537619-35158439 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-352537619-35158439, it is now deprecated. Please use the default quota class for default quota.
Jul 02 19:56:05 devstack cinder-volume[86639]: DEBUG cinder.quota [None req-75ad89ac-d992-4ca5-abb2-695d902e5aed tempest-TestInstancesWithCinderVolumes-1877930177 None] Created reservations ['6d226251-838f-4582-9857-054ea5614041', '7a875cc8-c69d-4b0a-bce4-a052cd9852d4', 'efba7f2a-f056-4499-a40b-05167adbb325', '555596dc-6a30-441f-865b-dfc25ec1d0c2'] {{(pid=86639) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 19:56:05 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-75ad89ac-d992-4ca5-abb2-695d902e5aed tempest-TestInstancesWithCinderVolumes-1877930177 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:56:05 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-75ad89ac-d992-4ca5-abb2-695d902e5aed tempest-TestInstancesWithCinderVolumes-1877930177 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:56:05 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-75ad89ac-d992-4ca5-abb2-695d902e5aed tempest-TestInstancesWithCinderVolumes-1877930177 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 19:56:05 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-75ad89ac-d992-4ca5-abb2-695d902e5aed tempest-TestInstancesWithCinderVolumes-1877930177 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 19:56:05 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-75ad89ac-d992-4ca5-abb2-695d902e5aed tempest-TestInstancesWithCinderVolumes-1877930177 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:56:05 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-75ad89ac-d992-4ca5-abb2-695d902e5aed tempest-TestInstancesWithCinderVolumes-1877930177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:56:05 devstack sudo[100362]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e
Jul 02 19:56:05 devstack sudo[100362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:56:06 devstack sudo[100358]: pam_unix(sudo:session): session closed for user root
Jul 02 19:56:06 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-518c4237-056f-487f-a906-b5f8f118f46f tempest-VolumeRetypeWithoutMigrationTest-1125923272 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-f4b1bf21-ceed-49f6-a83f-fda36d370fd7" returned: 0 in 1.408s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:56:06 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-518c4237-056f-487f-a906-b5f8f118f46f tempest-VolumeRetypeWithoutMigrationTest-1125923272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-f4b1bf21-ceed-49f6-a83f-fda36d370fd7 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:56:06 devstack sudo[100368]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-f4b1bf21-ceed-49f6-a83f-fda36d370fd7
Jul 02 19:56:06 devstack sudo[100368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:56:06 devstack sudo[100362]: pam_unix(sudo:session): session closed for user root
Jul 02 19:56:06 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-75ad89ac-d992-4ca5-abb2-695d902e5aed tempest-TestInstancesWithCinderVolumes-1877930177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e" returned: 0 in 1.230s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:56:06 devstack cinder-volume[86639]: DEBUG cinder.manager [None req-75ad89ac-d992-4ca5-abb2-695d902e5aed tempest-TestInstancesWithCinderVolumes-1877930177 None] Notifying Schedulers of capabilities ... {{(pid=86639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 19:56:06 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-75ad89ac-d992-4ca5-abb2-695d902e5aed tempest-TestInstancesWithCinderVolumes-1877930177 None] Deleted volume successfully.
Jul 02 19:56:06 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-75ad89ac-d992-4ca5-abb2-695d902e5aed tempest-TestInstancesWithCinderVolumes-1877930177 None] Lock "cinder-ff18f3bf-1e66-42c5-bccc-3e2b41e1dcf0-delete_volume" released by "delete_volume" :: held 3.651s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:56:07 devstack cinder-volume[86639]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac21d9a6-6202-4eaf-83d7-29517da19c43 tempest-VolumesSnapshotTestJSON-1095862726 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 19:56:07 devstack sudo[100368]: pam_unix(sudo:session): session closed for user root
Jul 02 19:56:07 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-ac21d9a6-6202-4eaf-83d7-29517da19c43 tempest-VolumesSnapshotTestJSON-1095862726 None] Flow 'volume_create_manager' (f5bfe1ad-685e-420a-8537-9ba554b92c98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 19:56:07 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-ac21d9a6-6202-4eaf-83d7-29517da19c43 tempest-VolumesSnapshotTestJSON-1095862726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f762b295-4146-4cc6-95a9-c0a16a233015) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:56:07 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-518c4237-056f-487f-a906-b5f8f118f46f tempest-VolumeRetypeWithoutMigrationTest-1125923272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-f4b1bf21-ceed-49f6-a83f-fda36d370fd7" returned: 0 in 1.054s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:56:07 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-ac21d9a6-6202-4eaf-83d7-29517da19c43 tempest-VolumesSnapshotTestJSON-1095862726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f762b295-4146-4cc6-95a9-c0a16a233015) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T17:56:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1241404781',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=133719cd-d5ad-4a1e-a6e4-904d5ba1b7c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='584113d73ad94c1aae6af613c9e6588d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T17:56:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T17:56:07Z,use_quota=True,user_id='401ac538758e424ca04e11fb9ee93d99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:56:07 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-ac21d9a6-6202-4eaf-83d7-29517da19c43 tempest-VolumesSnapshotTestJSON-1095862726 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (322a8f13-027e-4a38-89aa-349d3112b943) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:56:07 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-ac21d9a6-6202-4eaf-83d7-29517da19c43 tempest-VolumesSnapshotTestJSON-1095862726 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (322a8f13-027e-4a38-89aa-349d3112b943) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:56:07 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-ac21d9a6-6202-4eaf-83d7-29517da19c43 tempest-VolumesSnapshotTestJSON-1095862726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4860d4c-c0b7-46a1-bee2-7159a04b06d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:56:07 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-ac21d9a6-6202-4eaf-83d7-29517da19c43 tempest-VolumesSnapshotTestJSON-1095862726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4860d4c-c0b7-46a1-bee2-7159a04b06d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '133719cd-d5ad-4a1e-a6e4-904d5ba1b7c4', 'volume_name': 'volume-133719cd-d5ad-4a1e-a6e4-904d5ba1b7c4', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:56:07 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-ac21d9a6-6202-4eaf-83d7-29517da19c43 tempest-VolumesSnapshotTestJSON-1095862726 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2b9f3b3-897b-4024-bd0f-a4f3b9d18f50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:56:07 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-ac21d9a6-6202-4eaf-83d7-29517da19c43 tempest-VolumesSnapshotTestJSON-1095862726 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2b9f3b3-897b-4024-bd0f-a4f3b9d18f50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:56:07 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-ac21d9a6-6202-4eaf-83d7-29517da19c43 tempest-VolumesSnapshotTestJSON-1095862726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2a46461-aea8-4d40-ba94-4ebac9d3b636) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:56:07 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-ac21d9a6-6202-4eaf-83d7-29517da19c43 tempest-VolumesSnapshotTestJSON-1095862726 None] Volume 133719cd-d5ad-4a1e-a6e4-904d5ba1b7c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-133719cd-d5ad-4a1e-a6e4-904d5ba1b7c4', 'volume_size': 1}
Jul 02 19:56:07 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-ac21d9a6-6202-4eaf-83d7-29517da19c43 tempest-VolumesSnapshotTestJSON-1095862726 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:56:07 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-ac21d9a6-6202-4eaf-83d7-29517da19c43 tempest-VolumesSnapshotTestJSON-1095862726 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:56:07 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-ac21d9a6-6202-4eaf-83d7-29517da19c43 tempest-VolumesSnapshotTestJSON-1095862726 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce906cb830>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T17:56:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1241404781',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=133719cd-d5ad-4a1e-a6e4-904d5ba1b7c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='584113d73ad94c1aae6af613c9e6588d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T17:56:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T17:56:07Z,use_quota=True,user_id='401ac538758e424ca04e11fb9ee93d99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)}" {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 19:56:07 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-ac21d9a6-6202-4eaf-83d7-29517da19c43 tempest-VolumesSnapshotTestJSON-1095862726 None] Creating volume 133719cd-d5ad-4a1e-a6e4-904d5ba1b7c4 {{(pid=86639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 19:56:07 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-ac21d9a6-6202-4eaf-83d7-29517da19c43 tempest-VolumesSnapshotTestJSON-1095862726 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:56:07 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-ac21d9a6-6202-4eaf-83d7-29517da19c43 tempest-VolumesSnapshotTestJSON-1095862726 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:56:07 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-ac21d9a6-6202-4eaf-83d7-29517da19c43 tempest-VolumesSnapshotTestJSON-1095862726 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 19:56:07 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-ac21d9a6-6202-4eaf-83d7-29517da19c43 tempest-VolumesSnapshotTestJSON-1095862726 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 19:56:07 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-ac21d9a6-6202-4eaf-83d7-29517da19c43 tempest-VolumesSnapshotTestJSON-1095862726 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:56:07 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-ac21d9a6-6202-4eaf-83d7-29517da19c43 tempest-VolumesSnapshotTestJSON-1095862726 None] Selected osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92 as target Quobyte volume. {{(pid=86639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 19:56:07 devstack cinder-volume[86639]: INFO cinder.volume.drivers.remotefs [None req-ac21d9a6-6202-4eaf-83d7-29517da19c43 tempest-VolumesSnapshotTestJSON-1095862726 None] casted to osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92
Jul 02 19:56:07 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-ac21d9a6-6202-4eaf-83d7-29517da19c43 tempest-VolumesSnapshotTestJSON-1095862726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-133719cd-d5ad-4a1e-a6e4-904d5ba1b7c4 1073741824 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:56:07 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-518c4237-056f-487f-a906-b5f8f118f46f tempest-VolumeRetypeWithoutMigrationTest-1125923272 None] Lock "cinder-quobyte-f4b1bf21-ceed-49f6-a83f-fda36d370fd7" released by "delete_volume" :: held 2.596s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:56:07 devstack sudo[100372]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-133719cd-d5ad-4a1e-a6e4-904d5ba1b7c4 1073741824
Jul 02 19:56:07 devstack sudo[100372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:56:07 devstack cinder-volume[86639]: WARNING cinder.quota [None req-518c4237-056f-487f-a906-b5f8f118f46f tempest-VolumeRetypeWithoutMigrationTest-1125923272 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Jul 02 19:56:07 devstack cinder-volume[86639]: WARNING cinder.quota [None req-518c4237-056f-487f-a906-b5f8f118f46f tempest-VolumeRetypeWithoutMigrationTest-1125923272 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Jul 02 19:56:07 devstack cinder-volume[86639]: DEBUG cinder.quota [None req-518c4237-056f-487f-a906-b5f8f118f46f tempest-VolumeRetypeWithoutMigrationTest-1125923272 None] Created reservations ['2703978e-b749-4df9-b953-250310fba731', '94c2aa8d-f245-4e72-a408-768e81c03c27', 'edd3ff35-d084-4292-88ab-9ea4d8fcf3bb', '085cff49-4d35-4502-83d0-5d7371b9cf31'] {{(pid=86639) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 19:56:07 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-518c4237-056f-487f-a906-b5f8f118f46f tempest-VolumeRetypeWithoutMigrationTest-1125923272 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:56:07 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-518c4237-056f-487f-a906-b5f8f118f46f tempest-VolumeRetypeWithoutMigrationTest-1125923272 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:56:07 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-518c4237-056f-487f-a906-b5f8f118f46f tempest-VolumeRetypeWithoutMigrationTest-1125923272 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 19:56:07 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-518c4237-056f-487f-a906-b5f8f118f46f tempest-VolumeRetypeWithoutMigrationTest-1125923272 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 19:56:07 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-518c4237-056f-487f-a906-b5f8f118f46f tempest-VolumeRetypeWithoutMigrationTest-1125923272 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:56:07 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-518c4237-056f-487f-a906-b5f8f118f46f tempest-VolumeRetypeWithoutMigrationTest-1125923272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:56:07 devstack sudo[100375]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e
Jul 02 19:56:07 devstack sudo[100375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:56:08 devstack sudo[100375]: pam_unix(sudo:session): session closed for user root
Jul 02 19:56:08 devstack sudo[100372]: pam_unix(sudo:session): session closed for user root
Jul 02 19:56:08 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-518c4237-056f-487f-a906-b5f8f118f46f tempest-VolumeRetypeWithoutMigrationTest-1125923272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e" returned: 0 in 0.845s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:56:08 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-ac21d9a6-6202-4eaf-83d7-29517da19c43 tempest-VolumesSnapshotTestJSON-1095862726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-133719cd-d5ad-4a1e-a6e4-904d5ba1b7c4 1073741824" returned: 0 in 1.121s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:56:08 devstack cinder-volume[86639]: DEBUG cinder.manager [None req-518c4237-056f-487f-a906-b5f8f118f46f tempest-VolumeRetypeWithoutMigrationTest-1125923272 None] Notifying Schedulers of capabilities ... {{(pid=86639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 19:56:08 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-518c4237-056f-487f-a906-b5f8f118f46f tempest-VolumeRetypeWithoutMigrationTest-1125923272 None] Deleted volume successfully.
Jul 02 19:56:08 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-518c4237-056f-487f-a906-b5f8f118f46f tempest-VolumeRetypeWithoutMigrationTest-1125923272 None] Lock "cinder-f4b1bf21-ceed-49f6-a83f-fda36d370fd7-delete_volume" released by "delete_volume" :: held 3.879s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:56:08 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-ac21d9a6-6202-4eaf-83d7-29517da19c43 tempest-VolumesSnapshotTestJSON-1095862726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-133719cd-d5ad-4a1e-a6e4-904d5ba1b7c4 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:56:08 devstack sudo[100382]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-133719cd-d5ad-4a1e-a6e4-904d5ba1b7c4
Jul 02 19:56:08 devstack sudo[100382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:56:09 devstack sudo[100382]: pam_unix(sudo:session): session closed for user root
Jul 02 19:56:09 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-ac21d9a6-6202-4eaf-83d7-29517da19c43 tempest-VolumesSnapshotTestJSON-1095862726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-133719cd-d5ad-4a1e-a6e4-904d5ba1b7c4" returned: 0 in 1.006s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:56:09 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-ac21d9a6-6202-4eaf-83d7-29517da19c43 tempest-VolumesSnapshotTestJSON-1095862726 None] <== create_volume: return (2210ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'} {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 19:56:09 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-ac21d9a6-6202-4eaf-83d7-29517da19c43 tempest-VolumesSnapshotTestJSON-1095862726 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.216s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:56:09 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-ac21d9a6-6202-4eaf-83d7-29517da19c43 tempest-VolumesSnapshotTestJSON-1095862726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2a46461-aea8-4d40-ba94-4ebac9d3b636) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-133719cd-d5ad-4a1e-a6e4-904d5ba1b7c4', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:56:09 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-ac21d9a6-6202-4eaf-83d7-29517da19c43 tempest-VolumesSnapshotTestJSON-1095862726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1f685d7-3be8-4114-8e29-d97304e4e394) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:56:09 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-ac21d9a6-6202-4eaf-83d7-29517da19c43 tempest-VolumesSnapshotTestJSON-1095862726 None] Volume volume-133719cd-d5ad-4a1e-a6e4-904d5ba1b7c4 (133719cd-d5ad-4a1e-a6e4-904d5ba1b7c4): created successfully
Jul 02 19:56:09 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-ac21d9a6-6202-4eaf-83d7-29517da19c43 tempest-VolumesSnapshotTestJSON-1095862726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1f685d7-3be8-4114-8e29-d97304e4e394) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:56:09 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-ac21d9a6-6202-4eaf-83d7-29517da19c43 tempest-VolumesSnapshotTestJSON-1095862726 None] Flow 'volume_create_manager' (f5bfe1ad-685e-420a-8537-9ba554b92c98) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 19:56:09 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-ac21d9a6-6202-4eaf-83d7-29517da19c43 tempest-VolumesSnapshotTestJSON-1095862726 None] Created volume successfully.
Jul 02 19:56:10 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-fe33783f-440b-4b9e-b3a6-778437d888d9 tempest-VolumesSnapshotTestJSON-1095862726 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:56:10 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-fe33783f-440b-4b9e-b3a6-778437d888d9 tempest-VolumesSnapshotTestJSON-1095862726 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:56:10 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-fe33783f-440b-4b9e-b3a6-778437d888d9 tempest-VolumesSnapshotTestJSON-1095862726 None] Creating offline snapshot 37aa7aee-cd41-4bcf-b7dc-995ebc89fe7b of volume 133719cd-d5ad-4a1e-a6e4-904d5ba1b7c4 {{(pid=86639) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 02 19:56:10 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[34614b97-15b6-4dd8-b8b9-c81dbf168d98]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 19:56:10 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-fe33783f-440b-4b9e-b3a6-778437d888d9 tempest-VolumesSnapshotTestJSON-1095862726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-133719cd-d5ad-4a1e-a6e4-904d5ba1b7c4 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:56:10 devstack sudo[100422]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-133719cd-d5ad-4a1e-a6e4-904d5ba1b7c4
Jul 02 19:56:10 devstack sudo[100422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:56:11 devstack sudo[100422]: pam_unix(sudo:session): session closed for user root
Jul 02 19:56:11 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-fe33783f-440b-4b9e-b3a6-778437d888d9 tempest-VolumesSnapshotTestJSON-1095862726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-133719cd-d5ad-4a1e-a6e4-904d5ba1b7c4" returned: 0 in 1.025s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:56:11 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-fe33783f-440b-4b9e-b3a6-778437d888d9 tempest-VolumesSnapshotTestJSON-1095862726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-133719cd-d5ad-4a1e-a6e4-904d5ba1b7c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-133719cd-d5ad-4a1e-a6e4-904d5ba1b7c4.37aa7aee-cd41-4bcf-b7dc-995ebc89fe7b 1G {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:56:11 devstack sudo[100428]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-133719cd-d5ad-4a1e-a6e4-904d5ba1b7c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-133719cd-d5ad-4a1e-a6e4-904d5ba1b7c4.37aa7aee-cd41-4bcf-b7dc-995ebc89fe7b 1G
Jul 02 19:56:11 devstack sudo[100428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:56:11 devstack cinder-volume[86639]: INFO cinder.volume.manager [req-7f41d901-3f47-4642-b4fb-4108b30633c3 req-66cddcea-bb0d-4c7a-a23c-73b989bc99c4 tempest-TestInstancesWithCinderVolumes-1877930177 None] Terminate volume connection completed successfully.
Jul 02 19:56:11 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [req-7f41d901-3f47-4642-b4fb-4108b30633c3 req-66cddcea-bb0d-4c7a-a23c-73b989bc99c4 tempest-TestInstancesWithCinderVolumes-1877930177 None] Deleting attachment 0d8bae0f-61aa-48d6-9124-5aa7846a5928. {{(pid=86639) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 02 19:56:12 devstack sudo[100428]: pam_unix(sudo:session): session closed for user root
Jul 02 19:56:12 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-fe33783f-440b-4b9e-b3a6-778437d888d9 tempest-VolumesSnapshotTestJSON-1095862726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-133719cd-d5ad-4a1e-a6e4-904d5ba1b7c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-133719cd-d5ad-4a1e-a6e4-904d5ba1b7c4.37aa7aee-cd41-4bcf-b7dc-995ebc89fe7b 1G" returned: 0 in 1.090s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:56:12 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-fe33783f-440b-4b9e-b3a6-778437d888d9 tempest-VolumesSnapshotTestJSON-1095862726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-133719cd-d5ad-4a1e-a6e4-904d5ba1b7c4 -F qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-133719cd-d5ad-4a1e-a6e4-904d5ba1b7c4.37aa7aee-cd41-4bcf-b7dc-995ebc89fe7b {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:56:12 devstack sudo[100436]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-133719cd-d5ad-4a1e-a6e4-904d5ba1b7c4 -F qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-133719cd-d5ad-4a1e-a6e4-904d5ba1b7c4.37aa7aee-cd41-4bcf-b7dc-995ebc89fe7b
Jul 02 19:56:12 devstack sudo[100436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:56:13 devstack sudo[100436]: pam_unix(sudo:session): session closed for user root
Jul 02 19:56:13 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-fe33783f-440b-4b9e-b3a6-778437d888d9 tempest-VolumesSnapshotTestJSON-1095862726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-133719cd-d5ad-4a1e-a6e4-904d5ba1b7c4 -F qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-133719cd-d5ad-4a1e-a6e4-904d5ba1b7c4.37aa7aee-cd41-4bcf-b7dc-995ebc89fe7b" returned: 0 in 0.753s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:56:13 devstack cinder-volume[86639]: WARNING cinder.volume.drivers.remotefs [None req-fe33783f-440b-4b9e-b3a6-778437d888d9 tempest-VolumesSnapshotTestJSON-1095862726 None] /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-133719cd-d5ad-4a1e-a6e4-904d5ba1b7c4.37aa7aee-cd41-4bcf-b7dc-995ebc89fe7b is being set with open permissions: ugo+rw
Jul 02 19:56:13 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-fe33783f-440b-4b9e-b3a6-778437d888d9 tempest-VolumesSnapshotTestJSON-1095862726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-133719cd-d5ad-4a1e-a6e4-904d5ba1b7c4.37aa7aee-cd41-4bcf-b7dc-995ebc89fe7b {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:56:13 devstack sudo[100442]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-133719cd-d5ad-4a1e-a6e4-904d5ba1b7c4.37aa7aee-cd41-4bcf-b7dc-995ebc89fe7b
Jul 02 19:56:13 devstack sudo[100442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:56:14 devstack sudo[100442]: pam_unix(sudo:session): session closed for user root
Jul 02 19:56:14 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-fe33783f-440b-4b9e-b3a6-778437d888d9 tempest-VolumesSnapshotTestJSON-1095862726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-133719cd-d5ad-4a1e-a6e4-904d5ba1b7c4.37aa7aee-cd41-4bcf-b7dc-995ebc89fe7b" returned: 0 in 0.852s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:56:14 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-fe33783f-440b-4b9e-b3a6-778437d888d9 tempest-VolumesSnapshotTestJSON-1095862726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-133719cd-d5ad-4a1e-a6e4-904d5ba1b7c4.info {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:56:14 devstack sudo[100445]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-133719cd-d5ad-4a1e-a6e4-904d5ba1b7c4.info
Jul 02 19:56:14 devstack sudo[100445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:56:15 devstack sudo[100445]: pam_unix(sudo:session): session closed for user root
Jul 02 19:56:15 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-fe33783f-440b-4b9e-b3a6-778437d888d9 tempest-VolumesSnapshotTestJSON-1095862726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-133719cd-d5ad-4a1e-a6e4-904d5ba1b7c4.info" returned: 0 in 0.941s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:56:15 devstack cinder-volume[86639]: WARNING cinder.volume.drivers.remotefs [None req-fe33783f-440b-4b9e-b3a6-778437d888d9 tempest-VolumesSnapshotTestJSON-1095862726 None] /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-133719cd-d5ad-4a1e-a6e4-904d5ba1b7c4.info is being set with open permissions: ugo+rw
Jul 02 19:56:15 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-fe33783f-440b-4b9e-b3a6-778437d888d9 tempest-VolumesSnapshotTestJSON-1095862726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-133719cd-d5ad-4a1e-a6e4-904d5ba1b7c4.info {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:56:15 devstack sudo[100448]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-133719cd-d5ad-4a1e-a6e4-904d5ba1b7c4.info
Jul 02 19:56:15 devstack sudo[100448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:56:15 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-e51a9791-cd85-4ace-8588-a24a921a85ba tempest-TestInstancesWithCinderVolumes-1877930177 None] Acquiring lock "cinder-9b318261-668e-4454-af8f-b593a15f2a15-delete_volume" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:56:15 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-e51a9791-cd85-4ace-8588-a24a921a85ba tempest-TestInstancesWithCinderVolumes-1877930177 None] Lock "cinder-9b318261-668e-4454-af8f-b593a15f2a15-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:56:16 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-e51a9791-cd85-4ace-8588-a24a921a85ba tempest-TestInstancesWithCinderVolumes-1877930177 None] Acquiring lock "cinder-quobyte-9b318261-668e-4454-af8f-b593a15f2a15" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:56:16 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-e51a9791-cd85-4ace-8588-a24a921a85ba tempest-TestInstancesWithCinderVolumes-1877930177 None] Lock "cinder-quobyte-9b318261-668e-4454-af8f-b593a15f2a15" acquired by "delete_volume" :: waited 0.021s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:56:16 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b80af8f-116a-4494-abbc-7b2631d41f95]: (4, 'raw') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 19:56:16 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-e51a9791-cd85-4ace-8588-a24a921a85ba tempest-TestInstancesWithCinderVolumes-1877930177 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-9b318261-668e-4454-af8f-b593a15f2a15 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:56:16 devstack sudo[100448]: pam_unix(sudo:session): session closed for user root
Jul 02 19:56:16 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-fe33783f-440b-4b9e-b3a6-778437d888d9 tempest-VolumesSnapshotTestJSON-1095862726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-133719cd-d5ad-4a1e-a6e4-904d5ba1b7c4.info" returned: 0 in 0.756s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:56:16 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-fe33783f-440b-4b9e-b3a6-778437d888d9 tempest-VolumesSnapshotTestJSON-1095862726 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.572s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:56:16 devstack sudo[100451]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-9b318261-668e-4454-af8f-b593a15f2a15
Jul 02 19:56:16 devstack sudo[100451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:56:16 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-fe33783f-440b-4b9e-b3a6-778437d888d9 tempest-VolumesSnapshotTestJSON-1095862726 None] Create snapshot completed successfully
Jul 02 19:56:17 devstack sudo[100451]: pam_unix(sudo:session): session closed for user root
Jul 02 19:56:17 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-e51a9791-cd85-4ace-8588-a24a921a85ba tempest-TestInstancesWithCinderVolumes-1877930177 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-9b318261-668e-4454-af8f-b593a15f2a15" returned: 0 in 0.878s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:56:17 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-e51a9791-cd85-4ace-8588-a24a921a85ba tempest-TestInstancesWithCinderVolumes-1877930177 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-9b318261-668e-4454-af8f-b593a15f2a15 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:56:17 devstack sudo[100455]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-9b318261-668e-4454-af8f-b593a15f2a15
Jul 02 19:56:17 devstack sudo[100455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:56:17 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-38eab4de-7741-4edc-a567-5265ced91213 tempest-VolumesSnapshotTestJSON-1095862726 None] Acquiring lock "cinder-37aa7aee-cd41-4bcf-b7dc-995ebc89fe7b-delete_snapshot" by "delete_snapshot" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:56:17 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-38eab4de-7741-4edc-a567-5265ced91213 tempest-VolumesSnapshotTestJSON-1095862726 None] Lock "cinder-37aa7aee-cd41-4bcf-b7dc-995ebc89fe7b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:56:17 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-38eab4de-7741-4edc-a567-5265ced91213 tempest-VolumesSnapshotTestJSON-1095862726 None] Acquiring lock "cinder-quobyte-133719cd-d5ad-4a1e-a6e4-904d5ba1b7c4" by "delete_snapshot" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:56:17 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-38eab4de-7741-4edc-a567-5265ced91213 tempest-VolumesSnapshotTestJSON-1095862726 None] Lock "cinder-quobyte-133719cd-d5ad-4a1e-a6e4-904d5ba1b7c4" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:56:17 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-38eab4de-7741-4edc-a567-5265ced91213 tempest-VolumesSnapshotTestJSON-1095862726 None] Acquiring lock "cinder-quobyte-37aa7aee-cd41-4bcf-b7dc-995ebc89fe7b" by "_delete_snapshot" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:56:17 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-38eab4de-7741-4edc-a567-5265ced91213 tempest-VolumesSnapshotTestJSON-1095862726 None] Lock "cinder-quobyte-37aa7aee-cd41-4bcf-b7dc-995ebc89fe7b" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:56:17 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-38eab4de-7741-4edc-a567-5265ced91213 tempest-VolumesSnapshotTestJSON-1095862726 None] Deleting offline snapshot 37aa7aee-cd41-4bcf-b7dc-995ebc89fe7b of volume 133719cd-d5ad-4a1e-a6e4-904d5ba1b7c4 {{(pid=86639) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 02 19:56:17 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-38eab4de-7741-4edc-a567-5265ced91213 tempest-VolumesSnapshotTestJSON-1095862726 None] snapshot_file for this snap is: volume-133719cd-d5ad-4a1e-a6e4-904d5ba1b7c4.37aa7aee-cd41-4bcf-b7dc-995ebc89fe7b {{(pid=86639) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 02 19:56:17 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f959ec2-9038-417e-b2d5-0e2cbde8c7c6]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 19:56:17 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-38eab4de-7741-4edc-a567-5265ced91213 tempest-VolumesSnapshotTestJSON-1095862726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-133719cd-d5ad-4a1e-a6e4-904d5ba1b7c4.37aa7aee-cd41-4bcf-b7dc-995ebc89fe7b {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:56:17 devstack sudo[100457]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-133719cd-d5ad-4a1e-a6e4-904d5ba1b7c4.37aa7aee-cd41-4bcf-b7dc-995ebc89fe7b
Jul 02 19:56:17 devstack sudo[100457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:56:17 devstack sudo[100455]: pam_unix(sudo:session): session closed for user root
Jul 02 19:56:17 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-e51a9791-cd85-4ace-8588-a24a921a85ba tempest-TestInstancesWithCinderVolumes-1877930177 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-9b318261-668e-4454-af8f-b593a15f2a15" returned: 1 in 0.944s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:56:17 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-e51a9791-cd85-4ace-8588-a24a921a85ba tempest-TestInstancesWithCinderVolumes-1877930177 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-9b318261-668e-4454-af8f-b593a15f2a15' failed. Not Retrying. {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 02 19:56:17 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-e51a9791-cd85-4ace-8588-a24a921a85ba tempest-TestInstancesWithCinderVolumes-1877930177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-9b318261-668e-4454-af8f-b593a15f2a15 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:56:17 devstack sudo[100462]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-9b318261-668e-4454-af8f-b593a15f2a15
Jul 02 19:56:17 devstack sudo[100462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:56:18 devstack sudo[100457]: pam_unix(sudo:session): session closed for user root
Jul 02 19:56:18 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-38eab4de-7741-4edc-a567-5265ced91213 tempest-VolumesSnapshotTestJSON-1095862726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-133719cd-d5ad-4a1e-a6e4-904d5ba1b7c4.37aa7aee-cd41-4bcf-b7dc-995ebc89fe7b" returned: 0 in 0.973s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:56:18 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-38eab4de-7741-4edc-a567-5265ced91213 tempest-VolumesSnapshotTestJSON-1095862726 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-133719cd-d5ad-4a1e-a6e4-904d5ba1b7c4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86639) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 02 19:56:18 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cd72262-7777-40a1-9032-a87decb7b37a]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 19:56:18 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-38eab4de-7741-4edc-a567-5265ced91213 tempest-VolumesSnapshotTestJSON-1095862726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-133719cd-d5ad-4a1e-a6e4-904d5ba1b7c4 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:56:18 devstack sudo[100467]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-133719cd-d5ad-4a1e-a6e4-904d5ba1b7c4
Jul 02 19:56:18 devstack sudo[100467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:56:18 devstack sudo[100462]: pam_unix(sudo:session): session closed for user root
Jul 02 19:56:18 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-e51a9791-cd85-4ace-8588-a24a921a85ba tempest-TestInstancesWithCinderVolumes-1877930177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-9b318261-668e-4454-af8f-b593a15f2a15" returned: 0 in 0.783s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:56:18 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-e51a9791-cd85-4ace-8588-a24a921a85ba tempest-TestInstancesWithCinderVolumes-1877930177 None] Lock "cinder-quobyte-9b318261-668e-4454-af8f-b593a15f2a15" released by "delete_volume" :: held 2.705s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:56:18 devstack cinder-volume[86639]: WARNING cinder.quota [None req-e51a9791-cd85-4ace-8588-a24a921a85ba tempest-TestInstancesWithCinderVolumes-1877930177 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-473307939-2018892208 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-473307939-2018892208, it is now deprecated. Please use the default quota class for default quota.
Jul 02 19:56:18 devstack cinder-volume[86639]: WARNING cinder.quota [None req-e51a9791-cd85-4ace-8588-a24a921a85ba tempest-TestInstancesWithCinderVolumes-1877930177 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-473307939-2018892208 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-473307939-2018892208, it is now deprecated. Please use the default quota class for default quota.
Jul 02 19:56:18 devstack cinder-volume[86639]: DEBUG cinder.quota [None req-e51a9791-cd85-4ace-8588-a24a921a85ba tempest-TestInstancesWithCinderVolumes-1877930177 None] Created reservations ['db19a5f2-8a3c-4634-9195-5b67d00e78e7', '129c6f09-ee29-424c-bd0a-dbdd2b52a94a', '5ba4b16b-d6a0-4aed-a4ce-fc962b6b080e', '9329624c-1d13-4c49-857a-8c0d9f665172'] {{(pid=86639) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 19:56:18 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-e51a9791-cd85-4ace-8588-a24a921a85ba tempest-TestInstancesWithCinderVolumes-1877930177 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:56:18 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-e51a9791-cd85-4ace-8588-a24a921a85ba tempest-TestInstancesWithCinderVolumes-1877930177 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:56:18 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-e51a9791-cd85-4ace-8588-a24a921a85ba tempest-TestInstancesWithCinderVolumes-1877930177 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 19:56:18 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-e51a9791-cd85-4ace-8588-a24a921a85ba tempest-TestInstancesWithCinderVolumes-1877930177 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 19:56:18 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-e51a9791-cd85-4ace-8588-a24a921a85ba tempest-TestInstancesWithCinderVolumes-1877930177 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:56:18 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-e51a9791-cd85-4ace-8588-a24a921a85ba tempest-TestInstancesWithCinderVolumes-1877930177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:56:18 devstack sudo[100470]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e
Jul 02 19:56:18 devstack sudo[100470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:56:19 devstack sudo[100467]: pam_unix(sudo:session): session closed for user root
Jul 02 19:56:19 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-38eab4de-7741-4edc-a567-5265ced91213 tempest-VolumesSnapshotTestJSON-1095862726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-133719cd-d5ad-4a1e-a6e4-904d5ba1b7c4" returned: 0 in 0.906s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:56:19 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-38eab4de-7741-4edc-a567-5265ced91213 tempest-VolumesSnapshotTestJSON-1095862726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-133719cd-d5ad-4a1e-a6e4-904d5ba1b7c4.37aa7aee-cd41-4bcf-b7dc-995ebc89fe7b {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:56:19 devstack sudo[100475]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-133719cd-d5ad-4a1e-a6e4-904d5ba1b7c4.37aa7aee-cd41-4bcf-b7dc-995ebc89fe7b
Jul 02 19:56:19 devstack sudo[100475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:56:19 devstack sudo[100470]: pam_unix(sudo:session): session closed for user root
Jul 02 19:56:19 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-e51a9791-cd85-4ace-8588-a24a921a85ba tempest-TestInstancesWithCinderVolumes-1877930177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e" returned: 0 in 0.767s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:56:19 devstack cinder-volume[86639]: DEBUG cinder.manager [None req-e51a9791-cd85-4ace-8588-a24a921a85ba tempest-TestInstancesWithCinderVolumes-1877930177 None] Notifying Schedulers of capabilities ... {{(pid=86639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 19:56:19 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-e51a9791-cd85-4ace-8588-a24a921a85ba tempest-TestInstancesWithCinderVolumes-1877930177 None] Deleted volume successfully.
Jul 02 19:56:19 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-e51a9791-cd85-4ace-8588-a24a921a85ba tempest-TestInstancesWithCinderVolumes-1877930177 None] Lock "cinder-9b318261-668e-4454-af8f-b593a15f2a15-delete_volume" released by "delete_volume" :: held 3.789s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:56:20 devstack cinder-volume[86639]: DEBUG cinder.volume.flows.manager.create_volume [None req-2bf2c7d0-03be-4cfe-8dfc-3c9b8a6099ef tempest-SnapshotMetadataTestJSON-1248525638 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 19:56:20 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-2bf2c7d0-03be-4cfe-8dfc-3c9b8a6099ef tempest-SnapshotMetadataTestJSON-1248525638 None] Flow 'volume_create_manager' (9535aa4e-a545-41b6-94d9-19c6525c3947) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 19:56:20 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-2bf2c7d0-03be-4cfe-8dfc-3c9b8a6099ef tempest-SnapshotMetadataTestJSON-1248525638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d6037f8-ef2b-425a-a011-d6c38aedaee5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:56:20 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-2bf2c7d0-03be-4cfe-8dfc-3c9b8a6099ef tempest-SnapshotMetadataTestJSON-1248525638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d6037f8-ef2b-425a-a011-d6c38aedaee5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T17:56:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1554817447',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7cc5aac6-59d1-4a71-af2b-de795fc27af1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58f7a82f2b0941fe97760927da062d1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T17:56:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T17:56:20Z,use_quota=True,user_id='20a0776036314cdca7c6318668c8ad60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:56:20 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-2bf2c7d0-03be-4cfe-8dfc-3c9b8a6099ef tempest-SnapshotMetadataTestJSON-1248525638 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c425cd9-75de-4ea0-9c40-41ef14b6436b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:56:20 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-2bf2c7d0-03be-4cfe-8dfc-3c9b8a6099ef tempest-SnapshotMetadataTestJSON-1248525638 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c425cd9-75de-4ea0-9c40-41ef14b6436b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:56:20 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-2bf2c7d0-03be-4cfe-8dfc-3c9b8a6099ef tempest-SnapshotMetadataTestJSON-1248525638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21374da1-523f-4015-8a15-86ca4762ec1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:56:20 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-2bf2c7d0-03be-4cfe-8dfc-3c9b8a6099ef tempest-SnapshotMetadataTestJSON-1248525638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21374da1-523f-4015-8a15-86ca4762ec1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7cc5aac6-59d1-4a71-af2b-de795fc27af1', 'volume_name': 'volume-7cc5aac6-59d1-4a71-af2b-de795fc27af1', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:56:20 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-2bf2c7d0-03be-4cfe-8dfc-3c9b8a6099ef tempest-SnapshotMetadataTestJSON-1248525638 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dac19444-3423-4569-9352-bbbc475a08c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:56:20 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-2bf2c7d0-03be-4cfe-8dfc-3c9b8a6099ef tempest-SnapshotMetadataTestJSON-1248525638 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dac19444-3423-4569-9352-bbbc475a08c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:56:20 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-2bf2c7d0-03be-4cfe-8dfc-3c9b8a6099ef tempest-SnapshotMetadataTestJSON-1248525638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c203ddf3-0c48-4541-a08d-8eb27379b66c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:56:20 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-2bf2c7d0-03be-4cfe-8dfc-3c9b8a6099ef tempest-SnapshotMetadataTestJSON-1248525638 None] Volume 7cc5aac6-59d1-4a71-af2b-de795fc27af1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7cc5aac6-59d1-4a71-af2b-de795fc27af1', 'volume_size': 1}
Jul 02 19:56:20 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-2bf2c7d0-03be-4cfe-8dfc-3c9b8a6099ef tempest-SnapshotMetadataTestJSON-1248525638 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:56:20 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-2bf2c7d0-03be-4cfe-8dfc-3c9b8a6099ef tempest-SnapshotMetadataTestJSON-1248525638 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:56:20 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-2bf2c7d0-03be-4cfe-8dfc-3c9b8a6099ef tempest-SnapshotMetadataTestJSON-1248525638 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce906cb830>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T17:56:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1554817447',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7cc5aac6-59d1-4a71-af2b-de795fc27af1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58f7a82f2b0941fe97760927da062d1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T17:56:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T17:56:20Z,use_quota=True,user_id='20a0776036314cdca7c6318668c8ad60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)}" {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 19:56:20 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-2bf2c7d0-03be-4cfe-8dfc-3c9b8a6099ef tempest-SnapshotMetadataTestJSON-1248525638 None] Creating volume 7cc5aac6-59d1-4a71-af2b-de795fc27af1 {{(pid=86639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 19:56:20 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-2bf2c7d0-03be-4cfe-8dfc-3c9b8a6099ef tempest-SnapshotMetadataTestJSON-1248525638 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:56:20 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-2bf2c7d0-03be-4cfe-8dfc-3c9b8a6099ef tempest-SnapshotMetadataTestJSON-1248525638 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:56:20 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-2bf2c7d0-03be-4cfe-8dfc-3c9b8a6099ef tempest-SnapshotMetadataTestJSON-1248525638 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 19:56:20 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-2bf2c7d0-03be-4cfe-8dfc-3c9b8a6099ef tempest-SnapshotMetadataTestJSON-1248525638 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 19:56:20 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-2bf2c7d0-03be-4cfe-8dfc-3c9b8a6099ef tempest-SnapshotMetadataTestJSON-1248525638 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:56:20 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-2bf2c7d0-03be-4cfe-8dfc-3c9b8a6099ef tempest-SnapshotMetadataTestJSON-1248525638 None] Selected osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92 as target Quobyte volume. {{(pid=86639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 19:56:20 devstack cinder-volume[86639]: INFO cinder.volume.drivers.remotefs [None req-2bf2c7d0-03be-4cfe-8dfc-3c9b8a6099ef tempest-SnapshotMetadataTestJSON-1248525638 None] casted to osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92
Jul 02 19:56:20 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-2bf2c7d0-03be-4cfe-8dfc-3c9b8a6099ef tempest-SnapshotMetadataTestJSON-1248525638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-7cc5aac6-59d1-4a71-af2b-de795fc27af1 1073741824 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:56:20 devstack sudo[100482]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-7cc5aac6-59d1-4a71-af2b-de795fc27af1 1073741824
Jul 02 19:56:20 devstack sudo[100482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:56:20 devstack sudo[100475]: pam_unix(sudo:session): session closed for user root
Jul 02 19:56:20 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-38eab4de-7741-4edc-a567-5265ced91213 tempest-VolumesSnapshotTestJSON-1095862726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-133719cd-d5ad-4a1e-a6e4-904d5ba1b7c4.37aa7aee-cd41-4bcf-b7dc-995ebc89fe7b" returned: 0 in 1.099s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:56:20 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-38eab4de-7741-4edc-a567-5265ced91213 tempest-VolumesSnapshotTestJSON-1095862726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-133719cd-d5ad-4a1e-a6e4-904d5ba1b7c4.37aa7aee-cd41-4bcf-b7dc-995ebc89fe7b {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:56:20 devstack sudo[100484]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-133719cd-d5ad-4a1e-a6e4-904d5ba1b7c4.37aa7aee-cd41-4bcf-b7dc-995ebc89fe7b
Jul 02 19:56:20 devstack sudo[100484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:56:21 devstack sudo[100484]: pam_unix(sudo:session): session closed for user root
Jul 02 19:56:21 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-38eab4de-7741-4edc-a567-5265ced91213 tempest-VolumesSnapshotTestJSON-1095862726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-133719cd-d5ad-4a1e-a6e4-904d5ba1b7c4.37aa7aee-cd41-4bcf-b7dc-995ebc89fe7b" returned: 0 in 0.725s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:56:21 devstack cinder-volume[86639]: DEBUG dbcounter [-] [86639] Writing DB stats cinder:SELECT=83,cinder:INSERT=17,cinder:UPDATE=89,cinder:DELETE=7 {{(pid=86639) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 02 19:56:21 devstack cinder-volume[86639]: DEBUG dbcounter [-] [86639] Writing DB stats cinder:SELECT=88,cinder:INSERT=24,cinder:UPDATE=94,cinder:DELETE=6 {{(pid=86639) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 02 19:56:21 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-38eab4de-7741-4edc-a567-5265ced91213 tempest-VolumesSnapshotTestJSON-1095862726 None] Lock "cinder-quobyte-37aa7aee-cd41-4bcf-b7dc-995ebc89fe7b" released by "_delete_snapshot" :: held 3.882s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:56:21 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-38eab4de-7741-4edc-a567-5265ced91213 tempest-VolumesSnapshotTestJSON-1095862726 None] Lock "cinder-quobyte-133719cd-d5ad-4a1e-a6e4-904d5ba1b7c4" released by "delete_snapshot" :: held 3.921s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:56:21 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-2bf2c7d0-03be-4cfe-8dfc-3c9b8a6099ef tempest-SnapshotMetadataTestJSON-1248525638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-7cc5aac6-59d1-4a71-af2b-de795fc27af1 1073741824" returned: 0 in 1.059s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:56:21 devstack sudo[100482]: pam_unix(sudo:session): session closed for user root
Jul 02 19:56:21 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-2bf2c7d0-03be-4cfe-8dfc-3c9b8a6099ef tempest-SnapshotMetadataTestJSON-1248525638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-7cc5aac6-59d1-4a71-af2b-de795fc27af1 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:56:21 devstack cinder-volume[86639]: DEBUG cinder.quota [None req-38eab4de-7741-4edc-a567-5265ced91213 tempest-VolumesSnapshotTestJSON-1095862726 None] Created reservations ['25782b65-a085-4d71-9624-7f89fe801ed3', 'f66cf266-2cef-47e3-8316-30315d15486b', '97334098-ce39-4f55-ba64-07bbb09ec66a', '89ab9d82-5ba5-4c2f-84c0-a7eccd436c95'] {{(pid=86639) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 19:56:21 devstack sudo[100491]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-7cc5aac6-59d1-4a71-af2b-de795fc27af1
Jul 02 19:56:21 devstack sudo[100491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:56:21 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-38eab4de-7741-4edc-a567-5265ced91213 tempest-VolumesSnapshotTestJSON-1095862726 None] Delete snapshot completed successfully.
Jul 02 19:56:21 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-38eab4de-7741-4edc-a567-5265ced91213 tempest-VolumesSnapshotTestJSON-1095862726 None] Lock "cinder-37aa7aee-cd41-4bcf-b7dc-995ebc89fe7b-delete_snapshot" released by "delete_snapshot" :: held 4.283s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:56:22 devstack sudo[100491]: pam_unix(sudo:session): session closed for user root
Jul 02 19:56:22 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-2bf2c7d0-03be-4cfe-8dfc-3c9b8a6099ef tempest-SnapshotMetadataTestJSON-1248525638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-7cc5aac6-59d1-4a71-af2b-de795fc27af1" returned: 0 in 0.719s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:56:22 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-2bf2c7d0-03be-4cfe-8dfc-3c9b8a6099ef tempest-SnapshotMetadataTestJSON-1248525638 None] <== create_volume: return (1857ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'} {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 19:56:22 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-2bf2c7d0-03be-4cfe-8dfc-3c9b8a6099ef tempest-SnapshotMetadataTestJSON-1248525638 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.861s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:56:22 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-2bf2c7d0-03be-4cfe-8dfc-3c9b8a6099ef tempest-SnapshotMetadataTestJSON-1248525638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c203ddf3-0c48-4541-a08d-8eb27379b66c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7cc5aac6-59d1-4a71-af2b-de795fc27af1', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:56:22 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-2bf2c7d0-03be-4cfe-8dfc-3c9b8a6099ef tempest-SnapshotMetadataTestJSON-1248525638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (289d13af-9179-4f6a-b0c6-09cd8273ea47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:56:22 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-2bf2c7d0-03be-4cfe-8dfc-3c9b8a6099ef tempest-SnapshotMetadataTestJSON-1248525638 None] Volume volume-7cc5aac6-59d1-4a71-af2b-de795fc27af1 (7cc5aac6-59d1-4a71-af2b-de795fc27af1): created successfully
Jul 02 19:56:22 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-2bf2c7d0-03be-4cfe-8dfc-3c9b8a6099ef tempest-SnapshotMetadataTestJSON-1248525638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (289d13af-9179-4f6a-b0c6-09cd8273ea47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:56:22 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-2bf2c7d0-03be-4cfe-8dfc-3c9b8a6099ef tempest-SnapshotMetadataTestJSON-1248525638 None] Flow 'volume_create_manager' (9535aa4e-a545-41b6-94d9-19c6525c3947) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 19:56:22 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-2bf2c7d0-03be-4cfe-8dfc-3c9b8a6099ef tempest-SnapshotMetadataTestJSON-1248525638 None] Created volume successfully.
Jul 02 19:56:23 devstack cinder-volume[86639]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d8594a5-80fe-4f04-8dce-7528376f6dc5 tempest-VolumesSnapshotTestJSON-1095862726 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 19:56:23 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-1d8594a5-80fe-4f04-8dce-7528376f6dc5 tempest-VolumesSnapshotTestJSON-1095862726 None] Flow 'volume_create_manager' (3a2a5c2b-5d4b-4dad-993a-22f890971405) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 19:56:23 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-1d8594a5-80fe-4f04-8dce-7528376f6dc5 tempest-VolumesSnapshotTestJSON-1095862726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b47eee94-3970-4e1a-ba43-e368c2cca4c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:56:23 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-1d8594a5-80fe-4f04-8dce-7528376f6dc5 tempest-VolumesSnapshotTestJSON-1095862726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b47eee94-3970-4e1a-ba43-e368c2cca4c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T17:56:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-299859711',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab40c67a-3006-401d-aecd-dcf490c8c818,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='584113d73ad94c1aae6af613c9e6588d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T17:56:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T17:56:23Z,use_quota=True,user_id='401ac538758e424ca04e11fb9ee93d99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:56:23 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-1d8594a5-80fe-4f04-8dce-7528376f6dc5 tempest-VolumesSnapshotTestJSON-1095862726 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a9878bb-2f5b-4c50-90a8-452dc4ed55f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:56:23 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-1d8594a5-80fe-4f04-8dce-7528376f6dc5 tempest-VolumesSnapshotTestJSON-1095862726 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a9878bb-2f5b-4c50-90a8-452dc4ed55f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:56:23 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-1d8594a5-80fe-4f04-8dce-7528376f6dc5 tempest-VolumesSnapshotTestJSON-1095862726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01c899c4-f9e2-48a1-84f7-28c2465ec98b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:56:23 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-1d8594a5-80fe-4f04-8dce-7528376f6dc5 tempest-VolumesSnapshotTestJSON-1095862726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01c899c4-f9e2-48a1-84f7-28c2465ec98b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab40c67a-3006-401d-aecd-dcf490c8c818', 'volume_name': 'volume-ab40c67a-3006-401d-aecd-dcf490c8c818', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:56:23 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-1d8594a5-80fe-4f04-8dce-7528376f6dc5 tempest-VolumesSnapshotTestJSON-1095862726 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3470cb78-e005-4c8a-83c7-f4101e617273) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:56:23 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-1d8594a5-80fe-4f04-8dce-7528376f6dc5 tempest-VolumesSnapshotTestJSON-1095862726 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3470cb78-e005-4c8a-83c7-f4101e617273) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:56:23 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-1d8594a5-80fe-4f04-8dce-7528376f6dc5 tempest-VolumesSnapshotTestJSON-1095862726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e377779-4ec1-4353-91e4-84dcb42ce17e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:56:23 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-1d8594a5-80fe-4f04-8dce-7528376f6dc5 tempest-VolumesSnapshotTestJSON-1095862726 None] Volume ab40c67a-3006-401d-aecd-dcf490c8c818: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab40c67a-3006-401d-aecd-dcf490c8c818', 'volume_size': 1}
Jul 02 19:56:23 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-1d8594a5-80fe-4f04-8dce-7528376f6dc5 tempest-VolumesSnapshotTestJSON-1095862726 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:56:23 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-1d8594a5-80fe-4f04-8dce-7528376f6dc5 tempest-VolumesSnapshotTestJSON-1095862726 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:56:23 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-1d8594a5-80fe-4f04-8dce-7528376f6dc5 tempest-VolumesSnapshotTestJSON-1095862726 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce906cb830>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T17:56:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-299859711',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab40c67a-3006-401d-aecd-dcf490c8c818,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='584113d73ad94c1aae6af613c9e6588d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T17:56:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T17:56:23Z,use_quota=True,user_id='401ac538758e424ca04e11fb9ee93d99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)}" {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 19:56:23 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-1d8594a5-80fe-4f04-8dce-7528376f6dc5 tempest-VolumesSnapshotTestJSON-1095862726 None] Creating volume ab40c67a-3006-401d-aecd-dcf490c8c818 {{(pid=86639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 19:56:23 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-1d8594a5-80fe-4f04-8dce-7528376f6dc5 tempest-VolumesSnapshotTestJSON-1095862726 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:56:23 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-1d8594a5-80fe-4f04-8dce-7528376f6dc5 tempest-VolumesSnapshotTestJSON-1095862726 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:56:23 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-1d8594a5-80fe-4f04-8dce-7528376f6dc5 tempest-VolumesSnapshotTestJSON-1095862726 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 19:56:23 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-1d8594a5-80fe-4f04-8dce-7528376f6dc5 tempest-VolumesSnapshotTestJSON-1095862726 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 19:56:23 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-1d8594a5-80fe-4f04-8dce-7528376f6dc5 tempest-VolumesSnapshotTestJSON-1095862726 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:56:23 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-1d8594a5-80fe-4f04-8dce-7528376f6dc5 tempest-VolumesSnapshotTestJSON-1095862726 None] Selected osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92 as target Quobyte volume. {{(pid=86639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 19:56:23 devstack cinder-volume[86639]: INFO cinder.volume.drivers.remotefs [None req-1d8594a5-80fe-4f04-8dce-7528376f6dc5 tempest-VolumesSnapshotTestJSON-1095862726 None] casted to osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92
Jul 02 19:56:23 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-1d8594a5-80fe-4f04-8dce-7528376f6dc5 tempest-VolumesSnapshotTestJSON-1095862726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-ab40c67a-3006-401d-aecd-dcf490c8c818 1073741824 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:56:23 devstack sudo[100496]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-ab40c67a-3006-401d-aecd-dcf490c8c818 1073741824
Jul 02 19:56:23 devstack sudo[100496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:56:23 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-a1d062f1-b271-49fd-a4d4-af89cb5bb97a tempest-SnapshotMetadataTestJSON-1248525638 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:56:24 devstack sudo[100496]: pam_unix(sudo:session): session closed for user root
Jul 02 19:56:24 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-1d8594a5-80fe-4f04-8dce-7528376f6dc5 tempest-VolumesSnapshotTestJSON-1095862726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-ab40c67a-3006-401d-aecd-dcf490c8c818 1073741824" returned: 0 in 1.170s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:56:24 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-1d8594a5-80fe-4f04-8dce-7528376f6dc5 tempest-VolumesSnapshotTestJSON-1095862726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-ab40c67a-3006-401d-aecd-dcf490c8c818 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:56:24 devstack sudo[100503]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-ab40c67a-3006-401d-aecd-dcf490c8c818
Jul 02 19:56:24 devstack sudo[100503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:56:25 devstack sudo[100503]: pam_unix(sudo:session): session closed for user root
Jul 02 19:56:25 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-1d8594a5-80fe-4f04-8dce-7528376f6dc5 tempest-VolumesSnapshotTestJSON-1095862726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-ab40c67a-3006-401d-aecd-dcf490c8c818" returned: 0 in 0.794s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:56:25 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-1d8594a5-80fe-4f04-8dce-7528376f6dc5 tempest-VolumesSnapshotTestJSON-1095862726 None] <== create_volume: return (2021ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'} {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 19:56:25 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-1d8594a5-80fe-4f04-8dce-7528376f6dc5 tempest-VolumesSnapshotTestJSON-1095862726 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.025s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:56:25 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-a1d062f1-b271-49fd-a4d4-af89cb5bb97a tempest-SnapshotMetadataTestJSON-1248525638 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.759s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:56:25 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-a1d062f1-b271-49fd-a4d4-af89cb5bb97a tempest-SnapshotMetadataTestJSON-1248525638 None] Creating offline snapshot 45d01bc8-8f0b-42f3-a9f6-8f0f67f0fe86 of volume 7cc5aac6-59d1-4a71-af2b-de795fc27af1 {{(pid=86639) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 02 19:56:25 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-1d8594a5-80fe-4f04-8dce-7528376f6dc5 tempest-VolumesSnapshotTestJSON-1095862726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e377779-4ec1-4353-91e4-84dcb42ce17e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab40c67a-3006-401d-aecd-dcf490c8c818', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:56:25 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-1d8594a5-80fe-4f04-8dce-7528376f6dc5 tempest-VolumesSnapshotTestJSON-1095862726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06bc977a-efa3-4da6-86f3-1291b843cbea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:56:25 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6e487ee-a465-4ec7-bba3-23ea7b7a9605]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 19:56:25 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-a1d062f1-b271-49fd-a4d4-af89cb5bb97a tempest-SnapshotMetadataTestJSON-1248525638 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-7cc5aac6-59d1-4a71-af2b-de795fc27af1 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:56:25 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-1d8594a5-80fe-4f04-8dce-7528376f6dc5 tempest-VolumesSnapshotTestJSON-1095862726 None] Volume volume-ab40c67a-3006-401d-aecd-dcf490c8c818 (ab40c67a-3006-401d-aecd-dcf490c8c818): created successfully
Jul 02 19:56:25 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-1d8594a5-80fe-4f04-8dce-7528376f6dc5 tempest-VolumesSnapshotTestJSON-1095862726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06bc977a-efa3-4da6-86f3-1291b843cbea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:56:25 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-1d8594a5-80fe-4f04-8dce-7528376f6dc5 tempest-VolumesSnapshotTestJSON-1095862726 None] Flow 'volume_create_manager' (3a2a5c2b-5d4b-4dad-993a-22f890971405) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 19:56:25 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-1d8594a5-80fe-4f04-8dce-7528376f6dc5 tempest-VolumesSnapshotTestJSON-1095862726 None] Created volume successfully.
Jul 02 19:56:25 devstack sudo[100509]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-7cc5aac6-59d1-4a71-af2b-de795fc27af1
Jul 02 19:56:25 devstack sudo[100509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:56:26 devstack sudo[100509]: pam_unix(sudo:session): session closed for user root
Jul 02 19:56:26 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-a1d062f1-b271-49fd-a4d4-af89cb5bb97a tempest-SnapshotMetadataTestJSON-1248525638 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-7cc5aac6-59d1-4a71-af2b-de795fc27af1" returned: 0 in 0.917s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:56:26 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-a1d062f1-b271-49fd-a4d4-af89cb5bb97a tempest-SnapshotMetadataTestJSON-1248525638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-7cc5aac6-59d1-4a71-af2b-de795fc27af1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-7cc5aac6-59d1-4a71-af2b-de795fc27af1.45d01bc8-8f0b-42f3-a9f6-8f0f67f0fe86 1G {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:56:26 devstack sudo[100514]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-7cc5aac6-59d1-4a71-af2b-de795fc27af1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-7cc5aac6-59d1-4a71-af2b-de795fc27af1.45d01bc8-8f0b-42f3-a9f6-8f0f67f0fe86 1G
Jul 02 19:56:26 devstack sudo[100514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:56:26 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-d749ed0c-8027-4737-88fc-34c3338a11ec tempest-VolumesSnapshotTestJSON-1095862726 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:56:27 devstack sudo[100514]: pam_unix(sudo:session): session closed for user root
Jul 02 19:56:27 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-a1d062f1-b271-49fd-a4d4-af89cb5bb97a tempest-SnapshotMetadataTestJSON-1248525638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-7cc5aac6-59d1-4a71-af2b-de795fc27af1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-7cc5aac6-59d1-4a71-af2b-de795fc27af1.45d01bc8-8f0b-42f3-a9f6-8f0f67f0fe86 1G" returned: 0 in 0.946s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:56:27 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-a1d062f1-b271-49fd-a4d4-af89cb5bb97a tempest-SnapshotMetadataTestJSON-1248525638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7cc5aac6-59d1-4a71-af2b-de795fc27af1 -F qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-7cc5aac6-59d1-4a71-af2b-de795fc27af1.45d01bc8-8f0b-42f3-a9f6-8f0f67f0fe86 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:56:27 devstack sudo[100521]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7cc5aac6-59d1-4a71-af2b-de795fc27af1 -F qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-7cc5aac6-59d1-4a71-af2b-de795fc27af1.45d01bc8-8f0b-42f3-a9f6-8f0f67f0fe86
Jul 02 19:56:27 devstack sudo[100521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:56:28 devstack sudo[100521]: pam_unix(sudo:session): session closed for user root
Jul 02 19:56:28 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-a1d062f1-b271-49fd-a4d4-af89cb5bb97a tempest-SnapshotMetadataTestJSON-1248525638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7cc5aac6-59d1-4a71-af2b-de795fc27af1 -F qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-7cc5aac6-59d1-4a71-af2b-de795fc27af1.45d01bc8-8f0b-42f3-a9f6-8f0f67f0fe86" returned: 0 in 0.828s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:56:28 devstack cinder-volume[86639]: WARNING cinder.volume.drivers.remotefs [None req-a1d062f1-b271-49fd-a4d4-af89cb5bb97a tempest-SnapshotMetadataTestJSON-1248525638 None] /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-7cc5aac6-59d1-4a71-af2b-de795fc27af1.45d01bc8-8f0b-42f3-a9f6-8f0f67f0fe86 is being set with open permissions: ugo+rw
Jul 02 19:56:28 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-a1d062f1-b271-49fd-a4d4-af89cb5bb97a tempest-SnapshotMetadataTestJSON-1248525638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-7cc5aac6-59d1-4a71-af2b-de795fc27af1.45d01bc8-8f0b-42f3-a9f6-8f0f67f0fe86 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:56:28 devstack sudo[100526]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-7cc5aac6-59d1-4a71-af2b-de795fc27af1.45d01bc8-8f0b-42f3-a9f6-8f0f67f0fe86
Jul 02 19:56:28 devstack sudo[100526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:56:29 devstack sudo[100526]: pam_unix(sudo:session): session closed for user root
Jul 02 19:56:29 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-a1d062f1-b271-49fd-a4d4-af89cb5bb97a tempest-SnapshotMetadataTestJSON-1248525638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-7cc5aac6-59d1-4a71-af2b-de795fc27af1.45d01bc8-8f0b-42f3-a9f6-8f0f67f0fe86" returned: 0 in 0.917s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:56:29 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-a1d062f1-b271-49fd-a4d4-af89cb5bb97a tempest-SnapshotMetadataTestJSON-1248525638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-7cc5aac6-59d1-4a71-af2b-de795fc27af1.info {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:56:29 devstack sudo[100563]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-7cc5aac6-59d1-4a71-af2b-de795fc27af1.info
Jul 02 19:56:29 devstack sudo[100563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:56:30 devstack sudo[100563]: pam_unix(sudo:session): session closed for user root
Jul 02 19:56:30 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-a1d062f1-b271-49fd-a4d4-af89cb5bb97a tempest-SnapshotMetadataTestJSON-1248525638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-7cc5aac6-59d1-4a71-af2b-de795fc27af1.info" returned: 0 in 0.840s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:56:30 devstack cinder-volume[86639]: WARNING cinder.volume.drivers.remotefs [None req-a1d062f1-b271-49fd-a4d4-af89cb5bb97a tempest-SnapshotMetadataTestJSON-1248525638 None] /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-7cc5aac6-59d1-4a71-af2b-de795fc27af1.info is being set with open permissions: ugo+rw
Jul 02 19:56:30 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-a1d062f1-b271-49fd-a4d4-af89cb5bb97a tempest-SnapshotMetadataTestJSON-1248525638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-7cc5aac6-59d1-4a71-af2b-de795fc27af1.info {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:56:30 devstack sudo[100569]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-7cc5aac6-59d1-4a71-af2b-de795fc27af1.info
Jul 02 19:56:30 devstack sudo[100569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:56:30 devstack sudo[100569]: pam_unix(sudo:session): session closed for user root
Jul 02 19:56:30 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-a1d062f1-b271-49fd-a4d4-af89cb5bb97a tempest-SnapshotMetadataTestJSON-1248525638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-7cc5aac6-59d1-4a71-af2b-de795fc27af1.info" returned: 0 in 0.664s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:56:30 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-a1d062f1-b271-49fd-a4d4-af89cb5bb97a tempest-SnapshotMetadataTestJSON-1248525638 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.281s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:56:30 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-d749ed0c-8027-4737-88fc-34c3338a11ec tempest-VolumesSnapshotTestJSON-1095862726 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.149s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:56:30 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-d749ed0c-8027-4737-88fc-34c3338a11ec tempest-VolumesSnapshotTestJSON-1095862726 None] Creating offline snapshot f402c3ca-068b-41e5-b2fe-167cea5968ed of volume ab40c67a-3006-401d-aecd-dcf490c8c818 {{(pid=86639) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 02 19:56:30 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-a1d062f1-b271-49fd-a4d4-af89cb5bb97a tempest-SnapshotMetadataTestJSON-1248525638 None] Create snapshot completed successfully
Jul 02 19:56:30 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3086d4d-5e1f-48fe-9b6f-541319686791]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 19:56:30 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-d749ed0c-8027-4737-88fc-34c3338a11ec tempest-VolumesSnapshotTestJSON-1095862726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-ab40c67a-3006-401d-aecd-dcf490c8c818 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:56:31 devstack sudo[100572]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-ab40c67a-3006-401d-aecd-dcf490c8c818
Jul 02 19:56:31 devstack sudo[100572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:56:31 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-d749ed0c-8027-4737-88fc-34c3338a11ec tempest-VolumesSnapshotTestJSON-1095862726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-ab40c67a-3006-401d-aecd-dcf490c8c818" returned: 0 in 0.969s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:56:31 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-d749ed0c-8027-4737-88fc-34c3338a11ec tempest-VolumesSnapshotTestJSON-1095862726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-ab40c67a-3006-401d-aecd-dcf490c8c818,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-ab40c67a-3006-401d-aecd-dcf490c8c818.f402c3ca-068b-41e5-b2fe-167cea5968ed 1G {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:56:31 devstack sudo[100572]: pam_unix(sudo:session): session closed for user root
Jul 02 19:56:31 devstack sudo[100577]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-ab40c67a-3006-401d-aecd-dcf490c8c818,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-ab40c67a-3006-401d-aecd-dcf490c8c818.f402c3ca-068b-41e5-b2fe-167cea5968ed 1G
Jul 02 19:56:31 devstack sudo[100577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:56:31 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-99fcf363-7cff-4789-b6ac-f1f57e4c19f9 tempest-SnapshotMetadataTestJSON-1248525638 None] Acquiring lock "cinder-45d01bc8-8f0b-42f3-a9f6-8f0f67f0fe86-delete_snapshot" by "delete_snapshot" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:56:32 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-99fcf363-7cff-4789-b6ac-f1f57e4c19f9 tempest-SnapshotMetadataTestJSON-1248525638 None] Lock "cinder-45d01bc8-8f0b-42f3-a9f6-8f0f67f0fe86-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:56:32 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-99fcf363-7cff-4789-b6ac-f1f57e4c19f9 tempest-SnapshotMetadataTestJSON-1248525638 None] Acquiring lock "cinder-quobyte-7cc5aac6-59d1-4a71-af2b-de795fc27af1" by "delete_snapshot" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:56:32 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-99fcf363-7cff-4789-b6ac-f1f57e4c19f9 tempest-SnapshotMetadataTestJSON-1248525638 None] Lock "cinder-quobyte-7cc5aac6-59d1-4a71-af2b-de795fc27af1" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:56:32 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-99fcf363-7cff-4789-b6ac-f1f57e4c19f9 tempest-SnapshotMetadataTestJSON-1248525638 None] Acquiring lock "cinder-quobyte-45d01bc8-8f0b-42f3-a9f6-8f0f67f0fe86" by "_delete_snapshot" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:56:32 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-99fcf363-7cff-4789-b6ac-f1f57e4c19f9 tempest-SnapshotMetadataTestJSON-1248525638 None] Lock "cinder-quobyte-45d01bc8-8f0b-42f3-a9f6-8f0f67f0fe86" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:56:32 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-99fcf363-7cff-4789-b6ac-f1f57e4c19f9 tempest-SnapshotMetadataTestJSON-1248525638 None] Deleting offline snapshot 45d01bc8-8f0b-42f3-a9f6-8f0f67f0fe86 of volume 7cc5aac6-59d1-4a71-af2b-de795fc27af1 {{(pid=86639) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 02 19:56:32 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-99fcf363-7cff-4789-b6ac-f1f57e4c19f9 tempest-SnapshotMetadataTestJSON-1248525638 None] snapshot_file for this snap is: volume-7cc5aac6-59d1-4a71-af2b-de795fc27af1.45d01bc8-8f0b-42f3-a9f6-8f0f67f0fe86 {{(pid=86639) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 02 19:56:32 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[82534d39-a82a-4ea1-8897-6ab356e2f889]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 19:56:32 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-99fcf363-7cff-4789-b6ac-f1f57e4c19f9 tempest-SnapshotMetadataTestJSON-1248525638 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-7cc5aac6-59d1-4a71-af2b-de795fc27af1.45d01bc8-8f0b-42f3-a9f6-8f0f67f0fe86 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:56:32 devstack sudo[100579]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-7cc5aac6-59d1-4a71-af2b-de795fc27af1.45d01bc8-8f0b-42f3-a9f6-8f0f67f0fe86
Jul 02 19:56:32 devstack sudo[100579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:56:32 devstack sudo[100577]: pam_unix(sudo:session): session closed for user root
Jul 02 19:56:32 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-d749ed0c-8027-4737-88fc-34c3338a11ec tempest-VolumesSnapshotTestJSON-1095862726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-ab40c67a-3006-401d-aecd-dcf490c8c818,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-ab40c67a-3006-401d-aecd-dcf490c8c818.f402c3ca-068b-41e5-b2fe-167cea5968ed 1G" returned: 0 in 0.885s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:56:32 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-d749ed0c-8027-4737-88fc-34c3338a11ec tempest-VolumesSnapshotTestJSON-1095862726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab40c67a-3006-401d-aecd-dcf490c8c818 -F qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-ab40c67a-3006-401d-aecd-dcf490c8c818.f402c3ca-068b-41e5-b2fe-167cea5968ed {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:56:32 devstack sudo[100586]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab40c67a-3006-401d-aecd-dcf490c8c818 -F qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-ab40c67a-3006-401d-aecd-dcf490c8c818.f402c3ca-068b-41e5-b2fe-167cea5968ed
Jul 02 19:56:32 devstack sudo[100586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:56:32 devstack sudo[100579]: pam_unix(sudo:session): session closed for user root
Jul 02 19:56:32 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-99fcf363-7cff-4789-b6ac-f1f57e4c19f9 tempest-SnapshotMetadataTestJSON-1248525638 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-7cc5aac6-59d1-4a71-af2b-de795fc27af1.45d01bc8-8f0b-42f3-a9f6-8f0f67f0fe86" returned: 0 in 0.788s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:56:32 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-99fcf363-7cff-4789-b6ac-f1f57e4c19f9 tempest-SnapshotMetadataTestJSON-1248525638 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7cc5aac6-59d1-4a71-af2b-de795fc27af1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86639) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 02 19:56:32 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9a2b895-f678-49b2-ad39-fef3d32a1255]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 19:56:32 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-99fcf363-7cff-4789-b6ac-f1f57e4c19f9 tempest-SnapshotMetadataTestJSON-1248525638 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-7cc5aac6-59d1-4a71-af2b-de795fc27af1 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:56:33 devstack sudo[100591]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-7cc5aac6-59d1-4a71-af2b-de795fc27af1
Jul 02 19:56:33 devstack sudo[100591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:56:33 devstack sudo[100586]: pam_unix(sudo:session): session closed for user root
Jul 02 19:56:33 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-d749ed0c-8027-4737-88fc-34c3338a11ec tempest-VolumesSnapshotTestJSON-1095862726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab40c67a-3006-401d-aecd-dcf490c8c818 -F qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-ab40c67a-3006-401d-aecd-dcf490c8c818.f402c3ca-068b-41e5-b2fe-167cea5968ed" returned: 0 in 0.762s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:56:33 devstack cinder-volume[86639]: WARNING cinder.volume.drivers.remotefs [None req-d749ed0c-8027-4737-88fc-34c3338a11ec tempest-VolumesSnapshotTestJSON-1095862726 None] /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-ab40c67a-3006-401d-aecd-dcf490c8c818.f402c3ca-068b-41e5-b2fe-167cea5968ed is being set with open permissions: ugo+rw
Jul 02 19:56:33 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-d749ed0c-8027-4737-88fc-34c3338a11ec tempest-VolumesSnapshotTestJSON-1095862726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-ab40c67a-3006-401d-aecd-dcf490c8c818.f402c3ca-068b-41e5-b2fe-167cea5968ed {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:56:33 devstack sudo[100601]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-ab40c67a-3006-401d-aecd-dcf490c8c818.f402c3ca-068b-41e5-b2fe-167cea5968ed
Jul 02 19:56:33 devstack sudo[100601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:56:33 devstack sudo[100591]: pam_unix(sudo:session): session closed for user root
Jul 02 19:56:33 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-99fcf363-7cff-4789-b6ac-f1f57e4c19f9 tempest-SnapshotMetadataTestJSON-1248525638 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-7cc5aac6-59d1-4a71-af2b-de795fc27af1" returned: 0 in 0.873s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:56:33 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-99fcf363-7cff-4789-b6ac-f1f57e4c19f9 tempest-SnapshotMetadataTestJSON-1248525638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-7cc5aac6-59d1-4a71-af2b-de795fc27af1.45d01bc8-8f0b-42f3-a9f6-8f0f67f0fe86 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:56:33 devstack sudo[100607]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-7cc5aac6-59d1-4a71-af2b-de795fc27af1.45d01bc8-8f0b-42f3-a9f6-8f0f67f0fe86
Jul 02 19:56:33 devstack sudo[100607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:56:34 devstack sudo[100601]: pam_unix(sudo:session): session closed for user root
Jul 02 19:56:34 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-d749ed0c-8027-4737-88fc-34c3338a11ec tempest-VolumesSnapshotTestJSON-1095862726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-ab40c67a-3006-401d-aecd-dcf490c8c818.f402c3ca-068b-41e5-b2fe-167cea5968ed" returned: 0 in 0.728s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:56:34 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-d749ed0c-8027-4737-88fc-34c3338a11ec tempest-VolumesSnapshotTestJSON-1095862726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-ab40c67a-3006-401d-aecd-dcf490c8c818.info {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:56:34 devstack sudo[100610]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-ab40c67a-3006-401d-aecd-dcf490c8c818.info
Jul 02 19:56:34 devstack sudo[100610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:56:34 devstack sudo[100607]: pam_unix(sudo:session): session closed for user root
Jul 02 19:56:34 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-99fcf363-7cff-4789-b6ac-f1f57e4c19f9 tempest-SnapshotMetadataTestJSON-1248525638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-7cc5aac6-59d1-4a71-af2b-de795fc27af1.45d01bc8-8f0b-42f3-a9f6-8f0f67f0fe86" returned: 0 in 0.901s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:56:34 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-99fcf363-7cff-4789-b6ac-f1f57e4c19f9 tempest-SnapshotMetadataTestJSON-1248525638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-7cc5aac6-59d1-4a71-af2b-de795fc27af1.45d01bc8-8f0b-42f3-a9f6-8f0f67f0fe86 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:56:34 devstack sudo[100616]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-7cc5aac6-59d1-4a71-af2b-de795fc27af1.45d01bc8-8f0b-42f3-a9f6-8f0f67f0fe86
Jul 02 19:56:34 devstack sudo[100616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:56:35 devstack sudo[100610]: pam_unix(sudo:session): session closed for user root
Jul 02 19:56:35 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-d749ed0c-8027-4737-88fc-34c3338a11ec tempest-VolumesSnapshotTestJSON-1095862726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-ab40c67a-3006-401d-aecd-dcf490c8c818.info" returned: 0 in 0.788s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:56:35 devstack cinder-volume[86639]: WARNING cinder.volume.drivers.remotefs [None req-d749ed0c-8027-4737-88fc-34c3338a11ec tempest-VolumesSnapshotTestJSON-1095862726 None] /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-ab40c67a-3006-401d-aecd-dcf490c8c818.info is being set with open permissions: ugo+rw
Jul 02 19:56:35 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-d749ed0c-8027-4737-88fc-34c3338a11ec tempest-VolumesSnapshotTestJSON-1095862726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-ab40c67a-3006-401d-aecd-dcf490c8c818.info {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:56:35 devstack sudo[100619]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-ab40c67a-3006-401d-aecd-dcf490c8c818.info
Jul 02 19:56:35 devstack sudo[100619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:56:35 devstack sudo[100616]: pam_unix(sudo:session): session closed for user root
Jul 02 19:56:35 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-99fcf363-7cff-4789-b6ac-f1f57e4c19f9 tempest-SnapshotMetadataTestJSON-1248525638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-7cc5aac6-59d1-4a71-af2b-de795fc27af1.45d01bc8-8f0b-42f3-a9f6-8f0f67f0fe86" returned: 0 in 0.779s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:56:35 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-99fcf363-7cff-4789-b6ac-f1f57e4c19f9 tempest-SnapshotMetadataTestJSON-1248525638 None] Lock "cinder-quobyte-45d01bc8-8f0b-42f3-a9f6-8f0f67f0fe86" released by "_delete_snapshot" :: held 3.472s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:56:35 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-99fcf363-7cff-4789-b6ac-f1f57e4c19f9 tempest-SnapshotMetadataTestJSON-1248525638 None] Lock "cinder-quobyte-7cc5aac6-59d1-4a71-af2b-de795fc27af1" released by "delete_snapshot" :: held 3.501s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:56:35 devstack cinder-volume[86639]: DEBUG cinder.quota [None req-99fcf363-7cff-4789-b6ac-f1f57e4c19f9 tempest-SnapshotMetadataTestJSON-1248525638 None] Created reservations ['b647d50e-1f50-4ece-ae0f-8b82e0054e2e', 'fdda147d-e1e6-443a-ad00-c88c0f4fe05c', '09c2dccc-7825-42ba-bb8f-667bdd97b4f3', 'd3f5c29d-4250-4840-8fac-e3eba1db64b9'] {{(pid=86639) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 19:56:35 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-99fcf363-7cff-4789-b6ac-f1f57e4c19f9 tempest-SnapshotMetadataTestJSON-1248525638 None] Delete snapshot completed successfully.
Jul 02 19:56:35 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-99fcf363-7cff-4789-b6ac-f1f57e4c19f9 tempest-SnapshotMetadataTestJSON-1248525638 None] Lock "cinder-45d01bc8-8f0b-42f3-a9f6-8f0f67f0fe86-delete_snapshot" released by "delete_snapshot" :: held 3.701s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:56:35 devstack sudo[100619]: pam_unix(sudo:session): session closed for user root
Jul 02 19:56:35 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-d749ed0c-8027-4737-88fc-34c3338a11ec tempest-VolumesSnapshotTestJSON-1095862726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-ab40c67a-3006-401d-aecd-dcf490c8c818.info" returned: 0 in 0.760s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:56:35 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-d749ed0c-8027-4737-88fc-34c3338a11ec tempest-VolumesSnapshotTestJSON-1095862726 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.023s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:56:35 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-d749ed0c-8027-4737-88fc-34c3338a11ec tempest-VolumesSnapshotTestJSON-1095862726 None] Create snapshot completed successfully
Jul 02 19:56:36 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-d36f1df1-f45c-4650-97b4-90aed4762988 tempest-SnapshotMetadataTestJSON-1248525638 None] Acquiring lock "cinder-7cc5aac6-59d1-4a71-af2b-de795fc27af1-delete_volume" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:56:36 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-d36f1df1-f45c-4650-97b4-90aed4762988 tempest-SnapshotMetadataTestJSON-1248525638 None] Lock "cinder-7cc5aac6-59d1-4a71-af2b-de795fc27af1-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:56:36 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-d36f1df1-f45c-4650-97b4-90aed4762988 tempest-SnapshotMetadataTestJSON-1248525638 None] Acquiring lock "cinder-quobyte-7cc5aac6-59d1-4a71-af2b-de795fc27af1" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:56:36 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-d36f1df1-f45c-4650-97b4-90aed4762988 tempest-SnapshotMetadataTestJSON-1248525638 None] Lock "cinder-quobyte-7cc5aac6-59d1-4a71-af2b-de795fc27af1" acquired by "delete_volume" :: waited 0.019s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:56:36 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[383bbaca-5df7-4d72-9e8d-d624a86c50df]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 19:56:36 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-d36f1df1-f45c-4650-97b4-90aed4762988 tempest-SnapshotMetadataTestJSON-1248525638 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-7cc5aac6-59d1-4a71-af2b-de795fc27af1 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:56:36 devstack sudo[100625]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-7cc5aac6-59d1-4a71-af2b-de795fc27af1
Jul 02 19:56:36 devstack sudo[100625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:56:36 devstack cinder-volume[86639]: DEBUG cinder.volume.flows.manager.create_volume [None req-674c7355-1438-4b62-8bb3-68a39fb34a83 tempest-VolumesSnapshotTestJSON-1095862726 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 19:56:36 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-674c7355-1438-4b62-8bb3-68a39fb34a83 tempest-VolumesSnapshotTestJSON-1095862726 None] Flow 'volume_create_manager' (1e5b8778-c041-4c8d-9c0e-43face005d99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 19:56:36 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-674c7355-1438-4b62-8bb3-68a39fb34a83 tempest-VolumesSnapshotTestJSON-1095862726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e06a65c0-6928-47b2-8a50-edb11945d3ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:56:36 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-674c7355-1438-4b62-8bb3-68a39fb34a83 tempest-VolumesSnapshotTestJSON-1095862726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e06a65c0-6928-47b2-8a50-edb11945d3ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T17:56:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-359283395',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7463e6c8-1f48-4818-b4ee-f0666ebb3739,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='584113d73ad94c1aae6af613c9e6588d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T17:56:37Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=f402c3ca-068b-41e5-b2fe-167cea5968ed,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T17:56:37Z,use_quota=True,user_id='401ac538758e424ca04e11fb9ee93d99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:56:36 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-674c7355-1438-4b62-8bb3-68a39fb34a83 tempest-VolumesSnapshotTestJSON-1095862726 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7cb0b336-ba82-439c-9804-bdc03bb89cf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:56:36 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-674c7355-1438-4b62-8bb3-68a39fb34a83 tempest-VolumesSnapshotTestJSON-1095862726 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7cb0b336-ba82-439c-9804-bdc03bb89cf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:56:36 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-674c7355-1438-4b62-8bb3-68a39fb34a83 tempest-VolumesSnapshotTestJSON-1095862726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46add385-6458-4a16-b9c6-7b53fa97446f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:56:36 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-674c7355-1438-4b62-8bb3-68a39fb34a83 tempest-VolumesSnapshotTestJSON-1095862726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46add385-6458-4a16-b9c6-7b53fa97446f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '7463e6c8-1f48-4818-b4ee-f0666ebb3739', 'volume_name': 'volume-7463e6c8-1f48-4818-b4ee-f0666ebb3739', 'volume_size': 2, 'snapshot_id': 'f402c3ca-068b-41e5-b2fe-167cea5968ed'}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:56:36 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-674c7355-1438-4b62-8bb3-68a39fb34a83 tempest-VolumesSnapshotTestJSON-1095862726 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (652e8dc1-1a27-444e-b1af-757ede2e117b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:56:36 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-674c7355-1438-4b62-8bb3-68a39fb34a83 tempest-VolumesSnapshotTestJSON-1095862726 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (652e8dc1-1a27-444e-b1af-757ede2e117b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:56:36 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-674c7355-1438-4b62-8bb3-68a39fb34a83 tempest-VolumesSnapshotTestJSON-1095862726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70650c1b-501b-471f-b3f2-499a2552268c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:56:36 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-674c7355-1438-4b62-8bb3-68a39fb34a83 tempest-VolumesSnapshotTestJSON-1095862726 None] Volume 7463e6c8-1f48-4818-b4ee-f0666ebb3739: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-7463e6c8-1f48-4818-b4ee-f0666ebb3739', 'volume_size': 2, 'snapshot_id': 'f402c3ca-068b-41e5-b2fe-167cea5968ed'}
Jul 02 19:56:36 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-674c7355-1438-4b62-8bb3-68a39fb34a83 tempest-VolumesSnapshotTestJSON-1095862726 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:56:36 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-674c7355-1438-4b62-8bb3-68a39fb34a83 tempest-VolumesSnapshotTestJSON-1095862726 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:56:36 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-674c7355-1438-4b62-8bb3-68a39fb34a83 tempest-VolumesSnapshotTestJSON-1095862726 None] Acquiring lock "cinder-quobyte-f402c3ca-068b-41e5-b2fe-167cea5968ed-7463e6c8-1f48-4818-b4ee-f0666ebb3739" by "_create_volume_from_snapshot" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:56:36 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-674c7355-1438-4b62-8bb3-68a39fb34a83 tempest-VolumesSnapshotTestJSON-1095862726 None] Lock "cinder-quobyte-f402c3ca-068b-41e5-b2fe-167cea5968ed-7463e6c8-1f48-4818-b4ee-f0666ebb3739" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:56:36 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-674c7355-1438-4b62-8bb3-68a39fb34a83 tempest-VolumesSnapshotTestJSON-1095862726 None] Creating volume 7463e6c8-1f48-4818-b4ee-f0666ebb3739 from snapshot f402c3ca-068b-41e5-b2fe-167cea5968ed {{(pid=86639) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jul 02 19:56:36 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-674c7355-1438-4b62-8bb3-68a39fb34a83 tempest-VolumesSnapshotTestJSON-1095862726 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:56:36 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-674c7355-1438-4b62-8bb3-68a39fb34a83 tempest-VolumesSnapshotTestJSON-1095862726 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:56:36 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-674c7355-1438-4b62-8bb3-68a39fb34a83 tempest-VolumesSnapshotTestJSON-1095862726 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 19:56:36 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-674c7355-1438-4b62-8bb3-68a39fb34a83 tempest-VolumesSnapshotTestJSON-1095862726 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 19:56:36 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-674c7355-1438-4b62-8bb3-68a39fb34a83 tempest-VolumesSnapshotTestJSON-1095862726 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:56:36 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-674c7355-1438-4b62-8bb3-68a39fb34a83 tempest-VolumesSnapshotTestJSON-1095862726 None] Selected osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92 as target Quobyte volume. {{(pid=86639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 19:56:36 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-674c7355-1438-4b62-8bb3-68a39fb34a83 tempest-VolumesSnapshotTestJSON-1095862726 None] Acquiring lock "cinder-quobyte-7463e6c8-1f48-4818-b4ee-f0666ebb3739" by "_copy_volume_from_snapshot" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:56:36 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-674c7355-1438-4b62-8bb3-68a39fb34a83 tempest-VolumesSnapshotTestJSON-1095862726 None] Lock "cinder-quobyte-7463e6c8-1f48-4818-b4ee-f0666ebb3739" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:56:36 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-674c7355-1438-4b62-8bb3-68a39fb34a83 tempest-VolumesSnapshotTestJSON-1095862726 None] snapshot: f402c3ca-068b-41e5-b2fe-167cea5968ed, volume: 7463e6c8-1f48-4818-b4ee-f0666ebb3739,  {{(pid=86639) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jul 02 19:56:37 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-674c7355-1438-4b62-8bb3-68a39fb34a83 tempest-VolumesSnapshotTestJSON-1095862726 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:56:37 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-674c7355-1438-4b62-8bb3-68a39fb34a83 tempest-VolumesSnapshotTestJSON-1095862726 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:56:37 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-674c7355-1438-4b62-8bb3-68a39fb34a83 tempest-VolumesSnapshotTestJSON-1095862726 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 19:56:37 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-674c7355-1438-4b62-8bb3-68a39fb34a83 tempest-VolumesSnapshotTestJSON-1095862726 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 19:56:37 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-674c7355-1438-4b62-8bb3-68a39fb34a83 tempest-VolumesSnapshotTestJSON-1095862726 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:56:37 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[97651fe1-b2e5-432b-ba18-40e55ecbc380]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 19:56:37 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-674c7355-1438-4b62-8bb3-68a39fb34a83 tempest-VolumesSnapshotTestJSON-1095862726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-ab40c67a-3006-401d-aecd-dcf490c8c818.f402c3ca-068b-41e5-b2fe-167cea5968ed {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:56:37 devstack sudo[100627]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-ab40c67a-3006-401d-aecd-dcf490c8c818.f402c3ca-068b-41e5-b2fe-167cea5968ed
Jul 02 19:56:37 devstack sudo[100627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:56:37 devstack sudo[100625]: pam_unix(sudo:session): session closed for user root
Jul 02 19:56:37 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-d36f1df1-f45c-4650-97b4-90aed4762988 tempest-SnapshotMetadataTestJSON-1248525638 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-7cc5aac6-59d1-4a71-af2b-de795fc27af1" returned: 0 in 0.891s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:56:37 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-d36f1df1-f45c-4650-97b4-90aed4762988 tempest-SnapshotMetadataTestJSON-1248525638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-7cc5aac6-59d1-4a71-af2b-de795fc27af1 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:56:37 devstack sudo[100632]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-7cc5aac6-59d1-4a71-af2b-de795fc27af1
Jul 02 19:56:37 devstack sudo[100632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:56:37 devstack sudo[100627]: pam_unix(sudo:session): session closed for user root
Jul 02 19:56:37 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-674c7355-1438-4b62-8bb3-68a39fb34a83 tempest-VolumesSnapshotTestJSON-1095862726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-ab40c67a-3006-401d-aecd-dcf490c8c818.f402c3ca-068b-41e5-b2fe-167cea5968ed" returned: 0 in 0.861s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:56:37 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-674c7355-1438-4b62-8bb3-68a39fb34a83 tempest-VolumesSnapshotTestJSON-1095862726 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ab40c67a-3006-401d-aecd-dcf490c8c818(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86639) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 02 19:56:37 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-674c7355-1438-4b62-8bb3-68a39fb34a83 tempest-VolumesSnapshotTestJSON-1095862726 None] will copy from snapshot at /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-ab40c67a-3006-401d-aecd-dcf490c8c818 {{(pid=86639) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jul 02 19:56:37 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-674c7355-1438-4b62-8bb3-68a39fb34a83 tempest-VolumesSnapshotTestJSON-1095862726 None] Creating direct copy from snapshot {{(pid=86639) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jul 02 19:56:37 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[405e351f-073f-4a41-a1a2-e91691513e27]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 19:56:37 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-674c7355-1438-4b62-8bb3-68a39fb34a83 tempest-VolumesSnapshotTestJSON-1095862726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-ab40c67a-3006-401d-aecd-dcf490c8c818 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:56:38 devstack sudo[100637]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-ab40c67a-3006-401d-aecd-dcf490c8c818
Jul 02 19:56:38 devstack sudo[100637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:56:38 devstack sudo[100632]: pam_unix(sudo:session): session closed for user root
Jul 02 19:56:38 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-d36f1df1-f45c-4650-97b4-90aed4762988 tempest-SnapshotMetadataTestJSON-1248525638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-7cc5aac6-59d1-4a71-af2b-de795fc27af1" returned: 0 in 0.705s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:56:38 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-d36f1df1-f45c-4650-97b4-90aed4762988 tempest-SnapshotMetadataTestJSON-1248525638 None] Lock "cinder-quobyte-7cc5aac6-59d1-4a71-af2b-de795fc27af1" released by "delete_volume" :: held 1.690s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:56:38 devstack cinder-volume[86639]: DEBUG cinder.quota [None req-d36f1df1-f45c-4650-97b4-90aed4762988 tempest-SnapshotMetadataTestJSON-1248525638 None] Created reservations ['2e8253ce-630a-4ab9-929a-862482fdbbbd', 'db6a1087-0fb2-4eaf-92fc-7a267ff14050', 'e82fe1d8-9780-4bd5-8fc3-425c82e7ab3c', '78b5c50a-208a-41fd-9f65-265faf3b17a4'] {{(pid=86639) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 19:56:38 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-d36f1df1-f45c-4650-97b4-90aed4762988 tempest-SnapshotMetadataTestJSON-1248525638 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:56:38 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-d36f1df1-f45c-4650-97b4-90aed4762988 tempest-SnapshotMetadataTestJSON-1248525638 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:56:38 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-d36f1df1-f45c-4650-97b4-90aed4762988 tempest-SnapshotMetadataTestJSON-1248525638 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 19:56:38 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-d36f1df1-f45c-4650-97b4-90aed4762988 tempest-SnapshotMetadataTestJSON-1248525638 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 19:56:38 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-d36f1df1-f45c-4650-97b4-90aed4762988 tempest-SnapshotMetadataTestJSON-1248525638 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:56:38 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-d36f1df1-f45c-4650-97b4-90aed4762988 tempest-SnapshotMetadataTestJSON-1248525638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:56:38 devstack sudo[100640]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e
Jul 02 19:56:38 devstack sudo[100640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:56:39 devstack sudo[100637]: pam_unix(sudo:session): session closed for user root
Jul 02 19:56:39 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-674c7355-1438-4b62-8bb3-68a39fb34a83 tempest-VolumesSnapshotTestJSON-1095862726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-ab40c67a-3006-401d-aecd-dcf490c8c818" returned: 0 in 1.202s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:56:39 devstack cinder-volume[86639]: DEBUG cinder.utils [None req-674c7355-1438-4b62-8bb3-68a39fb34a83 tempest-VolumesSnapshotTestJSON-1095862726 None] Path /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-7463e6c8-1f48-4818-b4ee-f0666ebb3739 not found in is_blk_device check {{(pid=86639) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 02 19:56:39 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-674c7355-1438-4b62-8bb3-68a39fb34a83 tempest-VolumesSnapshotTestJSON-1095862726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-ab40c67a-3006-401d-aecd-dcf490c8c818 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-7463e6c8-1f48-4818-b4ee-f0666ebb3739 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:56:39 devstack sudo[100646]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-ab40c67a-3006-401d-aecd-dcf490c8c818 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-7463e6c8-1f48-4818-b4ee-f0666ebb3739
Jul 02 19:56:39 devstack sudo[100646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:56:39 devstack sudo[100640]: pam_unix(sudo:session): session closed for user root
Jul 02 19:56:39 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-d36f1df1-f45c-4650-97b4-90aed4762988 tempest-SnapshotMetadataTestJSON-1248525638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e" returned: 0 in 0.970s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:56:39 devstack cinder-volume[86639]: DEBUG cinder.manager [None req-d36f1df1-f45c-4650-97b4-90aed4762988 tempest-SnapshotMetadataTestJSON-1248525638 None] Notifying Schedulers of capabilities ... {{(pid=86639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 19:56:39 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-d36f1df1-f45c-4650-97b4-90aed4762988 tempest-SnapshotMetadataTestJSON-1248525638 None] Deleted volume successfully.
Jul 02 19:56:39 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-d36f1df1-f45c-4650-97b4-90aed4762988 tempest-SnapshotMetadataTestJSON-1248525638 None] Lock "cinder-7cc5aac6-59d1-4a71-af2b-de795fc27af1-delete_volume" released by "delete_volume" :: held 2.911s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:56:41 devstack cinder-volume[86639]: DEBUG oslo_service.periodic_task [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86639) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 02 19:56:41 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:56:41 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:56:41 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 19:56:41 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 19:56:41 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:56:41 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:56:41 devstack sudo[100659]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e
Jul 02 19:56:41 devstack sudo[100659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:56:44 devstack sudo[100659]: pam_unix(sudo:session): session closed for user root
Jul 02 19:56:44 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e" returned: 0 in 2.664s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:56:44 devstack cinder-volume[86639]: DEBUG cinder.manager [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] Notifying Schedulers of capabilities ... {{(pid=86639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 19:56:44 devstack cinder-volume[86639]: DEBUG oslo_service.periodic_task [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] Running periodic task VolumeManager._thread_info {{(pid=86639) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 02 19:56:44 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] thread count: 28 {{(pid=86639) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 02 19:56:44 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] thread info: [<_MainThread(MainThread, started 140525261275264)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 140525150678016)>, <Thread(Thread-3 (stat_writer), started daemon 140525150025920)>, <Thread(Rabbit-heartbeat, started daemon 140525150500864)>, <Thread(Thread-5 (_runner), started daemon 140525149847296)>, <Thread(Thread-7 (_runner), started daemon 140525149863424)>, <Thread(fd_logger, started daemon 140525146589376)>, <Thread(privsep_reader, started daemon 140525144562432)>, <Thread(tpool_thread_0, started daemon 140525137151680)>, <Thread(tpool_thread_1, started daemon 140525128758976)>, <Thread(tpool_thread_2, started daemon 140525120349888)>, <Thread(tpool_thread_3, started daemon 140525111940800)>, <Thread(tpool_thread_4, started daemon 140525103531712)>, <Thread(tpool_thread_5, started daemon 140525095122624)>, <Thread(tpool_thread_6, started daemon 140525086713536)>, <Thread(tpool_thread_7, started daemon 140525078304448)>, <Thread(tpool_thread_8, started daemon 140525069895360)>, <Thread(tpool_thread_9, started daemon 140525061486272)>, <Thread(tpool_thread_10, started daemon 140525053077184)>, <Thread(tpool_thread_11, started daemon 140525044668096)>, <Thread(tpool_thread_12, started daemon 140525036259008)>, <Thread(tpool_thread_13, started daemon 140525027849920)>, <Thread(tpool_thread_14, started daemon 140525019440832)>, <Thread(tpool_thread_15, started daemon 140525011031744)>, <Thread(tpool_thread_16, started daemon 140525002622656)>, <Thread(tpool_thread_17, started daemon 140524994213568)>, <Thread(tpool_thread_18, started daemon 140524985804480)>, <Thread(tpool_thread_19, started daemon 140524977395392)>] {{(pid=86639) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 02 19:56:45 devstack sudo[100646]: pam_unix(sudo:session): session closed for user root
Jul 02 19:56:45 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-674c7355-1438-4b62-8bb3-68a39fb34a83 tempest-VolumesSnapshotTestJSON-1095862726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-ab40c67a-3006-401d-aecd-dcf490c8c818 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-7463e6c8-1f48-4818-b4ee-f0666ebb3739" returned: 0 in 6.711s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:56:45 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[f95e384e-a229-47ee-83bf-ae177977471f]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 19:56:45 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-674c7355-1438-4b62-8bb3-68a39fb34a83 tempest-VolumesSnapshotTestJSON-1095862726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-ab40c67a-3006-401d-aecd-dcf490c8c818 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:56:45 devstack sudo[100663]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-ab40c67a-3006-401d-aecd-dcf490c8c818
Jul 02 19:56:45 devstack sudo[100663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:56:46 devstack sudo[100663]: pam_unix(sudo:session): session closed for user root
Jul 02 19:56:46 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-674c7355-1438-4b62-8bb3-68a39fb34a83 tempest-VolumesSnapshotTestJSON-1095862726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-ab40c67a-3006-401d-aecd-dcf490c8c818" returned: 0 in 1.051s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:56:46 devstack cinder-volume[86639]: DEBUG cinder.image.image_utils [None req-674c7355-1438-4b62-8bb3-68a39fb34a83 tempest-VolumesSnapshotTestJSON-1095862726 None] Image conversion details: src /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-ab40c67a-3006-401d-aecd-dcf490c8c818, size 1024.00 MB, duration 6.71 sec, destination /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-7463e6c8-1f48-4818-b4ee-f0666ebb3739 {{(pid=86639) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 02 19:56:46 devstack cinder-volume[86639]: INFO cinder.image.image_utils [None req-674c7355-1438-4b62-8bb3-68a39fb34a83 tempest-VolumesSnapshotTestJSON-1095862726 None] Converted 1024.00 MB image at 152.55 MB/s
Jul 02 19:56:46 devstack cinder-volume[86639]: WARNING cinder.volume.drivers.remotefs [None req-674c7355-1438-4b62-8bb3-68a39fb34a83 tempest-VolumesSnapshotTestJSON-1095862726 None] /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-7463e6c8-1f48-4818-b4ee-f0666ebb3739 is being set with open permissions: ugo+rw
Jul 02 19:56:46 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-674c7355-1438-4b62-8bb3-68a39fb34a83 tempest-VolumesSnapshotTestJSON-1095862726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-7463e6c8-1f48-4818-b4ee-f0666ebb3739 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:56:46 devstack sudo[100668]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-7463e6c8-1f48-4818-b4ee-f0666ebb3739
Jul 02 19:56:46 devstack sudo[100668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:56:47 devstack cinder-volume[86639]: DEBUG cinder.volume.flows.manager.create_volume [None req-296a2c5b-b5e4-42aa-b5ad-5c1c9ef16f2a tempest-VolumesTransfersTest-150813858 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 19:56:47 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-296a2c5b-b5e4-42aa-b5ad-5c1c9ef16f2a tempest-VolumesTransfersTest-150813858 None] Flow 'volume_create_manager' (7009cd76-841c-449d-9e54-b80999dee068) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 19:56:47 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-296a2c5b-b5e4-42aa-b5ad-5c1c9ef16f2a tempest-VolumesTransfersTest-150813858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4067083f-c88e-4627-aaaa-ed72f90b8aec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:56:47 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-296a2c5b-b5e4-42aa-b5ad-5c1c9ef16f2a tempest-VolumesTransfersTest-150813858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4067083f-c88e-4627-aaaa-ed72f90b8aec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T17:56:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1470519809',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fec4d2a7-b552-4e24-a406-66af899f046b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1a02b3707cd4dad9223c567a9497f36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T17:56:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T17:56:47Z,use_quota=True,user_id='f6c7aa6eccda4938b071ac8c5687500f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:56:47 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-296a2c5b-b5e4-42aa-b5ad-5c1c9ef16f2a tempest-VolumesTransfersTest-150813858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4687af0-0cd0-4f69-99b2-463a416f2707) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:56:47 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-296a2c5b-b5e4-42aa-b5ad-5c1c9ef16f2a tempest-VolumesTransfersTest-150813858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4687af0-0cd0-4f69-99b2-463a416f2707) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:56:47 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-296a2c5b-b5e4-42aa-b5ad-5c1c9ef16f2a tempest-VolumesTransfersTest-150813858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18304ab3-8b25-4080-89cb-e5abdf0c38b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:56:47 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-296a2c5b-b5e4-42aa-b5ad-5c1c9ef16f2a tempest-VolumesTransfersTest-150813858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18304ab3-8b25-4080-89cb-e5abdf0c38b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fec4d2a7-b552-4e24-a406-66af899f046b', 'volume_name': 'volume-fec4d2a7-b552-4e24-a406-66af899f046b', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:56:47 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-296a2c5b-b5e4-42aa-b5ad-5c1c9ef16f2a tempest-VolumesTransfersTest-150813858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b086f6d3-d489-44c7-b2a7-ffccdc660a0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:56:47 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-296a2c5b-b5e4-42aa-b5ad-5c1c9ef16f2a tempest-VolumesTransfersTest-150813858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b086f6d3-d489-44c7-b2a7-ffccdc660a0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:56:47 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-296a2c5b-b5e4-42aa-b5ad-5c1c9ef16f2a tempest-VolumesTransfersTest-150813858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99933fcf-f44c-4f64-ac38-f7b1ef705c16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:56:47 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-296a2c5b-b5e4-42aa-b5ad-5c1c9ef16f2a tempest-VolumesTransfersTest-150813858 None] Volume fec4d2a7-b552-4e24-a406-66af899f046b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fec4d2a7-b552-4e24-a406-66af899f046b', 'volume_size': 1}
Jul 02 19:56:47 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-296a2c5b-b5e4-42aa-b5ad-5c1c9ef16f2a tempest-VolumesTransfersTest-150813858 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:56:47 devstack sudo[100668]: pam_unix(sudo:session): session closed for user root
Jul 02 19:56:47 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-674c7355-1438-4b62-8bb3-68a39fb34a83 tempest-VolumesSnapshotTestJSON-1095862726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-7463e6c8-1f48-4818-b4ee-f0666ebb3739" returned: 0 in 0.793s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:56:47 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-674c7355-1438-4b62-8bb3-68a39fb34a83 tempest-VolumesSnapshotTestJSON-1095862726 None] Lock "cinder-quobyte-7463e6c8-1f48-4818-b4ee-f0666ebb3739" released by "_copy_volume_from_snapshot" :: held 10.786s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:56:47 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-674c7355-1438-4b62-8bb3-68a39fb34a83 tempest-VolumesSnapshotTestJSON-1095862726 None] Lock "cinder-quobyte-f402c3ca-068b-41e5-b2fe-167cea5968ed-7463e6c8-1f48-4818-b4ee-f0666ebb3739" released by "_create_volume_from_snapshot" :: held 10.818s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:56:47 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-674c7355-1438-4b62-8bb3-68a39fb34a83 tempest-VolumesSnapshotTestJSON-1095862726 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.837s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:56:47 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-296a2c5b-b5e4-42aa-b5ad-5c1c9ef16f2a tempest-VolumesTransfersTest-150813858 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.284s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:56:47 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-296a2c5b-b5e4-42aa-b5ad-5c1c9ef16f2a tempest-VolumesTransfersTest-150813858 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce906cb830>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T17:56:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1470519809',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fec4d2a7-b552-4e24-a406-66af899f046b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1a02b3707cd4dad9223c567a9497f36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T17:56:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T17:56:47Z,use_quota=True,user_id='f6c7aa6eccda4938b071ac8c5687500f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)}" {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 19:56:47 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-296a2c5b-b5e4-42aa-b5ad-5c1c9ef16f2a tempest-VolumesTransfersTest-150813858 None] Creating volume fec4d2a7-b552-4e24-a406-66af899f046b {{(pid=86639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 19:56:47 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-296a2c5b-b5e4-42aa-b5ad-5c1c9ef16f2a tempest-VolumesTransfersTest-150813858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:56:47 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-296a2c5b-b5e4-42aa-b5ad-5c1c9ef16f2a tempest-VolumesTransfersTest-150813858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:56:47 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-296a2c5b-b5e4-42aa-b5ad-5c1c9ef16f2a tempest-VolumesTransfersTest-150813858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 19:56:47 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-296a2c5b-b5e4-42aa-b5ad-5c1c9ef16f2a tempest-VolumesTransfersTest-150813858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 19:56:47 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-296a2c5b-b5e4-42aa-b5ad-5c1c9ef16f2a tempest-VolumesTransfersTest-150813858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:56:47 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-296a2c5b-b5e4-42aa-b5ad-5c1c9ef16f2a tempest-VolumesTransfersTest-150813858 None] Selected osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92 as target Quobyte volume. {{(pid=86639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 19:56:47 devstack cinder-volume[86639]: INFO cinder.volume.drivers.remotefs [None req-296a2c5b-b5e4-42aa-b5ad-5c1c9ef16f2a tempest-VolumesTransfersTest-150813858 None] casted to osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92
Jul 02 19:56:47 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-296a2c5b-b5e4-42aa-b5ad-5c1c9ef16f2a tempest-VolumesTransfersTest-150813858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-fec4d2a7-b552-4e24-a406-66af899f046b 1073741824 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:56:47 devstack sudo[100671]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-fec4d2a7-b552-4e24-a406-66af899f046b 1073741824
Jul 02 19:56:47 devstack sudo[100671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:56:47 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-674c7355-1438-4b62-8bb3-68a39fb34a83 tempest-VolumesSnapshotTestJSON-1095862726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70650c1b-501b-471f-b3f2-499a2552268c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7463e6c8-1f48-4818-b4ee-f0666ebb3739', 'volume_size': 2, 'snapshot_id': 'f402c3ca-068b-41e5-b2fe-167cea5968ed'}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:56:47 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-674c7355-1438-4b62-8bb3-68a39fb34a83 tempest-VolumesSnapshotTestJSON-1095862726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59bc7e60-1ab5-4f6a-9c7a-0b42571e3769) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:56:47 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-674c7355-1438-4b62-8bb3-68a39fb34a83 tempest-VolumesSnapshotTestJSON-1095862726 None] Volume volume-7463e6c8-1f48-4818-b4ee-f0666ebb3739 (7463e6c8-1f48-4818-b4ee-f0666ebb3739): created successfully
Jul 02 19:56:47 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-674c7355-1438-4b62-8bb3-68a39fb34a83 tempest-VolumesSnapshotTestJSON-1095862726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59bc7e60-1ab5-4f6a-9c7a-0b42571e3769) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:56:47 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-674c7355-1438-4b62-8bb3-68a39fb34a83 tempest-VolumesSnapshotTestJSON-1095862726 None] Flow 'volume_create_manager' (1e5b8778-c041-4c8d-9c0e-43face005d99) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 19:56:47 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-674c7355-1438-4b62-8bb3-68a39fb34a83 tempest-VolumesSnapshotTestJSON-1095862726 None] Created volume successfully.
Jul 02 19:56:48 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-99703c3f-2076-443b-a9bb-dc549aaab3f3 tempest-VolumesSnapshotTestJSON-1095862726 None] Acquiring lock "cinder-7463e6c8-1f48-4818-b4ee-f0666ebb3739-delete_volume" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:56:48 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-99703c3f-2076-443b-a9bb-dc549aaab3f3 tempest-VolumesSnapshotTestJSON-1095862726 None] Lock "cinder-7463e6c8-1f48-4818-b4ee-f0666ebb3739-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:56:48 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-99703c3f-2076-443b-a9bb-dc549aaab3f3 tempest-VolumesSnapshotTestJSON-1095862726 None] Acquiring lock "cinder-quobyte-7463e6c8-1f48-4818-b4ee-f0666ebb3739" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:56:48 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-99703c3f-2076-443b-a9bb-dc549aaab3f3 tempest-VolumesSnapshotTestJSON-1095862726 None] Lock "cinder-quobyte-7463e6c8-1f48-4818-b4ee-f0666ebb3739" acquired by "delete_volume" :: waited 0.032s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:56:48 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[d38751d1-042b-4c7f-b216-f4ec9d8c92e7]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 19:56:48 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-99703c3f-2076-443b-a9bb-dc549aaab3f3 tempest-VolumesSnapshotTestJSON-1095862726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-7463e6c8-1f48-4818-b4ee-f0666ebb3739 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:56:48 devstack sudo[100673]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-7463e6c8-1f48-4818-b4ee-f0666ebb3739
Jul 02 19:56:48 devstack sudo[100673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:56:49 devstack sudo[100671]: pam_unix(sudo:session): session closed for user root
Jul 02 19:56:49 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-296a2c5b-b5e4-42aa-b5ad-5c1c9ef16f2a tempest-VolumesTransfersTest-150813858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-fec4d2a7-b552-4e24-a406-66af899f046b 1073741824" returned: 0 in 1.377s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:56:49 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-296a2c5b-b5e4-42aa-b5ad-5c1c9ef16f2a tempest-VolumesTransfersTest-150813858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-fec4d2a7-b552-4e24-a406-66af899f046b {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:56:49 devstack sudo[100679]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-fec4d2a7-b552-4e24-a406-66af899f046b
Jul 02 19:56:49 devstack sudo[100679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:56:49 devstack sudo[100673]: pam_unix(sudo:session): session closed for user root
Jul 02 19:56:49 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-99703c3f-2076-443b-a9bb-dc549aaab3f3 tempest-VolumesSnapshotTestJSON-1095862726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-7463e6c8-1f48-4818-b4ee-f0666ebb3739" returned: 0 in 0.994s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:56:49 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-99703c3f-2076-443b-a9bb-dc549aaab3f3 tempest-VolumesSnapshotTestJSON-1095862726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-7463e6c8-1f48-4818-b4ee-f0666ebb3739 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:56:49 devstack sudo[100684]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-7463e6c8-1f48-4818-b4ee-f0666ebb3739
Jul 02 19:56:49 devstack sudo[100684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:56:50 devstack sudo[100679]: pam_unix(sudo:session): session closed for user root
Jul 02 19:56:50 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-296a2c5b-b5e4-42aa-b5ad-5c1c9ef16f2a tempest-VolumesTransfersTest-150813858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-fec4d2a7-b552-4e24-a406-66af899f046b" returned: 0 in 0.888s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:56:50 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-296a2c5b-b5e4-42aa-b5ad-5c1c9ef16f2a tempest-VolumesTransfersTest-150813858 None] <== create_volume: return (2326ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'} {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 19:56:50 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-296a2c5b-b5e4-42aa-b5ad-5c1c9ef16f2a tempest-VolumesTransfersTest-150813858 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.332s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:56:50 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-296a2c5b-b5e4-42aa-b5ad-5c1c9ef16f2a tempest-VolumesTransfersTest-150813858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99933fcf-f44c-4f64-ac38-f7b1ef705c16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fec4d2a7-b552-4e24-a406-66af899f046b', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:56:50 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-296a2c5b-b5e4-42aa-b5ad-5c1c9ef16f2a tempest-VolumesTransfersTest-150813858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a85af0ba-7dc6-49df-b2f6-547eaca7d1f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:56:50 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-296a2c5b-b5e4-42aa-b5ad-5c1c9ef16f2a tempest-VolumesTransfersTest-150813858 None] Volume volume-fec4d2a7-b552-4e24-a406-66af899f046b (fec4d2a7-b552-4e24-a406-66af899f046b): created successfully
Jul 02 19:56:50 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-296a2c5b-b5e4-42aa-b5ad-5c1c9ef16f2a tempest-VolumesTransfersTest-150813858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a85af0ba-7dc6-49df-b2f6-547eaca7d1f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:56:50 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-296a2c5b-b5e4-42aa-b5ad-5c1c9ef16f2a tempest-VolumesTransfersTest-150813858 None] Flow 'volume_create_manager' (7009cd76-841c-449d-9e54-b80999dee068) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 19:56:50 devstack sudo[100684]: pam_unix(sudo:session): session closed for user root
Jul 02 19:56:50 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-99703c3f-2076-443b-a9bb-dc549aaab3f3 tempest-VolumesSnapshotTestJSON-1095862726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-7463e6c8-1f48-4818-b4ee-f0666ebb3739" returned: 0 in 0.739s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:56:50 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-296a2c5b-b5e4-42aa-b5ad-5c1c9ef16f2a tempest-VolumesTransfersTest-150813858 None] Created volume successfully.
Jul 02 19:56:50 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-99703c3f-2076-443b-a9bb-dc549aaab3f3 tempest-VolumesSnapshotTestJSON-1095862726 None] Lock "cinder-quobyte-7463e6c8-1f48-4818-b4ee-f0666ebb3739" released by "delete_volume" :: held 1.831s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:56:50 devstack cinder-volume[86639]: DEBUG cinder.quota [None req-99703c3f-2076-443b-a9bb-dc549aaab3f3 tempest-VolumesSnapshotTestJSON-1095862726 None] Created reservations ['832df57e-eca3-4c51-a082-e95fe22af26f', 'c4d333b7-eba5-419d-84d1-e70de3450257', 'b66c204a-b41b-4648-9ad6-c85d617eb56f', '71d22efb-d799-40fa-88d9-d83c1ad345aa'] {{(pid=86639) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 19:56:50 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-99703c3f-2076-443b-a9bb-dc549aaab3f3 tempest-VolumesSnapshotTestJSON-1095862726 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:56:50 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-99703c3f-2076-443b-a9bb-dc549aaab3f3 tempest-VolumesSnapshotTestJSON-1095862726 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:56:50 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-99703c3f-2076-443b-a9bb-dc549aaab3f3 tempest-VolumesSnapshotTestJSON-1095862726 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 19:56:50 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-99703c3f-2076-443b-a9bb-dc549aaab3f3 tempest-VolumesSnapshotTestJSON-1095862726 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 19:56:50 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-99703c3f-2076-443b-a9bb-dc549aaab3f3 tempest-VolumesSnapshotTestJSON-1095862726 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:56:50 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-99703c3f-2076-443b-a9bb-dc549aaab3f3 tempest-VolumesSnapshotTestJSON-1095862726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:56:50 devstack sudo[100688]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e
Jul 02 19:56:50 devstack sudo[100688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:56:50 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-04968192-777e-498e-ad80-cf8c92718109 tempest-VolumesSnapshotTestJSON-1095862726 None] Acquiring lock "cinder-f402c3ca-068b-41e5-b2fe-167cea5968ed-delete_snapshot" by "delete_snapshot" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:56:50 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-04968192-777e-498e-ad80-cf8c92718109 tempest-VolumesSnapshotTestJSON-1095862726 None] Lock "cinder-f402c3ca-068b-41e5-b2fe-167cea5968ed-delete_snapshot" acquired by "delete_snapshot" :: waited 0.054s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:56:50 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-04968192-777e-498e-ad80-cf8c92718109 tempest-VolumesSnapshotTestJSON-1095862726 None] Acquiring lock "cinder-quobyte-ab40c67a-3006-401d-aecd-dcf490c8c818" by "delete_snapshot" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:56:50 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-04968192-777e-498e-ad80-cf8c92718109 tempest-VolumesSnapshotTestJSON-1095862726 None] Lock "cinder-quobyte-ab40c67a-3006-401d-aecd-dcf490c8c818" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:56:50 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-04968192-777e-498e-ad80-cf8c92718109 tempest-VolumesSnapshotTestJSON-1095862726 None] Acquiring lock "cinder-quobyte-f402c3ca-068b-41e5-b2fe-167cea5968ed" by "_delete_snapshot" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:56:50 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-04968192-777e-498e-ad80-cf8c92718109 tempest-VolumesSnapshotTestJSON-1095862726 None] Lock "cinder-quobyte-f402c3ca-068b-41e5-b2fe-167cea5968ed" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:56:50 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-04968192-777e-498e-ad80-cf8c92718109 tempest-VolumesSnapshotTestJSON-1095862726 None] Deleting offline snapshot f402c3ca-068b-41e5-b2fe-167cea5968ed of volume ab40c67a-3006-401d-aecd-dcf490c8c818 {{(pid=86639) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 02 19:56:50 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-04968192-777e-498e-ad80-cf8c92718109 tempest-VolumesSnapshotTestJSON-1095862726 None] snapshot_file for this snap is: volume-ab40c67a-3006-401d-aecd-dcf490c8c818.f402c3ca-068b-41e5-b2fe-167cea5968ed {{(pid=86639) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 02 19:56:50 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[38fd3a5c-538d-408b-b918-a741d68939f0]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 19:56:50 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-04968192-777e-498e-ad80-cf8c92718109 tempest-VolumesSnapshotTestJSON-1095862726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-ab40c67a-3006-401d-aecd-dcf490c8c818.f402c3ca-068b-41e5-b2fe-167cea5968ed {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:56:51 devstack sudo[100690]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-ab40c67a-3006-401d-aecd-dcf490c8c818.f402c3ca-068b-41e5-b2fe-167cea5968ed
Jul 02 19:56:51 devstack sudo[100690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:56:51 devstack sudo[100688]: pam_unix(sudo:session): session closed for user root
Jul 02 19:56:51 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-99703c3f-2076-443b-a9bb-dc549aaab3f3 tempest-VolumesSnapshotTestJSON-1095862726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e" returned: 0 in 1.059s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:56:51 devstack cinder-volume[86639]: DEBUG cinder.manager [None req-99703c3f-2076-443b-a9bb-dc549aaab3f3 tempest-VolumesSnapshotTestJSON-1095862726 None] Notifying Schedulers of capabilities ... {{(pid=86639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 19:56:51 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-99703c3f-2076-443b-a9bb-dc549aaab3f3 tempest-VolumesSnapshotTestJSON-1095862726 None] Deleted volume successfully.
Jul 02 19:56:51 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-99703c3f-2076-443b-a9bb-dc549aaab3f3 tempest-VolumesSnapshotTestJSON-1095862726 None] Lock "cinder-7463e6c8-1f48-4818-b4ee-f0666ebb3739-delete_volume" released by "delete_volume" :: held 3.276s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:56:51 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-11661619-8b12-4d48-8fb9-13a3585d174f tempest-VolumesTransfersTest-309491669 None] Transfer volume completed successfully.
Jul 02 19:56:51 devstack sudo[100690]: pam_unix(sudo:session): session closed for user root
Jul 02 19:56:51 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-04968192-777e-498e-ad80-cf8c92718109 tempest-VolumesSnapshotTestJSON-1095862726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-ab40c67a-3006-401d-aecd-dcf490c8c818.f402c3ca-068b-41e5-b2fe-167cea5968ed" returned: 0 in 1.025s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:56:51 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-04968192-777e-498e-ad80-cf8c92718109 tempest-VolumesSnapshotTestJSON-1095862726 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ab40c67a-3006-401d-aecd-dcf490c8c818(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86639) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 02 19:56:51 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[8de3b99d-d4a1-41f3-9779-b65c420eac87]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 19:56:51 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-04968192-777e-498e-ad80-cf8c92718109 tempest-VolumesSnapshotTestJSON-1095862726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-ab40c67a-3006-401d-aecd-dcf490c8c818 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:56:52 devstack sudo[100696]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-ab40c67a-3006-401d-aecd-dcf490c8c818
Jul 02 19:56:52 devstack sudo[100696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:56:52 devstack sudo[100696]: pam_unix(sudo:session): session closed for user root
Jul 02 19:56:52 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-04968192-777e-498e-ad80-cf8c92718109 tempest-VolumesSnapshotTestJSON-1095862726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-ab40c67a-3006-401d-aecd-dcf490c8c818" returned: 0 in 0.832s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:56:52 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-04968192-777e-498e-ad80-cf8c92718109 tempest-VolumesSnapshotTestJSON-1095862726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-ab40c67a-3006-401d-aecd-dcf490c8c818.f402c3ca-068b-41e5-b2fe-167cea5968ed {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:56:52 devstack sudo[100703]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-ab40c67a-3006-401d-aecd-dcf490c8c818.f402c3ca-068b-41e5-b2fe-167cea5968ed
Jul 02 19:56:52 devstack sudo[100703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:56:52 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-3ed3a38b-a232-4313-bc16-329350447a02 tempest-VolumesTransfersTest-1301586808 None] Acquiring lock "cinder-fec4d2a7-b552-4e24-a406-66af899f046b-delete_volume" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:56:52 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-3ed3a38b-a232-4313-bc16-329350447a02 tempest-VolumesTransfersTest-1301586808 None] Lock "cinder-fec4d2a7-b552-4e24-a406-66af899f046b-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:56:52 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-3ed3a38b-a232-4313-bc16-329350447a02 tempest-VolumesTransfersTest-1301586808 None] Acquiring lock "cinder-quobyte-fec4d2a7-b552-4e24-a406-66af899f046b" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:56:52 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-3ed3a38b-a232-4313-bc16-329350447a02 tempest-VolumesTransfersTest-1301586808 None] Lock "cinder-quobyte-fec4d2a7-b552-4e24-a406-66af899f046b" acquired by "delete_volume" :: waited 0.019s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:56:53 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[460f3d46-db54-45bb-b4fa-98ebf6b77de6]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 19:56:53 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-3ed3a38b-a232-4313-bc16-329350447a02 tempest-VolumesTransfersTest-1301586808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-fec4d2a7-b552-4e24-a406-66af899f046b {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:56:53 devstack sudo[100705]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-fec4d2a7-b552-4e24-a406-66af899f046b
Jul 02 19:56:53 devstack sudo[100705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:56:53 devstack sudo[100703]: pam_unix(sudo:session): session closed for user root
Jul 02 19:56:53 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-04968192-777e-498e-ad80-cf8c92718109 tempest-VolumesSnapshotTestJSON-1095862726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-ab40c67a-3006-401d-aecd-dcf490c8c818.f402c3ca-068b-41e5-b2fe-167cea5968ed" returned: 0 in 0.909s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:56:53 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-04968192-777e-498e-ad80-cf8c92718109 tempest-VolumesSnapshotTestJSON-1095862726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-ab40c67a-3006-401d-aecd-dcf490c8c818.f402c3ca-068b-41e5-b2fe-167cea5968ed {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:56:53 devstack sudo[100711]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-ab40c67a-3006-401d-aecd-dcf490c8c818.f402c3ca-068b-41e5-b2fe-167cea5968ed
Jul 02 19:56:53 devstack sudo[100711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:56:53 devstack sudo[100705]: pam_unix(sudo:session): session closed for user root
Jul 02 19:56:53 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-3ed3a38b-a232-4313-bc16-329350447a02 tempest-VolumesTransfersTest-1301586808 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-fec4d2a7-b552-4e24-a406-66af899f046b" returned: 0 in 0.858s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:56:53 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-3ed3a38b-a232-4313-bc16-329350447a02 tempest-VolumesTransfersTest-1301586808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-fec4d2a7-b552-4e24-a406-66af899f046b {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:56:53 devstack sudo[100717]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-fec4d2a7-b552-4e24-a406-66af899f046b
Jul 02 19:56:53 devstack sudo[100717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:56:54 devstack sudo[100711]: pam_unix(sudo:session): session closed for user root
Jul 02 19:56:54 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-04968192-777e-498e-ad80-cf8c92718109 tempest-VolumesSnapshotTestJSON-1095862726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-ab40c67a-3006-401d-aecd-dcf490c8c818.f402c3ca-068b-41e5-b2fe-167cea5968ed" returned: 0 in 0.869s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:56:54 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-04968192-777e-498e-ad80-cf8c92718109 tempest-VolumesSnapshotTestJSON-1095862726 None] Lock "cinder-quobyte-f402c3ca-068b-41e5-b2fe-167cea5968ed" released by "_delete_snapshot" :: held 3.808s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:56:54 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-04968192-777e-498e-ad80-cf8c92718109 tempest-VolumesSnapshotTestJSON-1095862726 None] Lock "cinder-quobyte-ab40c67a-3006-401d-aecd-dcf490c8c818" released by "delete_snapshot" :: held 3.868s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:56:54 devstack sudo[100717]: pam_unix(sudo:session): session closed for user root
Jul 02 19:56:54 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-3ed3a38b-a232-4313-bc16-329350447a02 tempest-VolumesTransfersTest-1301586808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-fec4d2a7-b552-4e24-a406-66af899f046b" returned: 0 in 0.787s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:56:54 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-3ed3a38b-a232-4313-bc16-329350447a02 tempest-VolumesTransfersTest-1301586808 None] Lock "cinder-quobyte-fec4d2a7-b552-4e24-a406-66af899f046b" released by "delete_volume" :: held 1.723s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:56:54 devstack cinder-volume[86639]: DEBUG cinder.quota [None req-04968192-777e-498e-ad80-cf8c92718109 tempest-VolumesSnapshotTestJSON-1095862726 None] Created reservations ['f5c02053-c6f8-49f9-9f2b-9e97b98558f7', '36a505a1-b298-4434-9ef4-313a679e6928', '6294ac60-773b-414c-b2cd-e64a4d935105', 'e13a27da-26ae-4c13-8f97-cbf2d6c70e04'] {{(pid=86639) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 19:56:54 devstack cinder-volume[86639]: DEBUG cinder.quota [None req-3ed3a38b-a232-4313-bc16-329350447a02 tempest-VolumesTransfersTest-1301586808 None] Created reservations ['b9054b93-6956-4b2f-b289-0927052ced78', '8aa71683-2beb-415f-837d-b922cf54a408', '226ff7d7-f605-4654-ac49-41fee51213bb', '66cf8fa2-7702-4579-812a-0cd823101341'] {{(pid=86639) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 19:56:54 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-04968192-777e-498e-ad80-cf8c92718109 tempest-VolumesSnapshotTestJSON-1095862726 None] Delete snapshot completed successfully.
Jul 02 19:56:54 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-04968192-777e-498e-ad80-cf8c92718109 tempest-VolumesSnapshotTestJSON-1095862726 None] Lock "cinder-f402c3ca-068b-41e5-b2fe-167cea5968ed-delete_snapshot" released by "delete_snapshot" :: held 4.128s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:56:54 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-3ed3a38b-a232-4313-bc16-329350447a02 tempest-VolumesTransfersTest-1301586808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:56:54 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-3ed3a38b-a232-4313-bc16-329350447a02 tempest-VolumesTransfersTest-1301586808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:56:54 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-3ed3a38b-a232-4313-bc16-329350447a02 tempest-VolumesTransfersTest-1301586808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 19:56:54 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-3ed3a38b-a232-4313-bc16-329350447a02 tempest-VolumesTransfersTest-1301586808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 19:56:54 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-3ed3a38b-a232-4313-bc16-329350447a02 tempest-VolumesTransfersTest-1301586808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:56:54 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-3ed3a38b-a232-4313-bc16-329350447a02 tempest-VolumesTransfersTest-1301586808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:56:54 devstack sudo[100721]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e
Jul 02 19:56:54 devstack sudo[100721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:56:55 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-56c1af8f-0460-429c-b6a0-587505ee50ef tempest-VolumesSnapshotTestJSON-1095862726 None] Acquiring lock "cinder-ab40c67a-3006-401d-aecd-dcf490c8c818-delete_volume" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:56:55 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-56c1af8f-0460-429c-b6a0-587505ee50ef tempest-VolumesSnapshotTestJSON-1095862726 None] Lock "cinder-ab40c67a-3006-401d-aecd-dcf490c8c818-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:56:55 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-56c1af8f-0460-429c-b6a0-587505ee50ef tempest-VolumesSnapshotTestJSON-1095862726 None] Acquiring lock "cinder-quobyte-ab40c67a-3006-401d-aecd-dcf490c8c818" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:56:55 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-56c1af8f-0460-429c-b6a0-587505ee50ef tempest-VolumesSnapshotTestJSON-1095862726 None] Lock "cinder-quobyte-ab40c67a-3006-401d-aecd-dcf490c8c818" acquired by "delete_volume" :: waited 0.021s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:56:55 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[c247356e-b154-4ab8-ba98-d449c567a8b8]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 19:56:55 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-56c1af8f-0460-429c-b6a0-587505ee50ef tempest-VolumesSnapshotTestJSON-1095862726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-ab40c67a-3006-401d-aecd-dcf490c8c818 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:56:55 devstack sudo[100725]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-ab40c67a-3006-401d-aecd-dcf490c8c818
Jul 02 19:56:55 devstack sudo[100725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:56:55 devstack cinder-volume[86639]: DEBUG cinder.volume.flows.manager.create_volume [None req-2da3916c-a10a-4d0a-83bd-1f8a4ffd483a tempest-VolumesTransfersTest-150813858 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 19:56:55 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-2da3916c-a10a-4d0a-83bd-1f8a4ffd483a tempest-VolumesTransfersTest-150813858 None] Flow 'volume_create_manager' (faa82e9c-53c4-42ea-aa83-a5ee9fc2ac65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 19:56:55 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-2da3916c-a10a-4d0a-83bd-1f8a4ffd483a tempest-VolumesTransfersTest-150813858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4d27575-2df4-4d59-9eff-a6533cd63e7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:56:55 devstack sudo[100721]: pam_unix(sudo:session): session closed for user root
Jul 02 19:56:55 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-3ed3a38b-a232-4313-bc16-329350447a02 tempest-VolumesTransfersTest-1301586808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e" returned: 0 in 0.969s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:56:55 devstack cinder-volume[86639]: DEBUG cinder.manager [None req-3ed3a38b-a232-4313-bc16-329350447a02 tempest-VolumesTransfersTest-1301586808 None] Notifying Schedulers of capabilities ... {{(pid=86639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 19:56:55 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-2da3916c-a10a-4d0a-83bd-1f8a4ffd483a tempest-VolumesTransfersTest-150813858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4d27575-2df4-4d59-9eff-a6533cd63e7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T17:56:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1170516674',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9eab16a1-78bc-49df-b8ec-06720b44af93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1a02b3707cd4dad9223c567a9497f36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T17:56:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T17:56:56Z,use_quota=True,user_id='f6c7aa6eccda4938b071ac8c5687500f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:56:55 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-2da3916c-a10a-4d0a-83bd-1f8a4ffd483a tempest-VolumesTransfersTest-150813858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee6c7606-9f5d-48a6-a39f-2edc7c0d681c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:56:55 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-2da3916c-a10a-4d0a-83bd-1f8a4ffd483a tempest-VolumesTransfersTest-150813858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee6c7606-9f5d-48a6-a39f-2edc7c0d681c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:56:55 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-2da3916c-a10a-4d0a-83bd-1f8a4ffd483a tempest-VolumesTransfersTest-150813858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bdc6d0a1-3d4c-43fe-8170-beb31f7904ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:56:55 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-2da3916c-a10a-4d0a-83bd-1f8a4ffd483a tempest-VolumesTransfersTest-150813858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bdc6d0a1-3d4c-43fe-8170-beb31f7904ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9eab16a1-78bc-49df-b8ec-06720b44af93', 'volume_name': 'volume-9eab16a1-78bc-49df-b8ec-06720b44af93', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:56:55 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-2da3916c-a10a-4d0a-83bd-1f8a4ffd483a tempest-VolumesTransfersTest-150813858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50c16cf5-96dd-47ad-8121-14d6daa96d6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:56:55 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-2da3916c-a10a-4d0a-83bd-1f8a4ffd483a tempest-VolumesTransfersTest-150813858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50c16cf5-96dd-47ad-8121-14d6daa96d6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:56:55 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-2da3916c-a10a-4d0a-83bd-1f8a4ffd483a tempest-VolumesTransfersTest-150813858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d205fd2-8d13-449b-9c86-688bf9f52102) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:56:55 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-2da3916c-a10a-4d0a-83bd-1f8a4ffd483a tempest-VolumesTransfersTest-150813858 None] Volume 9eab16a1-78bc-49df-b8ec-06720b44af93: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9eab16a1-78bc-49df-b8ec-06720b44af93', 'volume_size': 1}
Jul 02 19:56:55 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-2da3916c-a10a-4d0a-83bd-1f8a4ffd483a tempest-VolumesTransfersTest-150813858 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:56:55 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-2da3916c-a10a-4d0a-83bd-1f8a4ffd483a tempest-VolumesTransfersTest-150813858 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:56:55 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-2da3916c-a10a-4d0a-83bd-1f8a4ffd483a tempest-VolumesTransfersTest-150813858 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce906cb830>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T17:56:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1170516674',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9eab16a1-78bc-49df-b8ec-06720b44af93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1a02b3707cd4dad9223c567a9497f36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T17:56:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T17:56:56Z,use_quota=True,user_id='f6c7aa6eccda4938b071ac8c5687500f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)}" {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 19:56:55 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-2da3916c-a10a-4d0a-83bd-1f8a4ffd483a tempest-VolumesTransfersTest-150813858 None] Creating volume 9eab16a1-78bc-49df-b8ec-06720b44af93 {{(pid=86639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 19:56:55 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-2da3916c-a10a-4d0a-83bd-1f8a4ffd483a tempest-VolumesTransfersTest-150813858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:56:55 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-2da3916c-a10a-4d0a-83bd-1f8a4ffd483a tempest-VolumesTransfersTest-150813858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:56:55 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-2da3916c-a10a-4d0a-83bd-1f8a4ffd483a tempest-VolumesTransfersTest-150813858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 19:56:55 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-2da3916c-a10a-4d0a-83bd-1f8a4ffd483a tempest-VolumesTransfersTest-150813858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 19:56:55 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-2da3916c-a10a-4d0a-83bd-1f8a4ffd483a tempest-VolumesTransfersTest-150813858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:56:55 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-2da3916c-a10a-4d0a-83bd-1f8a4ffd483a tempest-VolumesTransfersTest-150813858 None] Selected osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92 as target Quobyte volume. {{(pid=86639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 19:56:55 devstack cinder-volume[86639]: INFO cinder.volume.drivers.remotefs [None req-2da3916c-a10a-4d0a-83bd-1f8a4ffd483a tempest-VolumesTransfersTest-150813858 None] casted to osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92
Jul 02 19:56:55 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-2da3916c-a10a-4d0a-83bd-1f8a4ffd483a tempest-VolumesTransfersTest-150813858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-9eab16a1-78bc-49df-b8ec-06720b44af93 1073741824 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:56:55 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-3ed3a38b-a232-4313-bc16-329350447a02 tempest-VolumesTransfersTest-1301586808 None] Deleted volume successfully.
Jul 02 19:56:55 devstack sudo[100728]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-9eab16a1-78bc-49df-b8ec-06720b44af93 1073741824
Jul 02 19:56:55 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-3ed3a38b-a232-4313-bc16-329350447a02 tempest-VolumesTransfersTest-1301586808 None] Lock "cinder-fec4d2a7-b552-4e24-a406-66af899f046b-delete_volume" released by "delete_volume" :: held 3.080s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:56:55 devstack sudo[100728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:56:56 devstack sudo[100725]: pam_unix(sudo:session): session closed for user root
Jul 02 19:56:56 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-56c1af8f-0460-429c-b6a0-587505ee50ef tempest-VolumesSnapshotTestJSON-1095862726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-ab40c67a-3006-401d-aecd-dcf490c8c818" returned: 0 in 1.032s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:56:56 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-56c1af8f-0460-429c-b6a0-587505ee50ef tempest-VolumesSnapshotTestJSON-1095862726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-ab40c67a-3006-401d-aecd-dcf490c8c818 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:56:56 devstack sudo[100733]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-ab40c67a-3006-401d-aecd-dcf490c8c818
Jul 02 19:56:56 devstack sudo[100733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:56:57 devstack sudo[100728]: pam_unix(sudo:session): session closed for user root
Jul 02 19:56:57 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-2da3916c-a10a-4d0a-83bd-1f8a4ffd483a tempest-VolumesTransfersTest-150813858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-9eab16a1-78bc-49df-b8ec-06720b44af93 1073741824" returned: 0 in 1.204s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:56:57 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-2da3916c-a10a-4d0a-83bd-1f8a4ffd483a tempest-VolumesTransfersTest-150813858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-9eab16a1-78bc-49df-b8ec-06720b44af93 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:56:57 devstack sudo[100740]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-9eab16a1-78bc-49df-b8ec-06720b44af93
Jul 02 19:56:57 devstack sudo[100740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:56:57 devstack sudo[100733]: pam_unix(sudo:session): session closed for user root
Jul 02 19:56:57 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-56c1af8f-0460-429c-b6a0-587505ee50ef tempest-VolumesSnapshotTestJSON-1095862726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-ab40c67a-3006-401d-aecd-dcf490c8c818" returned: 0 in 0.976s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:56:57 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-56c1af8f-0460-429c-b6a0-587505ee50ef tempest-VolumesSnapshotTestJSON-1095862726 None] Lock "cinder-quobyte-ab40c67a-3006-401d-aecd-dcf490c8c818" released by "delete_volume" :: held 2.122s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:56:57 devstack cinder-volume[86639]: DEBUG cinder.quota [None req-56c1af8f-0460-429c-b6a0-587505ee50ef tempest-VolumesSnapshotTestJSON-1095862726 None] Created reservations ['da464d9d-0eb8-4e80-b49d-7bebb4afa3a2', '8f4926fc-06f6-4268-a81c-55bd51eb8211', 'f6be8f63-2898-4528-99d8-a0fdf44147c5', '0cd1bf9e-cac9-46e0-99dc-cfafa693a480'] {{(pid=86639) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 19:56:57 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-56c1af8f-0460-429c-b6a0-587505ee50ef tempest-VolumesSnapshotTestJSON-1095862726 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:56:57 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-56c1af8f-0460-429c-b6a0-587505ee50ef tempest-VolumesSnapshotTestJSON-1095862726 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:56:57 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-56c1af8f-0460-429c-b6a0-587505ee50ef tempest-VolumesSnapshotTestJSON-1095862726 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 19:56:57 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-56c1af8f-0460-429c-b6a0-587505ee50ef tempest-VolumesSnapshotTestJSON-1095862726 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 19:56:57 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-56c1af8f-0460-429c-b6a0-587505ee50ef tempest-VolumesSnapshotTestJSON-1095862726 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:56:57 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-56c1af8f-0460-429c-b6a0-587505ee50ef tempest-VolumesSnapshotTestJSON-1095862726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:56:57 devstack sudo[100742]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e
Jul 02 19:56:57 devstack sudo[100742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:56:58 devstack sudo[100740]: pam_unix(sudo:session): session closed for user root
Jul 02 19:56:58 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-2da3916c-a10a-4d0a-83bd-1f8a4ffd483a tempest-VolumesTransfersTest-150813858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-9eab16a1-78bc-49df-b8ec-06720b44af93" returned: 0 in 0.814s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:56:58 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-2da3916c-a10a-4d0a-83bd-1f8a4ffd483a tempest-VolumesTransfersTest-150813858 None] <== create_volume: return (2080ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'} {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 19:56:58 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-2da3916c-a10a-4d0a-83bd-1f8a4ffd483a tempest-VolumesTransfersTest-150813858 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.083s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:56:58 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-2da3916c-a10a-4d0a-83bd-1f8a4ffd483a tempest-VolumesTransfersTest-150813858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d205fd2-8d13-449b-9c86-688bf9f52102) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9eab16a1-78bc-49df-b8ec-06720b44af93', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:56:58 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-2da3916c-a10a-4d0a-83bd-1f8a4ffd483a tempest-VolumesTransfersTest-150813858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c7f684b-cacc-453b-857a-d0cd4318ebc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:56:58 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-2da3916c-a10a-4d0a-83bd-1f8a4ffd483a tempest-VolumesTransfersTest-150813858 None] Volume volume-9eab16a1-78bc-49df-b8ec-06720b44af93 (9eab16a1-78bc-49df-b8ec-06720b44af93): created successfully
Jul 02 19:56:58 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-2da3916c-a10a-4d0a-83bd-1f8a4ffd483a tempest-VolumesTransfersTest-150813858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c7f684b-cacc-453b-857a-d0cd4318ebc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:56:58 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-2da3916c-a10a-4d0a-83bd-1f8a4ffd483a tempest-VolumesTransfersTest-150813858 None] Flow 'volume_create_manager' (faa82e9c-53c4-42ea-aa83-a5ee9fc2ac65) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 19:56:58 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-2da3916c-a10a-4d0a-83bd-1f8a4ffd483a tempest-VolumesTransfersTest-150813858 None] Created volume successfully.
Jul 02 19:56:58 devstack sudo[100742]: pam_unix(sudo:session): session closed for user root
Jul 02 19:56:58 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-56c1af8f-0460-429c-b6a0-587505ee50ef tempest-VolumesSnapshotTestJSON-1095862726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e" returned: 0 in 0.777s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:56:58 devstack cinder-volume[86639]: DEBUG cinder.manager [None req-56c1af8f-0460-429c-b6a0-587505ee50ef tempest-VolumesSnapshotTestJSON-1095862726 None] Notifying Schedulers of capabilities ... {{(pid=86639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 19:56:58 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-56c1af8f-0460-429c-b6a0-587505ee50ef tempest-VolumesSnapshotTestJSON-1095862726 None] Deleted volume successfully.
Jul 02 19:56:58 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-56c1af8f-0460-429c-b6a0-587505ee50ef tempest-VolumesSnapshotTestJSON-1095862726 None] Lock "cinder-ab40c67a-3006-401d-aecd-dcf490c8c818-delete_volume" released by "delete_volume" :: held 3.230s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:56:59 devstack cinder-volume[86639]: DEBUG cinder.volume.flows.manager.create_volume [None req-681b6e85-5330-4a50-9e1e-2444af512e26 tempest-VolumesSnapshotTestJSON-1095862726 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 19:56:59 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-681b6e85-5330-4a50-9e1e-2444af512e26 tempest-VolumesSnapshotTestJSON-1095862726 None] Flow 'volume_create_manager' (2be7dccd-0570-41a5-9a3e-89ef4f2e42c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 19:56:59 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-681b6e85-5330-4a50-9e1e-2444af512e26 tempest-VolumesSnapshotTestJSON-1095862726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4e00fef-6858-4df0-81b4-3af11163a327) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:56:59 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-681b6e85-5330-4a50-9e1e-2444af512e26 tempest-VolumesSnapshotTestJSON-1095862726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4e00fef-6858-4df0-81b4-3af11163a327) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T17:56:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-588130452',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=978cba79-b651-4b63-8e13-31385e5ac858,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='584113d73ad94c1aae6af613c9e6588d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T17:56:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T17:56:59Z,use_quota=True,user_id='401ac538758e424ca04e11fb9ee93d99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:56:59 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-681b6e85-5330-4a50-9e1e-2444af512e26 tempest-VolumesSnapshotTestJSON-1095862726 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29cea73b-9d77-48a9-b114-f947bf1aefdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:56:59 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-681b6e85-5330-4a50-9e1e-2444af512e26 tempest-VolumesSnapshotTestJSON-1095862726 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29cea73b-9d77-48a9-b114-f947bf1aefdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:56:59 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-681b6e85-5330-4a50-9e1e-2444af512e26 tempest-VolumesSnapshotTestJSON-1095862726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a93950e9-a2f6-4f8e-97fe-6bb1328eea00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:56:59 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-681b6e85-5330-4a50-9e1e-2444af512e26 tempest-VolumesSnapshotTestJSON-1095862726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a93950e9-a2f6-4f8e-97fe-6bb1328eea00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '978cba79-b651-4b63-8e13-31385e5ac858', 'volume_name': 'volume-978cba79-b651-4b63-8e13-31385e5ac858', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:56:59 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-681b6e85-5330-4a50-9e1e-2444af512e26 tempest-VolumesSnapshotTestJSON-1095862726 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcbd3e25-8d98-4d43-b675-539d0687d2fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:56:59 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-681b6e85-5330-4a50-9e1e-2444af512e26 tempest-VolumesSnapshotTestJSON-1095862726 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcbd3e25-8d98-4d43-b675-539d0687d2fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:56:59 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-681b6e85-5330-4a50-9e1e-2444af512e26 tempest-VolumesSnapshotTestJSON-1095862726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d268e502-7ddc-4bff-968b-8059f2a74303) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:56:59 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-681b6e85-5330-4a50-9e1e-2444af512e26 tempest-VolumesSnapshotTestJSON-1095862726 None] Volume 978cba79-b651-4b63-8e13-31385e5ac858: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-978cba79-b651-4b63-8e13-31385e5ac858', 'volume_size': 1}
Jul 02 19:56:59 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-681b6e85-5330-4a50-9e1e-2444af512e26 tempest-VolumesSnapshotTestJSON-1095862726 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:56:59 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-681b6e85-5330-4a50-9e1e-2444af512e26 tempest-VolumesSnapshotTestJSON-1095862726 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:56:59 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-681b6e85-5330-4a50-9e1e-2444af512e26 tempest-VolumesSnapshotTestJSON-1095862726 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce906cb830>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T17:56:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-588130452',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=978cba79-b651-4b63-8e13-31385e5ac858,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='584113d73ad94c1aae6af613c9e6588d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T17:56:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T17:56:59Z,use_quota=True,user_id='401ac538758e424ca04e11fb9ee93d99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)}" {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 19:56:59 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-681b6e85-5330-4a50-9e1e-2444af512e26 tempest-VolumesSnapshotTestJSON-1095862726 None] Creating volume 978cba79-b651-4b63-8e13-31385e5ac858 {{(pid=86639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 19:56:59 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-681b6e85-5330-4a50-9e1e-2444af512e26 tempest-VolumesSnapshotTestJSON-1095862726 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:56:59 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-681b6e85-5330-4a50-9e1e-2444af512e26 tempest-VolumesSnapshotTestJSON-1095862726 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:56:59 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-681b6e85-5330-4a50-9e1e-2444af512e26 tempest-VolumesSnapshotTestJSON-1095862726 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 19:56:59 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-681b6e85-5330-4a50-9e1e-2444af512e26 tempest-VolumesSnapshotTestJSON-1095862726 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 19:56:59 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-681b6e85-5330-4a50-9e1e-2444af512e26 tempest-VolumesSnapshotTestJSON-1095862726 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:56:59 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-681b6e85-5330-4a50-9e1e-2444af512e26 tempest-VolumesSnapshotTestJSON-1095862726 None] Selected osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92 as target Quobyte volume. {{(pid=86639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 19:56:59 devstack cinder-volume[86639]: INFO cinder.volume.drivers.remotefs [None req-681b6e85-5330-4a50-9e1e-2444af512e26 tempest-VolumesSnapshotTestJSON-1095862726 None] casted to osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92
Jul 02 19:56:59 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-681b6e85-5330-4a50-9e1e-2444af512e26 tempest-VolumesSnapshotTestJSON-1095862726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-978cba79-b651-4b63-8e13-31385e5ac858 1073741824 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:56:59 devstack sudo[100746]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-978cba79-b651-4b63-8e13-31385e5ac858 1073741824
Jul 02 19:56:59 devstack sudo[100746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:56:59 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-cf33144e-b1e2-4b8e-9cee-6a7d8a1a163b tempest-VolumesTransfersTest-1301586808 None] Acquiring lock "cinder-9eab16a1-78bc-49df-b8ec-06720b44af93-delete_volume" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:56:59 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-cf33144e-b1e2-4b8e-9cee-6a7d8a1a163b tempest-VolumesTransfersTest-1301586808 None] Lock "cinder-9eab16a1-78bc-49df-b8ec-06720b44af93-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:56:59 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-cf33144e-b1e2-4b8e-9cee-6a7d8a1a163b tempest-VolumesTransfersTest-1301586808 None] Acquiring lock "cinder-quobyte-9eab16a1-78bc-49df-b8ec-06720b44af93" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:56:59 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-cf33144e-b1e2-4b8e-9cee-6a7d8a1a163b tempest-VolumesTransfersTest-1301586808 None] Lock "cinder-quobyte-9eab16a1-78bc-49df-b8ec-06720b44af93" acquired by "delete_volume" :: waited 0.017s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:56:59 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5c60d50-d974-4c7c-88c4-87cb3e28d97b]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 19:56:59 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-cf33144e-b1e2-4b8e-9cee-6a7d8a1a163b tempest-VolumesTransfersTest-1301586808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-9eab16a1-78bc-49df-b8ec-06720b44af93 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:56:59 devstack sudo[100748]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-9eab16a1-78bc-49df-b8ec-06720b44af93
Jul 02 19:56:59 devstack sudo[100748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:57:00 devstack sudo[100746]: pam_unix(sudo:session): session closed for user root
Jul 02 19:57:00 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-681b6e85-5330-4a50-9e1e-2444af512e26 tempest-VolumesSnapshotTestJSON-1095862726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-978cba79-b651-4b63-8e13-31385e5ac858 1073741824" returned: 0 in 1.120s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:57:00 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-681b6e85-5330-4a50-9e1e-2444af512e26 tempest-VolumesSnapshotTestJSON-1095862726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-978cba79-b651-4b63-8e13-31385e5ac858 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:57:00 devstack sudo[100754]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-978cba79-b651-4b63-8e13-31385e5ac858
Jul 02 19:57:00 devstack sudo[100754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:57:00 devstack sudo[100748]: pam_unix(sudo:session): session closed for user root
Jul 02 19:57:00 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-cf33144e-b1e2-4b8e-9cee-6a7d8a1a163b tempest-VolumesTransfersTest-1301586808 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-9eab16a1-78bc-49df-b8ec-06720b44af93" returned: 0 in 1.054s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:57:00 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-cf33144e-b1e2-4b8e-9cee-6a7d8a1a163b tempest-VolumesTransfersTest-1301586808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-9eab16a1-78bc-49df-b8ec-06720b44af93 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:57:00 devstack sudo[100759]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-9eab16a1-78bc-49df-b8ec-06720b44af93
Jul 02 19:57:00 devstack sudo[100759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:57:01 devstack sudo[100754]: pam_unix(sudo:session): session closed for user root
Jul 02 19:57:01 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-681b6e85-5330-4a50-9e1e-2444af512e26 tempest-VolumesSnapshotTestJSON-1095862726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-978cba79-b651-4b63-8e13-31385e5ac858" returned: 0 in 0.738s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:57:01 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-681b6e85-5330-4a50-9e1e-2444af512e26 tempest-VolumesSnapshotTestJSON-1095862726 None] <== create_volume: return (1917ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'} {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 19:57:01 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-681b6e85-5330-4a50-9e1e-2444af512e26 tempest-VolumesSnapshotTestJSON-1095862726 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.920s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:57:01 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-681b6e85-5330-4a50-9e1e-2444af512e26 tempest-VolumesSnapshotTestJSON-1095862726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d268e502-7ddc-4bff-968b-8059f2a74303) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-978cba79-b651-4b63-8e13-31385e5ac858', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:57:01 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-681b6e85-5330-4a50-9e1e-2444af512e26 tempest-VolumesSnapshotTestJSON-1095862726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da902ee7-7ea1-4c62-bdc9-84d054c8f6d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:57:01 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-681b6e85-5330-4a50-9e1e-2444af512e26 tempest-VolumesSnapshotTestJSON-1095862726 None] Volume volume-978cba79-b651-4b63-8e13-31385e5ac858 (978cba79-b651-4b63-8e13-31385e5ac858): created successfully
Jul 02 19:57:01 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-681b6e85-5330-4a50-9e1e-2444af512e26 tempest-VolumesSnapshotTestJSON-1095862726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da902ee7-7ea1-4c62-bdc9-84d054c8f6d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:57:01 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-681b6e85-5330-4a50-9e1e-2444af512e26 tempest-VolumesSnapshotTestJSON-1095862726 None] Flow 'volume_create_manager' (2be7dccd-0570-41a5-9a3e-89ef4f2e42c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 19:57:01 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-681b6e85-5330-4a50-9e1e-2444af512e26 tempest-VolumesSnapshotTestJSON-1095862726 None] Created volume successfully.
Jul 02 19:57:01 devstack sudo[100759]: pam_unix(sudo:session): session closed for user root
Jul 02 19:57:01 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-cf33144e-b1e2-4b8e-9cee-6a7d8a1a163b tempest-VolumesTransfersTest-1301586808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-9eab16a1-78bc-49df-b8ec-06720b44af93" returned: 0 in 0.769s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:57:01 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-cf33144e-b1e2-4b8e-9cee-6a7d8a1a163b tempest-VolumesTransfersTest-1301586808 None] Lock "cinder-quobyte-9eab16a1-78bc-49df-b8ec-06720b44af93" released by "delete_volume" :: held 1.882s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:57:01 devstack cinder-volume[86639]: DEBUG cinder.quota [None req-cf33144e-b1e2-4b8e-9cee-6a7d8a1a163b tempest-VolumesTransfersTest-1301586808 None] Created reservations ['e825a164-8f14-4736-bb91-ca1ac584a074', '7428dd6d-7c01-4f82-b446-22a1345747e6', '02526d00-9202-4c58-b199-7ddc40042219', '6f262cb3-8282-4419-8313-afa8c959f19d'] {{(pid=86639) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 19:57:01 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-cf33144e-b1e2-4b8e-9cee-6a7d8a1a163b tempest-VolumesTransfersTest-1301586808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:57:01 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-cf33144e-b1e2-4b8e-9cee-6a7d8a1a163b tempest-VolumesTransfersTest-1301586808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:57:01 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-cf33144e-b1e2-4b8e-9cee-6a7d8a1a163b tempest-VolumesTransfersTest-1301586808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 19:57:01 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-cf33144e-b1e2-4b8e-9cee-6a7d8a1a163b tempest-VolumesTransfersTest-1301586808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 19:57:01 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-cf33144e-b1e2-4b8e-9cee-6a7d8a1a163b tempest-VolumesTransfersTest-1301586808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:57:01 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-cf33144e-b1e2-4b8e-9cee-6a7d8a1a163b tempest-VolumesTransfersTest-1301586808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:57:01 devstack sudo[100763]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e
Jul 02 19:57:01 devstack sudo[100763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:57:02 devstack sudo[100763]: pam_unix(sudo:session): session closed for user root
Jul 02 19:57:02 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-cf33144e-b1e2-4b8e-9cee-6a7d8a1a163b tempest-VolumesTransfersTest-1301586808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e" returned: 0 in 0.785s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:57:02 devstack cinder-volume[86639]: DEBUG cinder.manager [None req-cf33144e-b1e2-4b8e-9cee-6a7d8a1a163b tempest-VolumesTransfersTest-1301586808 None] Notifying Schedulers of capabilities ... {{(pid=86639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 19:57:02 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-cf33144e-b1e2-4b8e-9cee-6a7d8a1a163b tempest-VolumesTransfersTest-1301586808 None] Deleted volume successfully.
Jul 02 19:57:02 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-cf33144e-b1e2-4b8e-9cee-6a7d8a1a163b tempest-VolumesTransfersTest-1301586808 None] Lock "cinder-9eab16a1-78bc-49df-b8ec-06720b44af93-delete_volume" released by "delete_volume" :: held 2.924s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:57:02 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-844c53bc-3cff-42df-ad7a-1dd791001c5b tempest-VolumesSnapshotTestJSON-1095862726 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:57:02 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-844c53bc-3cff-42df-ad7a-1dd791001c5b tempest-VolumesSnapshotTestJSON-1095862726 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:57:02 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-844c53bc-3cff-42df-ad7a-1dd791001c5b tempest-VolumesSnapshotTestJSON-1095862726 None] Creating offline snapshot 60307871-7f4c-449e-8eb7-8fecb255a465 of volume 978cba79-b651-4b63-8e13-31385e5ac858 {{(pid=86639) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 02 19:57:02 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[46bb2cf4-e75b-49e0-ab0a-bd3008e04cd4]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 19:57:02 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-844c53bc-3cff-42df-ad7a-1dd791001c5b tempest-VolumesSnapshotTestJSON-1095862726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-978cba79-b651-4b63-8e13-31385e5ac858 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:57:02 devstack sudo[100766]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-978cba79-b651-4b63-8e13-31385e5ac858
Jul 02 19:57:02 devstack sudo[100766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:57:03 devstack sudo[100766]: pam_unix(sudo:session): session closed for user root
Jul 02 19:57:03 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-844c53bc-3cff-42df-ad7a-1dd791001c5b tempest-VolumesSnapshotTestJSON-1095862726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-978cba79-b651-4b63-8e13-31385e5ac858" returned: 0 in 1.109s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:57:03 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-844c53bc-3cff-42df-ad7a-1dd791001c5b tempest-VolumesSnapshotTestJSON-1095862726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-978cba79-b651-4b63-8e13-31385e5ac858,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-978cba79-b651-4b63-8e13-31385e5ac858.60307871-7f4c-449e-8eb7-8fecb255a465 1G {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:57:03 devstack sudo[100772]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-978cba79-b651-4b63-8e13-31385e5ac858,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-978cba79-b651-4b63-8e13-31385e5ac858.60307871-7f4c-449e-8eb7-8fecb255a465 1G
Jul 02 19:57:03 devstack sudo[100772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:57:04 devstack sudo[100772]: pam_unix(sudo:session): session closed for user root
Jul 02 19:57:04 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-844c53bc-3cff-42df-ad7a-1dd791001c5b tempest-VolumesSnapshotTestJSON-1095862726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-978cba79-b651-4b63-8e13-31385e5ac858,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-978cba79-b651-4b63-8e13-31385e5ac858.60307871-7f4c-449e-8eb7-8fecb255a465 1G" returned: 0 in 1.139s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:57:04 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-844c53bc-3cff-42df-ad7a-1dd791001c5b tempest-VolumesSnapshotTestJSON-1095862726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-978cba79-b651-4b63-8e13-31385e5ac858 -F qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-978cba79-b651-4b63-8e13-31385e5ac858.60307871-7f4c-449e-8eb7-8fecb255a465 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:57:04 devstack sudo[100778]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-978cba79-b651-4b63-8e13-31385e5ac858 -F qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-978cba79-b651-4b63-8e13-31385e5ac858.60307871-7f4c-449e-8eb7-8fecb255a465
Jul 02 19:57:04 devstack sudo[100778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:57:05 devstack sudo[100778]: pam_unix(sudo:session): session closed for user root
Jul 02 19:57:05 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-844c53bc-3cff-42df-ad7a-1dd791001c5b tempest-VolumesSnapshotTestJSON-1095862726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-978cba79-b651-4b63-8e13-31385e5ac858 -F qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-978cba79-b651-4b63-8e13-31385e5ac858.60307871-7f4c-449e-8eb7-8fecb255a465" returned: 0 in 0.980s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:57:05 devstack cinder-volume[86639]: WARNING cinder.volume.drivers.remotefs [None req-844c53bc-3cff-42df-ad7a-1dd791001c5b tempest-VolumesSnapshotTestJSON-1095862726 None] /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-978cba79-b651-4b63-8e13-31385e5ac858.60307871-7f4c-449e-8eb7-8fecb255a465 is being set with open permissions: ugo+rw
Jul 02 19:57:05 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-844c53bc-3cff-42df-ad7a-1dd791001c5b tempest-VolumesSnapshotTestJSON-1095862726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-978cba79-b651-4b63-8e13-31385e5ac858.60307871-7f4c-449e-8eb7-8fecb255a465 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:57:05 devstack sudo[100784]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-978cba79-b651-4b63-8e13-31385e5ac858.60307871-7f4c-449e-8eb7-8fecb255a465
Jul 02 19:57:05 devstack sudo[100784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:57:06 devstack sudo[100784]: pam_unix(sudo:session): session closed for user root
Jul 02 19:57:06 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-844c53bc-3cff-42df-ad7a-1dd791001c5b tempest-VolumesSnapshotTestJSON-1095862726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-978cba79-b651-4b63-8e13-31385e5ac858.60307871-7f4c-449e-8eb7-8fecb255a465" returned: 0 in 0.754s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:57:06 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-844c53bc-3cff-42df-ad7a-1dd791001c5b tempest-VolumesSnapshotTestJSON-1095862726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-978cba79-b651-4b63-8e13-31385e5ac858.info {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:57:06 devstack sudo[100787]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-978cba79-b651-4b63-8e13-31385e5ac858.info
Jul 02 19:57:06 devstack sudo[100787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:57:07 devstack sudo[100787]: pam_unix(sudo:session): session closed for user root
Jul 02 19:57:07 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-844c53bc-3cff-42df-ad7a-1dd791001c5b tempest-VolumesSnapshotTestJSON-1095862726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-978cba79-b651-4b63-8e13-31385e5ac858.info" returned: 0 in 0.772s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:57:07 devstack cinder-volume[86639]: WARNING cinder.volume.drivers.remotefs [None req-844c53bc-3cff-42df-ad7a-1dd791001c5b tempest-VolumesSnapshotTestJSON-1095862726 None] /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-978cba79-b651-4b63-8e13-31385e5ac858.info is being set with open permissions: ugo+rw
Jul 02 19:57:07 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-844c53bc-3cff-42df-ad7a-1dd791001c5b tempest-VolumesSnapshotTestJSON-1095862726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-978cba79-b651-4b63-8e13-31385e5ac858.info {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:57:07 devstack sudo[100790]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-978cba79-b651-4b63-8e13-31385e5ac858.info
Jul 02 19:57:07 devstack sudo[100790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:57:07 devstack cinder-volume[86639]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a1f9819-a43d-4bf8-b4f9-87294f2fa63c tempest-TestStampPattern-490270338 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 19:57:07 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-2a1f9819-a43d-4bf8-b4f9-87294f2fa63c tempest-TestStampPattern-490270338 None] Flow 'volume_create_manager' (75d23b4d-aac5-44bd-90af-50852de6ee2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 19:57:07 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-2a1f9819-a43d-4bf8-b4f9-87294f2fa63c tempest-TestStampPattern-490270338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36605873-1adf-4641-a045-2d26df6476ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:57:07 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-2a1f9819-a43d-4bf8-b4f9-87294f2fa63c tempest-TestStampPattern-490270338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36605873-1adf-4641-a045-2d26df6476ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T17:57:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-873781182',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f01b42d-1ed5-4eb3-be31-1f30a012b64e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2b672eb053945e89ba677cfc99f047f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T17:57:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T17:57:08Z,use_quota=True,user_id='bee2c39ae9774a96a7c3a987f842ed1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:57:07 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-2a1f9819-a43d-4bf8-b4f9-87294f2fa63c tempest-TestStampPattern-490270338 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3bd7d5a-1a98-4c5e-a3eb-c7a0dadf7fd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:57:07 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-2a1f9819-a43d-4bf8-b4f9-87294f2fa63c tempest-TestStampPattern-490270338 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3bd7d5a-1a98-4c5e-a3eb-c7a0dadf7fd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:57:07 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-2a1f9819-a43d-4bf8-b4f9-87294f2fa63c tempest-TestStampPattern-490270338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6792b14-1355-4be8-9a9b-67c66738b093) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:57:07 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-2a1f9819-a43d-4bf8-b4f9-87294f2fa63c tempest-TestStampPattern-490270338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6792b14-1355-4be8-9a9b-67c66738b093) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f01b42d-1ed5-4eb3-be31-1f30a012b64e', 'volume_name': 'volume-3f01b42d-1ed5-4eb3-be31-1f30a012b64e', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:57:07 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-2a1f9819-a43d-4bf8-b4f9-87294f2fa63c tempest-TestStampPattern-490270338 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e82b1957-86df-4951-a9c5-b25453118766) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:57:07 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-2a1f9819-a43d-4bf8-b4f9-87294f2fa63c tempest-TestStampPattern-490270338 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e82b1957-86df-4951-a9c5-b25453118766) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:57:07 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-2a1f9819-a43d-4bf8-b4f9-87294f2fa63c tempest-TestStampPattern-490270338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80c5a920-4cbf-4b58-a11c-fcc3213a3e0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:57:07 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-2a1f9819-a43d-4bf8-b4f9-87294f2fa63c tempest-TestStampPattern-490270338 None] Volume 3f01b42d-1ed5-4eb3-be31-1f30a012b64e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f01b42d-1ed5-4eb3-be31-1f30a012b64e', 'volume_size': 1}
Jul 02 19:57:07 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-2a1f9819-a43d-4bf8-b4f9-87294f2fa63c tempest-TestStampPattern-490270338 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:57:08 devstack sudo[100790]: pam_unix(sudo:session): session closed for user root
Jul 02 19:57:08 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-844c53bc-3cff-42df-ad7a-1dd791001c5b tempest-VolumesSnapshotTestJSON-1095862726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-978cba79-b651-4b63-8e13-31385e5ac858.info" returned: 0 in 0.830s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:57:08 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-844c53bc-3cff-42df-ad7a-1dd791001c5b tempest-VolumesSnapshotTestJSON-1095862726 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.741s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:57:08 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-2a1f9819-a43d-4bf8-b4f9-87294f2fa63c tempest-TestStampPattern-490270338 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.398s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:57:08 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-2a1f9819-a43d-4bf8-b4f9-87294f2fa63c tempest-TestStampPattern-490270338 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce906cb830>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T17:57:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-873781182',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f01b42d-1ed5-4eb3-be31-1f30a012b64e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2b672eb053945e89ba677cfc99f047f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T17:57:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T17:57:08Z,use_quota=True,user_id='bee2c39ae9774a96a7c3a987f842ed1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)}" {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 19:57:08 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-2a1f9819-a43d-4bf8-b4f9-87294f2fa63c tempest-TestStampPattern-490270338 None] Creating volume 3f01b42d-1ed5-4eb3-be31-1f30a012b64e {{(pid=86639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 19:57:08 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-2a1f9819-a43d-4bf8-b4f9-87294f2fa63c tempest-TestStampPattern-490270338 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:57:08 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-2a1f9819-a43d-4bf8-b4f9-87294f2fa63c tempest-TestStampPattern-490270338 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:57:08 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-2a1f9819-a43d-4bf8-b4f9-87294f2fa63c tempest-TestStampPattern-490270338 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 19:57:08 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-2a1f9819-a43d-4bf8-b4f9-87294f2fa63c tempest-TestStampPattern-490270338 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 19:57:08 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-2a1f9819-a43d-4bf8-b4f9-87294f2fa63c tempest-TestStampPattern-490270338 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:57:08 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-2a1f9819-a43d-4bf8-b4f9-87294f2fa63c tempest-TestStampPattern-490270338 None] Selected osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92 as target Quobyte volume. {{(pid=86639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 19:57:08 devstack cinder-volume[86639]: INFO cinder.volume.drivers.remotefs [None req-2a1f9819-a43d-4bf8-b4f9-87294f2fa63c tempest-TestStampPattern-490270338 None] casted to osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92
Jul 02 19:57:08 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-2a1f9819-a43d-4bf8-b4f9-87294f2fa63c tempest-TestStampPattern-490270338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-3f01b42d-1ed5-4eb3-be31-1f30a012b64e 1073741824 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:57:08 devstack sudo[100793]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-3f01b42d-1ed5-4eb3-be31-1f30a012b64e 1073741824
Jul 02 19:57:08 devstack sudo[100793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:57:08 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-844c53bc-3cff-42df-ad7a-1dd791001c5b tempest-VolumesSnapshotTestJSON-1095862726 None] Create snapshot completed successfully
Jul 02 19:57:09 devstack sudo[100793]: pam_unix(sudo:session): session closed for user root
Jul 02 19:57:09 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-2a1f9819-a43d-4bf8-b4f9-87294f2fa63c tempest-TestStampPattern-490270338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-3f01b42d-1ed5-4eb3-be31-1f30a012b64e 1073741824" returned: 0 in 1.252s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:57:09 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-2a1f9819-a43d-4bf8-b4f9-87294f2fa63c tempest-TestStampPattern-490270338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-3f01b42d-1ed5-4eb3-be31-1f30a012b64e {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:57:09 devstack sudo[100802]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-3f01b42d-1ed5-4eb3-be31-1f30a012b64e
Jul 02 19:57:09 devstack sudo[100802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:57:09 devstack cinder-volume[86639]: DEBUG cinder.volume.flows.manager.create_volume [None req-d2683d89-e348-4b40-bb42-93ced4d5e82c tempest-VolumesSnapshotTestJSON-1095862726 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 19:57:09 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-d2683d89-e348-4b40-bb42-93ced4d5e82c tempest-VolumesSnapshotTestJSON-1095862726 None] Flow 'volume_create_manager' (61d0bde5-223f-48ac-922b-6564de9480f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 19:57:09 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-d2683d89-e348-4b40-bb42-93ced4d5e82c tempest-VolumesSnapshotTestJSON-1095862726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c5861ca-9480-4c6e-b7b8-adb6d8db5573) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:57:09 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-d2683d89-e348-4b40-bb42-93ced4d5e82c tempest-VolumesSnapshotTestJSON-1095862726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c5861ca-9480-4c6e-b7b8-adb6d8db5573) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T17:57:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-6885725',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61df04ff-8b5f-44d5-a93f-706d16cd56f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='584113d73ad94c1aae6af613c9e6588d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T17:57:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=60307871-7f4c-449e-8eb7-8fecb255a465,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T17:57:10Z,use_quota=True,user_id='401ac538758e424ca04e11fb9ee93d99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:57:09 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-d2683d89-e348-4b40-bb42-93ced4d5e82c tempest-VolumesSnapshotTestJSON-1095862726 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a359597d-a509-4ed8-8b92-9783f12ab296) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:57:09 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-d2683d89-e348-4b40-bb42-93ced4d5e82c tempest-VolumesSnapshotTestJSON-1095862726 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a359597d-a509-4ed8-8b92-9783f12ab296) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:57:09 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-d2683d89-e348-4b40-bb42-93ced4d5e82c tempest-VolumesSnapshotTestJSON-1095862726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f88ba93-3b15-4e9c-be04-7299c7a8c06a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:57:09 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-d2683d89-e348-4b40-bb42-93ced4d5e82c tempest-VolumesSnapshotTestJSON-1095862726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f88ba93-3b15-4e9c-be04-7299c7a8c06a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '61df04ff-8b5f-44d5-a93f-706d16cd56f4', 'volume_name': 'volume-61df04ff-8b5f-44d5-a93f-706d16cd56f4', 'volume_size': 1, 'snapshot_id': '60307871-7f4c-449e-8eb7-8fecb255a465'}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:57:09 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-d2683d89-e348-4b40-bb42-93ced4d5e82c tempest-VolumesSnapshotTestJSON-1095862726 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (260ac6c9-a50d-4361-9ad9-7b01f67961e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:57:09 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-d2683d89-e348-4b40-bb42-93ced4d5e82c tempest-VolumesSnapshotTestJSON-1095862726 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (260ac6c9-a50d-4361-9ad9-7b01f67961e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:57:09 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-d2683d89-e348-4b40-bb42-93ced4d5e82c tempest-VolumesSnapshotTestJSON-1095862726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4ce3fd2-5b1b-4c73-be94-1459b34edcbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:57:09 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-d2683d89-e348-4b40-bb42-93ced4d5e82c tempest-VolumesSnapshotTestJSON-1095862726 None] Volume 61df04ff-8b5f-44d5-a93f-706d16cd56f4: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-61df04ff-8b5f-44d5-a93f-706d16cd56f4', 'volume_size': 1, 'snapshot_id': '60307871-7f4c-449e-8eb7-8fecb255a465'}
Jul 02 19:57:09 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-d2683d89-e348-4b40-bb42-93ced4d5e82c tempest-VolumesSnapshotTestJSON-1095862726 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:57:10 devstack sudo[100802]: pam_unix(sudo:session): session closed for user root
Jul 02 19:57:10 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-2a1f9819-a43d-4bf8-b4f9-87294f2fa63c tempest-TestStampPattern-490270338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-3f01b42d-1ed5-4eb3-be31-1f30a012b64e" returned: 0 in 0.826s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:57:10 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-2a1f9819-a43d-4bf8-b4f9-87294f2fa63c tempest-TestStampPattern-490270338 None] <== create_volume: return (2168ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'} {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 19:57:10 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-2a1f9819-a43d-4bf8-b4f9-87294f2fa63c tempest-TestStampPattern-490270338 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.170s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:57:10 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-d2683d89-e348-4b40-bb42-93ced4d5e82c tempest-VolumesSnapshotTestJSON-1095862726 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.516s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:57:10 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-d2683d89-e348-4b40-bb42-93ced4d5e82c tempest-VolumesSnapshotTestJSON-1095862726 None] Acquiring lock "cinder-quobyte-60307871-7f4c-449e-8eb7-8fecb255a465-61df04ff-8b5f-44d5-a93f-706d16cd56f4" by "_create_volume_from_snapshot" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:57:10 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-2a1f9819-a43d-4bf8-b4f9-87294f2fa63c tempest-TestStampPattern-490270338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80c5a920-4cbf-4b58-a11c-fcc3213a3e0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f01b42d-1ed5-4eb3-be31-1f30a012b64e', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:57:10 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-2a1f9819-a43d-4bf8-b4f9-87294f2fa63c tempest-TestStampPattern-490270338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96449025-452c-4211-8efe-8530a0f6d18b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:57:10 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-d2683d89-e348-4b40-bb42-93ced4d5e82c tempest-VolumesSnapshotTestJSON-1095862726 None] Lock "cinder-quobyte-60307871-7f4c-449e-8eb7-8fecb255a465-61df04ff-8b5f-44d5-a93f-706d16cd56f4" acquired by "_create_volume_from_snapshot" :: waited 0.032s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:57:10 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-d2683d89-e348-4b40-bb42-93ced4d5e82c tempest-VolumesSnapshotTestJSON-1095862726 None] Creating volume 61df04ff-8b5f-44d5-a93f-706d16cd56f4 from snapshot 60307871-7f4c-449e-8eb7-8fecb255a465 {{(pid=86639) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jul 02 19:57:10 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-d2683d89-e348-4b40-bb42-93ced4d5e82c tempest-VolumesSnapshotTestJSON-1095862726 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:57:10 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-d2683d89-e348-4b40-bb42-93ced4d5e82c tempest-VolumesSnapshotTestJSON-1095862726 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:57:10 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-d2683d89-e348-4b40-bb42-93ced4d5e82c tempest-VolumesSnapshotTestJSON-1095862726 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 19:57:10 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-d2683d89-e348-4b40-bb42-93ced4d5e82c tempest-VolumesSnapshotTestJSON-1095862726 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 19:57:10 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-d2683d89-e348-4b40-bb42-93ced4d5e82c tempest-VolumesSnapshotTestJSON-1095862726 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:57:10 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-d2683d89-e348-4b40-bb42-93ced4d5e82c tempest-VolumesSnapshotTestJSON-1095862726 None] Selected osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92 as target Quobyte volume. {{(pid=86639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 19:57:10 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-d2683d89-e348-4b40-bb42-93ced4d5e82c tempest-VolumesSnapshotTestJSON-1095862726 None] Acquiring lock "cinder-quobyte-61df04ff-8b5f-44d5-a93f-706d16cd56f4" by "_copy_volume_from_snapshot" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:57:10 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-2a1f9819-a43d-4bf8-b4f9-87294f2fa63c tempest-TestStampPattern-490270338 None] Volume volume-3f01b42d-1ed5-4eb3-be31-1f30a012b64e (3f01b42d-1ed5-4eb3-be31-1f30a012b64e): created successfully
Jul 02 19:57:10 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-2a1f9819-a43d-4bf8-b4f9-87294f2fa63c tempest-TestStampPattern-490270338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96449025-452c-4211-8efe-8530a0f6d18b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:57:10 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-2a1f9819-a43d-4bf8-b4f9-87294f2fa63c tempest-TestStampPattern-490270338 None] Flow 'volume_create_manager' (75d23b4d-aac5-44bd-90af-50852de6ee2f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 19:57:10 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-d2683d89-e348-4b40-bb42-93ced4d5e82c tempest-VolumesSnapshotTestJSON-1095862726 None] Lock "cinder-quobyte-61df04ff-8b5f-44d5-a93f-706d16cd56f4" acquired by "_copy_volume_from_snapshot" :: waited 0.031s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:57:10 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-d2683d89-e348-4b40-bb42-93ced4d5e82c tempest-VolumesSnapshotTestJSON-1095862726 None] snapshot: 60307871-7f4c-449e-8eb7-8fecb255a465, volume: 61df04ff-8b5f-44d5-a93f-706d16cd56f4,  {{(pid=86639) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jul 02 19:57:10 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-2a1f9819-a43d-4bf8-b4f9-87294f2fa63c tempest-TestStampPattern-490270338 None] Created volume successfully.
Jul 02 19:57:10 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-d2683d89-e348-4b40-bb42-93ced4d5e82c tempest-VolumesSnapshotTestJSON-1095862726 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:57:10 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-d2683d89-e348-4b40-bb42-93ced4d5e82c tempest-VolumesSnapshotTestJSON-1095862726 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:57:10 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-d2683d89-e348-4b40-bb42-93ced4d5e82c tempest-VolumesSnapshotTestJSON-1095862726 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 19:57:10 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-d2683d89-e348-4b40-bb42-93ced4d5e82c tempest-VolumesSnapshotTestJSON-1095862726 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 19:57:10 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-d2683d89-e348-4b40-bb42-93ced4d5e82c tempest-VolumesSnapshotTestJSON-1095862726 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:57:10 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[92f52306-a84d-45a3-909c-f402001da717]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 19:57:10 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-d2683d89-e348-4b40-bb42-93ced4d5e82c tempest-VolumesSnapshotTestJSON-1095862726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-978cba79-b651-4b63-8e13-31385e5ac858.60307871-7f4c-449e-8eb7-8fecb255a465 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:57:10 devstack sudo[100805]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-978cba79-b651-4b63-8e13-31385e5ac858.60307871-7f4c-449e-8eb7-8fecb255a465
Jul 02 19:57:10 devstack sudo[100805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:57:11 devstack cinder-volume[86639]: DEBUG cinder.volume.flows.manager.create_volume [None req-f64390dc-c12c-44ee-93f6-af94f9dbc69b tempest-VolumesTransfersV357Test-1930236706 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 19:57:11 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-f64390dc-c12c-44ee-93f6-af94f9dbc69b tempest-VolumesTransfersV357Test-1930236706 None] Flow 'volume_create_manager' (b7df02c0-8e15-4b7c-a5fa-b11cd9240c19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 19:57:11 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-f64390dc-c12c-44ee-93f6-af94f9dbc69b tempest-VolumesTransfersV357Test-1930236706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e9cbca4-f002-4ca7-9600-24e237bf1116) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:57:11 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-f64390dc-c12c-44ee-93f6-af94f9dbc69b tempest-VolumesTransfersV357Test-1930236706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e9cbca4-f002-4ca7-9600-24e237bf1116) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T17:57:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-2064966243',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66845b33-ad85-4b0d-b26e-21f40c4928c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30a9c62fdd38428ba32d5aa58388f878',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T17:57:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T17:57:11Z,use_quota=True,user_id='9bb84044ec7a4896897245103b1b5bd2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:57:11 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-f64390dc-c12c-44ee-93f6-af94f9dbc69b tempest-VolumesTransfersV357Test-1930236706 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f452091b-a2a7-43c7-92ad-45fc16e35656) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:57:11 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-f64390dc-c12c-44ee-93f6-af94f9dbc69b tempest-VolumesTransfersV357Test-1930236706 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f452091b-a2a7-43c7-92ad-45fc16e35656) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:57:11 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-f64390dc-c12c-44ee-93f6-af94f9dbc69b tempest-VolumesTransfersV357Test-1930236706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6614479a-bf59-46f7-bcb7-47b3ab596077) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:57:11 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-f64390dc-c12c-44ee-93f6-af94f9dbc69b tempest-VolumesTransfersV357Test-1930236706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6614479a-bf59-46f7-bcb7-47b3ab596077) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '66845b33-ad85-4b0d-b26e-21f40c4928c3', 'volume_name': 'volume-66845b33-ad85-4b0d-b26e-21f40c4928c3', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:57:11 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-f64390dc-c12c-44ee-93f6-af94f9dbc69b tempest-VolumesTransfersV357Test-1930236706 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0288b3d-8e75-4a24-8831-7b0ff4540fdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:57:11 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-f64390dc-c12c-44ee-93f6-af94f9dbc69b tempest-VolumesTransfersV357Test-1930236706 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0288b3d-8e75-4a24-8831-7b0ff4540fdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:57:11 devstack sudo[100805]: pam_unix(sudo:session): session closed for user root
Jul 02 19:57:11 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-f64390dc-c12c-44ee-93f6-af94f9dbc69b tempest-VolumesTransfersV357Test-1930236706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55e43e7f-9f07-40ba-9f37-189e0c94c845) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:57:11 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-f64390dc-c12c-44ee-93f6-af94f9dbc69b tempest-VolumesTransfersV357Test-1930236706 None] Volume 66845b33-ad85-4b0d-b26e-21f40c4928c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-66845b33-ad85-4b0d-b26e-21f40c4928c3', 'volume_size': 1}
Jul 02 19:57:11 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-f64390dc-c12c-44ee-93f6-af94f9dbc69b tempest-VolumesTransfersV357Test-1930236706 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:57:11 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-d2683d89-e348-4b40-bb42-93ced4d5e82c tempest-VolumesSnapshotTestJSON-1095862726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-978cba79-b651-4b63-8e13-31385e5ac858.60307871-7f4c-449e-8eb7-8fecb255a465" returned: 0 in 0.923s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:57:11 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-d2683d89-e348-4b40-bb42-93ced4d5e82c tempest-VolumesSnapshotTestJSON-1095862726 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-978cba79-b651-4b63-8e13-31385e5ac858(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86639) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 02 19:57:11 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-d2683d89-e348-4b40-bb42-93ced4d5e82c tempest-VolumesSnapshotTestJSON-1095862726 None] will copy from snapshot at /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-978cba79-b651-4b63-8e13-31385e5ac858 {{(pid=86639) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jul 02 19:57:11 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-d2683d89-e348-4b40-bb42-93ced4d5e82c tempest-VolumesSnapshotTestJSON-1095862726 None] Creating direct copy from snapshot {{(pid=86639) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jul 02 19:57:11 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a03416d-d382-43b9-bc7b-bd196be13ddf]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 19:57:11 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-d2683d89-e348-4b40-bb42-93ced4d5e82c tempest-VolumesSnapshotTestJSON-1095862726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-978cba79-b651-4b63-8e13-31385e5ac858 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:57:11 devstack sudo[100810]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-978cba79-b651-4b63-8e13-31385e5ac858
Jul 02 19:57:11 devstack sudo[100810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:57:12 devstack sudo[100810]: pam_unix(sudo:session): session closed for user root
Jul 02 19:57:12 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-d2683d89-e348-4b40-bb42-93ced4d5e82c tempest-VolumesSnapshotTestJSON-1095862726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-978cba79-b651-4b63-8e13-31385e5ac858" returned: 0 in 0.827s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:57:12 devstack cinder-volume[86639]: DEBUG cinder.utils [None req-d2683d89-e348-4b40-bb42-93ced4d5e82c tempest-VolumesSnapshotTestJSON-1095862726 None] Path /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-61df04ff-8b5f-44d5-a93f-706d16cd56f4 not found in is_blk_device check {{(pid=86639) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 02 19:57:12 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-d2683d89-e348-4b40-bb42-93ced4d5e82c tempest-VolumesSnapshotTestJSON-1095862726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-978cba79-b651-4b63-8e13-31385e5ac858 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-61df04ff-8b5f-44d5-a93f-706d16cd56f4 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:57:12 devstack sudo[100815]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-978cba79-b651-4b63-8e13-31385e5ac858 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-61df04ff-8b5f-44d5-a93f-706d16cd56f4
Jul 02 19:57:12 devstack sudo[100815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:57:18 devstack sudo[100815]: pam_unix(sudo:session): session closed for user root
Jul 02 19:57:18 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-d2683d89-e348-4b40-bb42-93ced4d5e82c tempest-VolumesSnapshotTestJSON-1095862726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-978cba79-b651-4b63-8e13-31385e5ac858 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-61df04ff-8b5f-44d5-a93f-706d16cd56f4" returned: 0 in 5.847s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:57:18 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7010ffc-04fc-4894-a463-66267f4792ed]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 19:57:18 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-d2683d89-e348-4b40-bb42-93ced4d5e82c tempest-VolumesSnapshotTestJSON-1095862726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-978cba79-b651-4b63-8e13-31385e5ac858 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:57:18 devstack sudo[100842]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-978cba79-b651-4b63-8e13-31385e5ac858
Jul 02 19:57:18 devstack sudo[100842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:57:19 devstack sudo[100842]: pam_unix(sudo:session): session closed for user root
Jul 02 19:57:19 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-d2683d89-e348-4b40-bb42-93ced4d5e82c tempest-VolumesSnapshotTestJSON-1095862726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-978cba79-b651-4b63-8e13-31385e5ac858" returned: 0 in 1.127s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:57:19 devstack cinder-volume[86639]: DEBUG cinder.image.image_utils [None req-d2683d89-e348-4b40-bb42-93ced4d5e82c tempest-VolumesSnapshotTestJSON-1095862726 None] Image conversion details: src /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-978cba79-b651-4b63-8e13-31385e5ac858, size 1024.00 MB, duration 5.85 sec, destination /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-61df04ff-8b5f-44d5-a93f-706d16cd56f4 {{(pid=86639) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 02 19:57:19 devstack cinder-volume[86639]: INFO cinder.image.image_utils [None req-d2683d89-e348-4b40-bb42-93ced4d5e82c tempest-VolumesSnapshotTestJSON-1095862726 None] Converted 1024.00 MB image at 175.10 MB/s
Jul 02 19:57:19 devstack cinder-volume[86639]: WARNING cinder.volume.drivers.remotefs [None req-d2683d89-e348-4b40-bb42-93ced4d5e82c tempest-VolumesSnapshotTestJSON-1095862726 None] /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-61df04ff-8b5f-44d5-a93f-706d16cd56f4 is being set with open permissions: ugo+rw
Jul 02 19:57:19 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-d2683d89-e348-4b40-bb42-93ced4d5e82c tempest-VolumesSnapshotTestJSON-1095862726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-61df04ff-8b5f-44d5-a93f-706d16cd56f4 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:57:19 devstack sudo[100851]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-61df04ff-8b5f-44d5-a93f-706d16cd56f4
Jul 02 19:57:19 devstack sudo[100851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:57:20 devstack sudo[100851]: pam_unix(sudo:session): session closed for user root
Jul 02 19:57:20 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-d2683d89-e348-4b40-bb42-93ced4d5e82c tempest-VolumesSnapshotTestJSON-1095862726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-61df04ff-8b5f-44d5-a93f-706d16cd56f4" returned: 0 in 0.698s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:57:20 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-d2683d89-e348-4b40-bb42-93ced4d5e82c tempest-VolumesSnapshotTestJSON-1095862726 None] Lock "cinder-quobyte-61df04ff-8b5f-44d5-a93f-706d16cd56f4" released by "_copy_volume_from_snapshot" :: held 9.562s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:57:20 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-d2683d89-e348-4b40-bb42-93ced4d5e82c tempest-VolumesSnapshotTestJSON-1095862726 None] Lock "cinder-quobyte-60307871-7f4c-449e-8eb7-8fecb255a465-61df04ff-8b5f-44d5-a93f-706d16cd56f4" released by "_create_volume_from_snapshot" :: held 9.614s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:57:20 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-d2683d89-e348-4b40-bb42-93ced4d5e82c tempest-VolumesSnapshotTestJSON-1095862726 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.648s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:57:20 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-f64390dc-c12c-44ee-93f6-af94f9dbc69b tempest-VolumesTransfersV357Test-1930236706 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.571s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:57:20 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-f64390dc-c12c-44ee-93f6-af94f9dbc69b tempest-VolumesTransfersV357Test-1930236706 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce906cb830>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T17:57:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-2064966243',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66845b33-ad85-4b0d-b26e-21f40c4928c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30a9c62fdd38428ba32d5aa58388f878',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T17:57:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T17:57:11Z,use_quota=True,user_id='9bb84044ec7a4896897245103b1b5bd2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)}" {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 19:57:20 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-f64390dc-c12c-44ee-93f6-af94f9dbc69b tempest-VolumesTransfersV357Test-1930236706 None] Creating volume 66845b33-ad85-4b0d-b26e-21f40c4928c3 {{(pid=86639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 19:57:20 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-f64390dc-c12c-44ee-93f6-af94f9dbc69b tempest-VolumesTransfersV357Test-1930236706 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:57:20 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-f64390dc-c12c-44ee-93f6-af94f9dbc69b tempest-VolumesTransfersV357Test-1930236706 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:57:20 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-f64390dc-c12c-44ee-93f6-af94f9dbc69b tempest-VolumesTransfersV357Test-1930236706 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 19:57:20 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-f64390dc-c12c-44ee-93f6-af94f9dbc69b tempest-VolumesTransfersV357Test-1930236706 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 19:57:20 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-f64390dc-c12c-44ee-93f6-af94f9dbc69b tempest-VolumesTransfersV357Test-1930236706 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:57:20 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-f64390dc-c12c-44ee-93f6-af94f9dbc69b tempest-VolumesTransfersV357Test-1930236706 None] Selected osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92 as target Quobyte volume. {{(pid=86639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 19:57:20 devstack cinder-volume[86639]: INFO cinder.volume.drivers.remotefs [None req-f64390dc-c12c-44ee-93f6-af94f9dbc69b tempest-VolumesTransfersV357Test-1930236706 None] casted to osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92
Jul 02 19:57:20 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-f64390dc-c12c-44ee-93f6-af94f9dbc69b tempest-VolumesTransfersV357Test-1930236706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-66845b33-ad85-4b0d-b26e-21f40c4928c3 1073741824 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:57:20 devstack sudo[100854]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-66845b33-ad85-4b0d-b26e-21f40c4928c3 1073741824
Jul 02 19:57:20 devstack sudo[100854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:57:20 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-d2683d89-e348-4b40-bb42-93ced4d5e82c tempest-VolumesSnapshotTestJSON-1095862726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4ce3fd2-5b1b-4c73-be94-1459b34edcbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-61df04ff-8b5f-44d5-a93f-706d16cd56f4', 'volume_size': 1, 'snapshot_id': '60307871-7f4c-449e-8eb7-8fecb255a465'}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:57:20 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-d2683d89-e348-4b40-bb42-93ced4d5e82c tempest-VolumesSnapshotTestJSON-1095862726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65341ee2-2b0e-472c-a1f2-8a89a6d921b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:57:20 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-d2683d89-e348-4b40-bb42-93ced4d5e82c tempest-VolumesSnapshotTestJSON-1095862726 None] Volume volume-61df04ff-8b5f-44d5-a93f-706d16cd56f4 (61df04ff-8b5f-44d5-a93f-706d16cd56f4): created successfully
Jul 02 19:57:20 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-d2683d89-e348-4b40-bb42-93ced4d5e82c tempest-VolumesSnapshotTestJSON-1095862726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65341ee2-2b0e-472c-a1f2-8a89a6d921b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:57:20 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-d2683d89-e348-4b40-bb42-93ced4d5e82c tempest-VolumesSnapshotTestJSON-1095862726 None] Flow 'volume_create_manager' (61d0bde5-223f-48ac-922b-6564de9480f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 19:57:20 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-d2683d89-e348-4b40-bb42-93ced4d5e82c tempest-VolumesSnapshotTestJSON-1095862726 None] Created volume successfully.
Jul 02 19:57:20 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-789ba257-79ad-4bcb-92b4-936f8b175ad2 tempest-VolumesSnapshotTestJSON-1095862726 None] Acquiring lock "cinder-61df04ff-8b5f-44d5-a93f-706d16cd56f4-delete_volume" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:57:20 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-789ba257-79ad-4bcb-92b4-936f8b175ad2 tempest-VolumesSnapshotTestJSON-1095862726 None] Lock "cinder-61df04ff-8b5f-44d5-a93f-706d16cd56f4-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:57:20 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-789ba257-79ad-4bcb-92b4-936f8b175ad2 tempest-VolumesSnapshotTestJSON-1095862726 None] Acquiring lock "cinder-quobyte-61df04ff-8b5f-44d5-a93f-706d16cd56f4" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:57:20 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-789ba257-79ad-4bcb-92b4-936f8b175ad2 tempest-VolumesSnapshotTestJSON-1095862726 None] Lock "cinder-quobyte-61df04ff-8b5f-44d5-a93f-706d16cd56f4" acquired by "delete_volume" :: waited 0.018s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:57:20 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[e85fdf8a-b78d-40e4-a4d7-9f2bf8615fd6]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 19:57:20 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-789ba257-79ad-4bcb-92b4-936f8b175ad2 tempest-VolumesSnapshotTestJSON-1095862726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-61df04ff-8b5f-44d5-a93f-706d16cd56f4 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:57:20 devstack sudo[100857]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-61df04ff-8b5f-44d5-a93f-706d16cd56f4
Jul 02 19:57:20 devstack sudo[100857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:57:21 devstack sudo[100854]: pam_unix(sudo:session): session closed for user root
Jul 02 19:57:21 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-f64390dc-c12c-44ee-93f6-af94f9dbc69b tempest-VolumesTransfersV357Test-1930236706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-66845b33-ad85-4b0d-b26e-21f40c4928c3 1073741824" returned: 0 in 1.011s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:57:21 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-f64390dc-c12c-44ee-93f6-af94f9dbc69b tempest-VolumesTransfersV357Test-1930236706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-66845b33-ad85-4b0d-b26e-21f40c4928c3 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:57:21 devstack sudo[100861]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-66845b33-ad85-4b0d-b26e-21f40c4928c3
Jul 02 19:57:21 devstack sudo[100861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:57:21 devstack sudo[100857]: pam_unix(sudo:session): session closed for user root
Jul 02 19:57:21 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-789ba257-79ad-4bcb-92b4-936f8b175ad2 tempest-VolumesSnapshotTestJSON-1095862726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-61df04ff-8b5f-44d5-a93f-706d16cd56f4" returned: 0 in 0.992s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:57:21 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-789ba257-79ad-4bcb-92b4-936f8b175ad2 tempest-VolumesSnapshotTestJSON-1095862726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-61df04ff-8b5f-44d5-a93f-706d16cd56f4 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:57:21 devstack sudo[100866]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-61df04ff-8b5f-44d5-a93f-706d16cd56f4
Jul 02 19:57:21 devstack sudo[100866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:57:21 devstack sudo[100861]: pam_unix(sudo:session): session closed for user root
Jul 02 19:57:21 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-f64390dc-c12c-44ee-93f6-af94f9dbc69b tempest-VolumesTransfersV357Test-1930236706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-66845b33-ad85-4b0d-b26e-21f40c4928c3" returned: 0 in 0.739s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:57:21 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-f64390dc-c12c-44ee-93f6-af94f9dbc69b tempest-VolumesTransfersV357Test-1930236706 None] <== create_volume: return (1806ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'} {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 19:57:21 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-f64390dc-c12c-44ee-93f6-af94f9dbc69b tempest-VolumesTransfersV357Test-1930236706 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.810s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:57:21 devstack cinder-volume[86639]: DEBUG dbcounter [-] [86639] Writing DB stats cinder:SELECT=69,cinder:INSERT=22,cinder:UPDATE=86,cinder:DELETE=7 {{(pid=86639) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 02 19:57:21 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-f64390dc-c12c-44ee-93f6-af94f9dbc69b tempest-VolumesTransfersV357Test-1930236706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55e43e7f-9f07-40ba-9f37-189e0c94c845) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-66845b33-ad85-4b0d-b26e-21f40c4928c3', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:57:21 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-f64390dc-c12c-44ee-93f6-af94f9dbc69b tempest-VolumesTransfersV357Test-1930236706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49a05673-fddd-48db-8a7d-85c88fe7b3e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:57:22 devstack cinder-volume[86639]: DEBUG dbcounter [-] [86639] Writing DB stats cinder:SELECT=73,cinder:UPDATE=86,cinder:INSERT=20,cinder:DELETE=9 {{(pid=86639) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 02 19:57:22 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-f64390dc-c12c-44ee-93f6-af94f9dbc69b tempest-VolumesTransfersV357Test-1930236706 None] Volume volume-66845b33-ad85-4b0d-b26e-21f40c4928c3 (66845b33-ad85-4b0d-b26e-21f40c4928c3): created successfully
Jul 02 19:57:22 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-f64390dc-c12c-44ee-93f6-af94f9dbc69b tempest-VolumesTransfersV357Test-1930236706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49a05673-fddd-48db-8a7d-85c88fe7b3e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:57:22 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-f64390dc-c12c-44ee-93f6-af94f9dbc69b tempest-VolumesTransfersV357Test-1930236706 None] Flow 'volume_create_manager' (b7df02c0-8e15-4b7c-a5fa-b11cd9240c19) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 19:57:22 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-f64390dc-c12c-44ee-93f6-af94f9dbc69b tempest-VolumesTransfersV357Test-1930236706 None] Created volume successfully.
Jul 02 19:57:22 devstack sudo[100866]: pam_unix(sudo:session): session closed for user root
Jul 02 19:57:22 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-789ba257-79ad-4bcb-92b4-936f8b175ad2 tempest-VolumesSnapshotTestJSON-1095862726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-61df04ff-8b5f-44d5-a93f-706d16cd56f4" returned: 0 in 0.778s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:57:22 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-789ba257-79ad-4bcb-92b4-936f8b175ad2 tempest-VolumesSnapshotTestJSON-1095862726 None] Lock "cinder-quobyte-61df04ff-8b5f-44d5-a93f-706d16cd56f4" released by "delete_volume" :: held 1.812s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:57:22 devstack cinder-volume[86639]: DEBUG cinder.quota [None req-789ba257-79ad-4bcb-92b4-936f8b175ad2 tempest-VolumesSnapshotTestJSON-1095862726 None] Created reservations ['ca588ece-908d-4396-8ab6-5c24b157a182', '8591504d-c400-4250-8319-1d947164aa42', '4f6768df-9ff4-47a7-a65e-ffc0ede1a7ba', '55346928-4f7f-4b5c-9a3a-10a6460f996d'] {{(pid=86639) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 19:57:22 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-789ba257-79ad-4bcb-92b4-936f8b175ad2 tempest-VolumesSnapshotTestJSON-1095862726 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:57:22 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-789ba257-79ad-4bcb-92b4-936f8b175ad2 tempest-VolumesSnapshotTestJSON-1095862726 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:57:22 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-789ba257-79ad-4bcb-92b4-936f8b175ad2 tempest-VolumesSnapshotTestJSON-1095862726 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 19:57:22 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-789ba257-79ad-4bcb-92b4-936f8b175ad2 tempest-VolumesSnapshotTestJSON-1095862726 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 19:57:22 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-789ba257-79ad-4bcb-92b4-936f8b175ad2 tempest-VolumesSnapshotTestJSON-1095862726 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:57:22 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-789ba257-79ad-4bcb-92b4-936f8b175ad2 tempest-VolumesSnapshotTestJSON-1095862726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:57:22 devstack sudo[100873]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e
Jul 02 19:57:22 devstack sudo[100873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:57:22 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-59a60e8f-d847-4374-a086-5445e4bd7fb0 tempest-VolumesSnapshotTestJSON-1095862726 None] Acquiring lock "cinder-60307871-7f4c-449e-8eb7-8fecb255a465-delete_snapshot" by "delete_snapshot" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:57:23 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-59a60e8f-d847-4374-a086-5445e4bd7fb0 tempest-VolumesSnapshotTestJSON-1095862726 None] Lock "cinder-60307871-7f4c-449e-8eb7-8fecb255a465-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:57:23 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-59a60e8f-d847-4374-a086-5445e4bd7fb0 tempest-VolumesSnapshotTestJSON-1095862726 None] Acquiring lock "cinder-quobyte-978cba79-b651-4b63-8e13-31385e5ac858" by "delete_snapshot" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:57:23 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-59a60e8f-d847-4374-a086-5445e4bd7fb0 tempest-VolumesSnapshotTestJSON-1095862726 None] Lock "cinder-quobyte-978cba79-b651-4b63-8e13-31385e5ac858" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:57:23 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-59a60e8f-d847-4374-a086-5445e4bd7fb0 tempest-VolumesSnapshotTestJSON-1095862726 None] Acquiring lock "cinder-quobyte-60307871-7f4c-449e-8eb7-8fecb255a465" by "_delete_snapshot" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:57:23 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-59a60e8f-d847-4374-a086-5445e4bd7fb0 tempest-VolumesSnapshotTestJSON-1095862726 None] Lock "cinder-quobyte-60307871-7f4c-449e-8eb7-8fecb255a465" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:57:23 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-59a60e8f-d847-4374-a086-5445e4bd7fb0 tempest-VolumesSnapshotTestJSON-1095862726 None] Deleting offline snapshot 60307871-7f4c-449e-8eb7-8fecb255a465 of volume 978cba79-b651-4b63-8e13-31385e5ac858 {{(pid=86639) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 02 19:57:23 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-59a60e8f-d847-4374-a086-5445e4bd7fb0 tempest-VolumesSnapshotTestJSON-1095862726 None] snapshot_file for this snap is: volume-978cba79-b651-4b63-8e13-31385e5ac858.60307871-7f4c-449e-8eb7-8fecb255a465 {{(pid=86639) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 02 19:57:23 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dd84c91-4ca5-4da1-9c47-0ced25ee2a0d]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 19:57:23 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-59a60e8f-d847-4374-a086-5445e4bd7fb0 tempest-VolumesSnapshotTestJSON-1095862726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-978cba79-b651-4b63-8e13-31385e5ac858.60307871-7f4c-449e-8eb7-8fecb255a465 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:57:23 devstack sudo[100875]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-978cba79-b651-4b63-8e13-31385e5ac858.60307871-7f4c-449e-8eb7-8fecb255a465
Jul 02 19:57:23 devstack sudo[100875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:57:23 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-7a6ca8bd-6fa7-4aa7-bfaa-9a985d8574a3 tempest-VolumesTransfersV357Test-345234737 None] Transfer volume completed successfully.
Jul 02 19:57:23 devstack sudo[100873]: pam_unix(sudo:session): session closed for user root
Jul 02 19:57:23 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-789ba257-79ad-4bcb-92b4-936f8b175ad2 tempest-VolumesSnapshotTestJSON-1095862726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e" returned: 0 in 0.809s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:57:23 devstack cinder-volume[86639]: DEBUG cinder.manager [None req-789ba257-79ad-4bcb-92b4-936f8b175ad2 tempest-VolumesSnapshotTestJSON-1095862726 None] Notifying Schedulers of capabilities ... {{(pid=86639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 19:57:23 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-789ba257-79ad-4bcb-92b4-936f8b175ad2 tempest-VolumesSnapshotTestJSON-1095862726 None] Deleted volume successfully.
Jul 02 19:57:23 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-789ba257-79ad-4bcb-92b4-936f8b175ad2 tempest-VolumesSnapshotTestJSON-1095862726 None] Lock "cinder-61df04ff-8b5f-44d5-a93f-706d16cd56f4-delete_volume" released by "delete_volume" :: held 2.910s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:57:24 devstack sudo[100875]: pam_unix(sudo:session): session closed for user root
Jul 02 19:57:24 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-59a60e8f-d847-4374-a086-5445e4bd7fb0 tempest-VolumesSnapshotTestJSON-1095862726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-978cba79-b651-4b63-8e13-31385e5ac858.60307871-7f4c-449e-8eb7-8fecb255a465" returned: 0 in 0.974s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:57:24 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-59a60e8f-d847-4374-a086-5445e4bd7fb0 tempest-VolumesSnapshotTestJSON-1095862726 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-978cba79-b651-4b63-8e13-31385e5ac858(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86639) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 02 19:57:24 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ade23a4-9635-42d1-be2c-4ff44d32ca9c]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 19:57:24 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-59a60e8f-d847-4374-a086-5445e4bd7fb0 tempest-VolumesSnapshotTestJSON-1095862726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-978cba79-b651-4b63-8e13-31385e5ac858 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:57:24 devstack sudo[100882]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-978cba79-b651-4b63-8e13-31385e5ac858
Jul 02 19:57:24 devstack sudo[100882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:57:24 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-602bb56b-dce6-4e2f-a1be-f220cbfafcbe tempest-VolumesTransfersV357Test-776537754 None] Acquiring lock "cinder-66845b33-ad85-4b0d-b26e-21f40c4928c3-delete_volume" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:57:24 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-602bb56b-dce6-4e2f-a1be-f220cbfafcbe tempest-VolumesTransfersV357Test-776537754 None] Lock "cinder-66845b33-ad85-4b0d-b26e-21f40c4928c3-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:57:24 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-602bb56b-dce6-4e2f-a1be-f220cbfafcbe tempest-VolumesTransfersV357Test-776537754 None] Acquiring lock "cinder-quobyte-66845b33-ad85-4b0d-b26e-21f40c4928c3" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:57:24 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-602bb56b-dce6-4e2f-a1be-f220cbfafcbe tempest-VolumesTransfersV357Test-776537754 None] Lock "cinder-quobyte-66845b33-ad85-4b0d-b26e-21f40c4928c3" acquired by "delete_volume" :: waited 0.031s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:57:25 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[16dcffe0-afd2-40bc-829c-c837c9d0502b]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 19:57:25 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-602bb56b-dce6-4e2f-a1be-f220cbfafcbe tempest-VolumesTransfersV357Test-776537754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-66845b33-ad85-4b0d-b26e-21f40c4928c3 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:57:25 devstack sudo[100937]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-66845b33-ad85-4b0d-b26e-21f40c4928c3
Jul 02 19:57:25 devstack sudo[100937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:57:25 devstack sudo[100882]: pam_unix(sudo:session): session closed for user root
Jul 02 19:57:25 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-59a60e8f-d847-4374-a086-5445e4bd7fb0 tempest-VolumesSnapshotTestJSON-1095862726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-978cba79-b651-4b63-8e13-31385e5ac858" returned: 0 in 1.704s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:57:25 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-59a60e8f-d847-4374-a086-5445e4bd7fb0 tempest-VolumesSnapshotTestJSON-1095862726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-978cba79-b651-4b63-8e13-31385e5ac858.60307871-7f4c-449e-8eb7-8fecb255a465 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:57:25 devstack sudo[100956]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-978cba79-b651-4b63-8e13-31385e5ac858.60307871-7f4c-449e-8eb7-8fecb255a465
Jul 02 19:57:25 devstack sudo[100956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:57:26 devstack sudo[100937]: pam_unix(sudo:session): session closed for user root
Jul 02 19:57:26 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-602bb56b-dce6-4e2f-a1be-f220cbfafcbe tempest-VolumesTransfersV357Test-776537754 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-66845b33-ad85-4b0d-b26e-21f40c4928c3" returned: 0 in 1.625s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:57:26 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-602bb56b-dce6-4e2f-a1be-f220cbfafcbe tempest-VolumesTransfersV357Test-776537754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-66845b33-ad85-4b0d-b26e-21f40c4928c3 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:57:26 devstack sudo[100964]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-66845b33-ad85-4b0d-b26e-21f40c4928c3
Jul 02 19:57:26 devstack sudo[100964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:57:26 devstack sudo[100956]: pam_unix(sudo:session): session closed for user root
Jul 02 19:57:26 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-59a60e8f-d847-4374-a086-5445e4bd7fb0 tempest-VolumesSnapshotTestJSON-1095862726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-978cba79-b651-4b63-8e13-31385e5ac858.60307871-7f4c-449e-8eb7-8fecb255a465" returned: 0 in 1.135s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:57:26 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-59a60e8f-d847-4374-a086-5445e4bd7fb0 tempest-VolumesSnapshotTestJSON-1095862726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-978cba79-b651-4b63-8e13-31385e5ac858.60307871-7f4c-449e-8eb7-8fecb255a465 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:57:27 devstack sudo[100971]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-978cba79-b651-4b63-8e13-31385e5ac858.60307871-7f4c-449e-8eb7-8fecb255a465
Jul 02 19:57:27 devstack sudo[100971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:57:27 devstack sudo[100964]: pam_unix(sudo:session): session closed for user root
Jul 02 19:57:27 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-602bb56b-dce6-4e2f-a1be-f220cbfafcbe tempest-VolumesTransfersV357Test-776537754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-66845b33-ad85-4b0d-b26e-21f40c4928c3" returned: 0 in 0.919s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:57:27 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-602bb56b-dce6-4e2f-a1be-f220cbfafcbe tempest-VolumesTransfersV357Test-776537754 None] Lock "cinder-quobyte-66845b33-ad85-4b0d-b26e-21f40c4928c3" released by "delete_volume" :: held 2.625s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:57:27 devstack cinder-volume[86639]: DEBUG cinder.quota [None req-602bb56b-dce6-4e2f-a1be-f220cbfafcbe tempest-VolumesTransfersV357Test-776537754 None] Created reservations ['3bd66a95-7602-4454-b696-96852fb4454f', '6baebce3-77bc-4f78-a42d-fd4e820f5070', 'ff280234-8bb9-4c4f-b949-a29eccf16ce2', 'f06209e8-1b49-4673-9e88-797391449c25'] {{(pid=86639) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 19:57:27 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-602bb56b-dce6-4e2f-a1be-f220cbfafcbe tempest-VolumesTransfersV357Test-776537754 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:57:27 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-602bb56b-dce6-4e2f-a1be-f220cbfafcbe tempest-VolumesTransfersV357Test-776537754 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:57:27 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-602bb56b-dce6-4e2f-a1be-f220cbfafcbe tempest-VolumesTransfersV357Test-776537754 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 19:57:27 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-602bb56b-dce6-4e2f-a1be-f220cbfafcbe tempest-VolumesTransfersV357Test-776537754 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 19:57:27 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-602bb56b-dce6-4e2f-a1be-f220cbfafcbe tempest-VolumesTransfersV357Test-776537754 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:57:27 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-602bb56b-dce6-4e2f-a1be-f220cbfafcbe tempest-VolumesTransfersV357Test-776537754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:57:27 devstack sudo[100975]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e
Jul 02 19:57:27 devstack sudo[100975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:57:27 devstack sudo[100971]: pam_unix(sudo:session): session closed for user root
Jul 02 19:57:27 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-59a60e8f-d847-4374-a086-5445e4bd7fb0 tempest-VolumesSnapshotTestJSON-1095862726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-978cba79-b651-4b63-8e13-31385e5ac858.60307871-7f4c-449e-8eb7-8fecb255a465" returned: 0 in 0.950s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:57:27 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-59a60e8f-d847-4374-a086-5445e4bd7fb0 tempest-VolumesSnapshotTestJSON-1095862726 None] Lock "cinder-quobyte-60307871-7f4c-449e-8eb7-8fecb255a465" released by "_delete_snapshot" :: held 4.934s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:57:28 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-59a60e8f-d847-4374-a086-5445e4bd7fb0 tempest-VolumesSnapshotTestJSON-1095862726 None] Lock "cinder-quobyte-978cba79-b651-4b63-8e13-31385e5ac858" released by "delete_snapshot" :: held 4.967s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:57:28 devstack cinder-volume[86639]: DEBUG cinder.quota [None req-59a60e8f-d847-4374-a086-5445e4bd7fb0 tempest-VolumesSnapshotTestJSON-1095862726 None] Created reservations ['c96c3c47-c37b-4da0-8022-bf53d216f3a1', '82625c6b-3a92-4a69-9c28-2f90b6e2975f', 'd6a66935-7060-4082-93ff-eff08d84659d', '0f1b5533-dd99-4c8f-81d1-a71ceb612fff'] {{(pid=86639) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 19:57:28 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-59a60e8f-d847-4374-a086-5445e4bd7fb0 tempest-VolumesSnapshotTestJSON-1095862726 None] Delete snapshot completed successfully.
Jul 02 19:57:28 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-59a60e8f-d847-4374-a086-5445e4bd7fb0 tempest-VolumesSnapshotTestJSON-1095862726 None] Lock "cinder-60307871-7f4c-449e-8eb7-8fecb255a465-delete_snapshot" released by "delete_snapshot" :: held 5.230s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:57:28 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-9605455d-3acd-47f2-90c4-6d1193a9a9ec tempest-VolumesSnapshotTestJSON-1095862726 None] Acquiring lock "cinder-978cba79-b651-4b63-8e13-31385e5ac858-delete_volume" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:57:28 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-9605455d-3acd-47f2-90c4-6d1193a9a9ec tempest-VolumesSnapshotTestJSON-1095862726 None] Lock "cinder-978cba79-b651-4b63-8e13-31385e5ac858-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:57:28 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-9605455d-3acd-47f2-90c4-6d1193a9a9ec tempest-VolumesSnapshotTestJSON-1095862726 None] Acquiring lock "cinder-quobyte-978cba79-b651-4b63-8e13-31385e5ac858" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:57:28 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-9605455d-3acd-47f2-90c4-6d1193a9a9ec tempest-VolumesSnapshotTestJSON-1095862726 None] Lock "cinder-quobyte-978cba79-b651-4b63-8e13-31385e5ac858" acquired by "delete_volume" :: waited 0.046s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:57:28 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[7df93d89-cda6-45cd-8f70-b340af204a01]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 19:57:28 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-9605455d-3acd-47f2-90c4-6d1193a9a9ec tempest-VolumesSnapshotTestJSON-1095862726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-978cba79-b651-4b63-8e13-31385e5ac858 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:57:28 devstack sudo[100975]: pam_unix(sudo:session): session closed for user root
Jul 02 19:57:28 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-602bb56b-dce6-4e2f-a1be-f220cbfafcbe tempest-VolumesTransfersV357Test-776537754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e" returned: 0 in 1.200s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:57:28 devstack cinder-volume[86639]: DEBUG cinder.manager [None req-602bb56b-dce6-4e2f-a1be-f220cbfafcbe tempest-VolumesTransfersV357Test-776537754 None] Notifying Schedulers of capabilities ... {{(pid=86639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 19:57:28 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-602bb56b-dce6-4e2f-a1be-f220cbfafcbe tempest-VolumesTransfersV357Test-776537754 None] Deleted volume successfully.
Jul 02 19:57:29 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-602bb56b-dce6-4e2f-a1be-f220cbfafcbe tempest-VolumesTransfersV357Test-776537754 None] Lock "cinder-66845b33-ad85-4b0d-b26e-21f40c4928c3-delete_volume" released by "delete_volume" :: held 4.242s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:57:29 devstack sudo[100978]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-978cba79-b651-4b63-8e13-31385e5ac858
Jul 02 19:57:29 devstack sudo[100978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:57:29 devstack cinder-volume[86639]: DEBUG cinder.volume.flows.manager.create_volume [None req-b4083146-f2ab-485c-89ec-f56f9131e249 tempest-VolumesTransfersV357Test-1930236706 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 19:57:29 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-b4083146-f2ab-485c-89ec-f56f9131e249 tempest-VolumesTransfersV357Test-1930236706 None] Flow 'volume_create_manager' (45dc63d6-2c8c-490a-859c-2d566d588b0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 19:57:29 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-b4083146-f2ab-485c-89ec-f56f9131e249 tempest-VolumesTransfersV357Test-1930236706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a50bd71-e886-4917-8187-e22930524018) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:57:29 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-b4083146-f2ab-485c-89ec-f56f9131e249 tempest-VolumesTransfersV357Test-1930236706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a50bd71-e886-4917-8187-e22930524018) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T17:57:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-312836735',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afd8b96f-ca56-4e72-b394-16d0040c0017,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30a9c62fdd38428ba32d5aa58388f878',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T17:57:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T17:57:29Z,use_quota=True,user_id='9bb84044ec7a4896897245103b1b5bd2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:57:29 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-b4083146-f2ab-485c-89ec-f56f9131e249 tempest-VolumesTransfersV357Test-1930236706 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ccc4841-790c-4376-b7ca-4cde7419b21e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:57:29 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-b4083146-f2ab-485c-89ec-f56f9131e249 tempest-VolumesTransfersV357Test-1930236706 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ccc4841-790c-4376-b7ca-4cde7419b21e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:57:29 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-b4083146-f2ab-485c-89ec-f56f9131e249 tempest-VolumesTransfersV357Test-1930236706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e8ba625-25b8-4b6b-901b-08c8df504873) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:57:29 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-b4083146-f2ab-485c-89ec-f56f9131e249 tempest-VolumesTransfersV357Test-1930236706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e8ba625-25b8-4b6b-901b-08c8df504873) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'afd8b96f-ca56-4e72-b394-16d0040c0017', 'volume_name': 'volume-afd8b96f-ca56-4e72-b394-16d0040c0017', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:57:29 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-b4083146-f2ab-485c-89ec-f56f9131e249 tempest-VolumesTransfersV357Test-1930236706 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25257d49-8cfc-4a74-90fe-d529aadc0d45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:57:29 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-b4083146-f2ab-485c-89ec-f56f9131e249 tempest-VolumesTransfersV357Test-1930236706 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25257d49-8cfc-4a74-90fe-d529aadc0d45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:57:29 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-b4083146-f2ab-485c-89ec-f56f9131e249 tempest-VolumesTransfersV357Test-1930236706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4247b95-1513-48c9-88ba-d473bd6731a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:57:29 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-b4083146-f2ab-485c-89ec-f56f9131e249 tempest-VolumesTransfersV357Test-1930236706 None] Volume afd8b96f-ca56-4e72-b394-16d0040c0017: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-afd8b96f-ca56-4e72-b394-16d0040c0017', 'volume_size': 1}
Jul 02 19:57:29 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-b4083146-f2ab-485c-89ec-f56f9131e249 tempest-VolumesTransfersV357Test-1930236706 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:57:29 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-b4083146-f2ab-485c-89ec-f56f9131e249 tempest-VolumesTransfersV357Test-1930236706 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:57:29 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-b4083146-f2ab-485c-89ec-f56f9131e249 tempest-VolumesTransfersV357Test-1930236706 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce906cb830>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T17:57:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-312836735',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afd8b96f-ca56-4e72-b394-16d0040c0017,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30a9c62fdd38428ba32d5aa58388f878',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T17:57:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T17:57:29Z,use_quota=True,user_id='9bb84044ec7a4896897245103b1b5bd2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)}" {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 19:57:29 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-b4083146-f2ab-485c-89ec-f56f9131e249 tempest-VolumesTransfersV357Test-1930236706 None] Creating volume afd8b96f-ca56-4e72-b394-16d0040c0017 {{(pid=86639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 19:57:29 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-b4083146-f2ab-485c-89ec-f56f9131e249 tempest-VolumesTransfersV357Test-1930236706 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:57:29 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-b4083146-f2ab-485c-89ec-f56f9131e249 tempest-VolumesTransfersV357Test-1930236706 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:57:29 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-b4083146-f2ab-485c-89ec-f56f9131e249 tempest-VolumesTransfersV357Test-1930236706 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 19:57:29 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-b4083146-f2ab-485c-89ec-f56f9131e249 tempest-VolumesTransfersV357Test-1930236706 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 19:57:29 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-b4083146-f2ab-485c-89ec-f56f9131e249 tempest-VolumesTransfersV357Test-1930236706 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:57:29 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-b4083146-f2ab-485c-89ec-f56f9131e249 tempest-VolumesTransfersV357Test-1930236706 None] Selected osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92 as target Quobyte volume. {{(pid=86639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 19:57:29 devstack cinder-volume[86639]: INFO cinder.volume.drivers.remotefs [None req-b4083146-f2ab-485c-89ec-f56f9131e249 tempest-VolumesTransfersV357Test-1930236706 None] casted to osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92
Jul 02 19:57:29 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-b4083146-f2ab-485c-89ec-f56f9131e249 tempest-VolumesTransfersV357Test-1930236706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-afd8b96f-ca56-4e72-b394-16d0040c0017 1073741824 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:57:29 devstack sudo[100994]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-afd8b96f-ca56-4e72-b394-16d0040c0017 1073741824
Jul 02 19:57:29 devstack sudo[100994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:57:30 devstack sudo[100978]: pam_unix(sudo:session): session closed for user root
Jul 02 19:57:30 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-9605455d-3acd-47f2-90c4-6d1193a9a9ec tempest-VolumesSnapshotTestJSON-1095862726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-978cba79-b651-4b63-8e13-31385e5ac858" returned: 0 in 1.290s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:57:30 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-9605455d-3acd-47f2-90c4-6d1193a9a9ec tempest-VolumesSnapshotTestJSON-1095862726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-978cba79-b651-4b63-8e13-31385e5ac858 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:57:30 devstack sudo[101021]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-978cba79-b651-4b63-8e13-31385e5ac858
Jul 02 19:57:30 devstack sudo[101021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:57:31 devstack sudo[100994]: pam_unix(sudo:session): session closed for user root
Jul 02 19:57:31 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-b4083146-f2ab-485c-89ec-f56f9131e249 tempest-VolumesTransfersV357Test-1930236706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-afd8b96f-ca56-4e72-b394-16d0040c0017 1073741824" returned: 0 in 1.435s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:57:31 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-b4083146-f2ab-485c-89ec-f56f9131e249 tempest-VolumesTransfersV357Test-1930236706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-afd8b96f-ca56-4e72-b394-16d0040c0017 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:57:31 devstack sudo[101029]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-afd8b96f-ca56-4e72-b394-16d0040c0017
Jul 02 19:57:31 devstack sudo[101029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:57:31 devstack sudo[101021]: pam_unix(sudo:session): session closed for user root
Jul 02 19:57:31 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-9605455d-3acd-47f2-90c4-6d1193a9a9ec tempest-VolumesSnapshotTestJSON-1095862726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-978cba79-b651-4b63-8e13-31385e5ac858" returned: 0 in 0.994s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:57:31 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-9605455d-3acd-47f2-90c4-6d1193a9a9ec tempest-VolumesSnapshotTestJSON-1095862726 None] Lock "cinder-quobyte-978cba79-b651-4b63-8e13-31385e5ac858" released by "delete_volume" :: held 2.396s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:57:31 devstack cinder-volume[86639]: DEBUG cinder.quota [None req-9605455d-3acd-47f2-90c4-6d1193a9a9ec tempest-VolumesSnapshotTestJSON-1095862726 None] Created reservations ['57a72c80-72d4-4df8-87bd-2bd056b5696e', '57f3b3b4-cf74-48fd-9208-8dc2e54171bf', 'd07a3fbe-70a6-4d8f-bf8e-cac83e5aca9d', '362f5ba7-c237-4c0c-990b-4cf7206622c9'] {{(pid=86639) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 19:57:31 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-9605455d-3acd-47f2-90c4-6d1193a9a9ec tempest-VolumesSnapshotTestJSON-1095862726 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:57:31 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-9605455d-3acd-47f2-90c4-6d1193a9a9ec tempest-VolumesSnapshotTestJSON-1095862726 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:57:31 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-9605455d-3acd-47f2-90c4-6d1193a9a9ec tempest-VolumesSnapshotTestJSON-1095862726 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 19:57:31 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-9605455d-3acd-47f2-90c4-6d1193a9a9ec tempest-VolumesSnapshotTestJSON-1095862726 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 19:57:31 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-9605455d-3acd-47f2-90c4-6d1193a9a9ec tempest-VolumesSnapshotTestJSON-1095862726 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:57:31 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-9605455d-3acd-47f2-90c4-6d1193a9a9ec tempest-VolumesSnapshotTestJSON-1095862726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:57:31 devstack sudo[101031]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e
Jul 02 19:57:31 devstack sudo[101031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:57:32 devstack sudo[101029]: pam_unix(sudo:session): session closed for user root
Jul 02 19:57:32 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-b4083146-f2ab-485c-89ec-f56f9131e249 tempest-VolumesTransfersV357Test-1930236706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-afd8b96f-ca56-4e72-b394-16d0040c0017" returned: 0 in 0.889s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:57:32 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-b4083146-f2ab-485c-89ec-f56f9131e249 tempest-VolumesTransfersV357Test-1930236706 None] <== create_volume: return (2388ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'} {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 19:57:32 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-b4083146-f2ab-485c-89ec-f56f9131e249 tempest-VolumesTransfersV357Test-1930236706 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.406s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:57:32 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-b4083146-f2ab-485c-89ec-f56f9131e249 tempest-VolumesTransfersV357Test-1930236706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4247b95-1513-48c9-88ba-d473bd6731a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-afd8b96f-ca56-4e72-b394-16d0040c0017', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:57:32 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-b4083146-f2ab-485c-89ec-f56f9131e249 tempest-VolumesTransfersV357Test-1930236706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65c00b12-44ec-4302-9064-d81d7ec960a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:57:32 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-b4083146-f2ab-485c-89ec-f56f9131e249 tempest-VolumesTransfersV357Test-1930236706 None] Volume volume-afd8b96f-ca56-4e72-b394-16d0040c0017 (afd8b96f-ca56-4e72-b394-16d0040c0017): created successfully
Jul 02 19:57:32 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-b4083146-f2ab-485c-89ec-f56f9131e249 tempest-VolumesTransfersV357Test-1930236706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65c00b12-44ec-4302-9064-d81d7ec960a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:57:32 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-b4083146-f2ab-485c-89ec-f56f9131e249 tempest-VolumesTransfersV357Test-1930236706 None] Flow 'volume_create_manager' (45dc63d6-2c8c-490a-859c-2d566d588b0b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 19:57:32 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-b4083146-f2ab-485c-89ec-f56f9131e249 tempest-VolumesTransfersV357Test-1930236706 None] Created volume successfully.
Jul 02 19:57:32 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-46504a8b-86fd-4f86-9c2c-215ef593b669 tempest-VolumesSnapshotTestJSON-1095862726 None] Acquiring lock "cinder-133719cd-d5ad-4a1e-a6e4-904d5ba1b7c4-delete_volume" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:57:32 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-46504a8b-86fd-4f86-9c2c-215ef593b669 tempest-VolumesSnapshotTestJSON-1095862726 None] Lock "cinder-133719cd-d5ad-4a1e-a6e4-904d5ba1b7c4-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:57:32 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-46504a8b-86fd-4f86-9c2c-215ef593b669 tempest-VolumesSnapshotTestJSON-1095862726 None] Acquiring lock "cinder-quobyte-133719cd-d5ad-4a1e-a6e4-904d5ba1b7c4" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:57:32 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-46504a8b-86fd-4f86-9c2c-215ef593b669 tempest-VolumesSnapshotTestJSON-1095862726 None] Lock "cinder-quobyte-133719cd-d5ad-4a1e-a6e4-904d5ba1b7c4" acquired by "delete_volume" :: waited 0.020s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:57:32 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1342b96-c0d7-4f17-a766-aa62f26a1a17]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 19:57:32 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-46504a8b-86fd-4f86-9c2c-215ef593b669 tempest-VolumesSnapshotTestJSON-1095862726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-133719cd-d5ad-4a1e-a6e4-904d5ba1b7c4 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:57:32 devstack sudo[101031]: pam_unix(sudo:session): session closed for user root
Jul 02 19:57:32 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-9605455d-3acd-47f2-90c4-6d1193a9a9ec tempest-VolumesSnapshotTestJSON-1095862726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e" returned: 0 in 1.095s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:57:32 devstack cinder-volume[86639]: DEBUG cinder.manager [None req-9605455d-3acd-47f2-90c4-6d1193a9a9ec tempest-VolumesSnapshotTestJSON-1095862726 None] Notifying Schedulers of capabilities ... {{(pid=86639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 19:57:32 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-9605455d-3acd-47f2-90c4-6d1193a9a9ec tempest-VolumesSnapshotTestJSON-1095862726 None] Deleted volume successfully.
Jul 02 19:57:32 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-9605455d-3acd-47f2-90c4-6d1193a9a9ec tempest-VolumesSnapshotTestJSON-1095862726 None] Lock "cinder-978cba79-b651-4b63-8e13-31385e5ac858-delete_volume" released by "delete_volume" :: held 3.949s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:57:32 devstack sudo[101036]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-133719cd-d5ad-4a1e-a6e4-904d5ba1b7c4
Jul 02 19:57:32 devstack sudo[101036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:57:33 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-4f907141-a8aa-4979-949b-0987d39e8b89 tempest-VolumesTransfersV357Test-776537754 None] Acquiring lock "cinder-afd8b96f-ca56-4e72-b394-16d0040c0017-delete_volume" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:57:33 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-4f907141-a8aa-4979-949b-0987d39e8b89 tempest-VolumesTransfersV357Test-776537754 None] Lock "cinder-afd8b96f-ca56-4e72-b394-16d0040c0017-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:57:33 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-4f907141-a8aa-4979-949b-0987d39e8b89 tempest-VolumesTransfersV357Test-776537754 None] Acquiring lock "cinder-quobyte-afd8b96f-ca56-4e72-b394-16d0040c0017" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:57:33 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-4f907141-a8aa-4979-949b-0987d39e8b89 tempest-VolumesTransfersV357Test-776537754 None] Lock "cinder-quobyte-afd8b96f-ca56-4e72-b394-16d0040c0017" acquired by "delete_volume" :: waited 0.043s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:57:33 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d953740-25d9-47c1-9ca8-971810bb2849]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 19:57:33 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-4f907141-a8aa-4979-949b-0987d39e8b89 tempest-VolumesTransfersV357Test-776537754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-afd8b96f-ca56-4e72-b394-16d0040c0017 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:57:33 devstack sudo[101045]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-afd8b96f-ca56-4e72-b394-16d0040c0017
Jul 02 19:57:33 devstack sudo[101045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:57:34 devstack sudo[101036]: pam_unix(sudo:session): session closed for user root
Jul 02 19:57:34 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-46504a8b-86fd-4f86-9c2c-215ef593b669 tempest-VolumesSnapshotTestJSON-1095862726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-133719cd-d5ad-4a1e-a6e4-904d5ba1b7c4" returned: 0 in 1.542s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:57:34 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-46504a8b-86fd-4f86-9c2c-215ef593b669 tempest-VolumesSnapshotTestJSON-1095862726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-133719cd-d5ad-4a1e-a6e4-904d5ba1b7c4 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:57:34 devstack sudo[101052]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-133719cd-d5ad-4a1e-a6e4-904d5ba1b7c4
Jul 02 19:57:34 devstack sudo[101052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:57:34 devstack sudo[101052]: pam_unix(sudo:session): session closed for user root
Jul 02 19:57:34 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-46504a8b-86fd-4f86-9c2c-215ef593b669 tempest-VolumesSnapshotTestJSON-1095862726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-133719cd-d5ad-4a1e-a6e4-904d5ba1b7c4" returned: 0 in 0.899s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:57:34 devstack sudo[101045]: pam_unix(sudo:session): session closed for user root
Jul 02 19:57:34 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-4f907141-a8aa-4979-949b-0987d39e8b89 tempest-VolumesTransfersV357Test-776537754 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-afd8b96f-ca56-4e72-b394-16d0040c0017" returned: 0 in 1.527s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:57:34 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-4f907141-a8aa-4979-949b-0987d39e8b89 tempest-VolumesTransfersV357Test-776537754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-afd8b96f-ca56-4e72-b394-16d0040c0017 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:57:35 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-46504a8b-86fd-4f86-9c2c-215ef593b669 tempest-VolumesSnapshotTestJSON-1095862726 None] Lock "cinder-quobyte-133719cd-d5ad-4a1e-a6e4-904d5ba1b7c4" released by "delete_volume" :: held 2.537s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:57:35 devstack sudo[101058]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-afd8b96f-ca56-4e72-b394-16d0040c0017
Jul 02 19:57:35 devstack sudo[101058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:57:35 devstack cinder-volume[86639]: DEBUG cinder.quota [None req-46504a8b-86fd-4f86-9c2c-215ef593b669 tempest-VolumesSnapshotTestJSON-1095862726 None] Created reservations ['00dd8846-d3a0-4335-bb97-7bbcc08e3288', '8cd03fe6-0f13-4a86-9364-cbbee885c373', 'f965c88d-42dd-4d97-811e-903aa2b86feb', '442343b8-aa15-42e2-8663-254d2bec10b2'] {{(pid=86639) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 19:57:35 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-46504a8b-86fd-4f86-9c2c-215ef593b669 tempest-VolumesSnapshotTestJSON-1095862726 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:57:35 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-46504a8b-86fd-4f86-9c2c-215ef593b669 tempest-VolumesSnapshotTestJSON-1095862726 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:57:35 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-46504a8b-86fd-4f86-9c2c-215ef593b669 tempest-VolumesSnapshotTestJSON-1095862726 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 19:57:35 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-46504a8b-86fd-4f86-9c2c-215ef593b669 tempest-VolumesSnapshotTestJSON-1095862726 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 19:57:35 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-46504a8b-86fd-4f86-9c2c-215ef593b669 tempest-VolumesSnapshotTestJSON-1095862726 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:57:35 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-46504a8b-86fd-4f86-9c2c-215ef593b669 tempest-VolumesSnapshotTestJSON-1095862726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:57:35 devstack sudo[101060]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e
Jul 02 19:57:35 devstack sudo[101060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:57:35 devstack sudo[101058]: pam_unix(sudo:session): session closed for user root
Jul 02 19:57:35 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-4f907141-a8aa-4979-949b-0987d39e8b89 tempest-VolumesTransfersV357Test-776537754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-afd8b96f-ca56-4e72-b394-16d0040c0017" returned: 0 in 0.765s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:57:35 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-4f907141-a8aa-4979-949b-0987d39e8b89 tempest-VolumesTransfersV357Test-776537754 None] Lock "cinder-quobyte-afd8b96f-ca56-4e72-b394-16d0040c0017" released by "delete_volume" :: held 2.375s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:57:35 devstack sudo[101060]: pam_unix(sudo:session): session closed for user root
Jul 02 19:57:35 devstack cinder-volume[86639]: DEBUG cinder.quota [None req-4f907141-a8aa-4979-949b-0987d39e8b89 tempest-VolumesTransfersV357Test-776537754 None] Created reservations ['6caf5fcc-43b4-43a7-87dc-e8b27a16cc2a', '4ad3bf3c-efe4-43a6-8426-8c2c8ec8b51f', 'bc30f06b-a2fd-4a3a-bc76-d40674b36af7', '4a36fd50-6f7d-4f53-b187-72b6b72e3f29'] {{(pid=86639) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 19:57:35 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-46504a8b-86fd-4f86-9c2c-215ef593b669 tempest-VolumesSnapshotTestJSON-1095862726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e" returned: 0 in 0.757s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:57:35 devstack cinder-volume[86639]: DEBUG cinder.manager [None req-46504a8b-86fd-4f86-9c2c-215ef593b669 tempest-VolumesSnapshotTestJSON-1095862726 None] Notifying Schedulers of capabilities ... {{(pid=86639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 19:57:35 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-46504a8b-86fd-4f86-9c2c-215ef593b669 tempest-VolumesSnapshotTestJSON-1095862726 None] Deleted volume successfully.
Jul 02 19:57:35 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-46504a8b-86fd-4f86-9c2c-215ef593b669 tempest-VolumesSnapshotTestJSON-1095862726 None] Lock "cinder-133719cd-d5ad-4a1e-a6e4-904d5ba1b7c4-delete_volume" released by "delete_volume" :: held 3.554s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:57:35 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-4f907141-a8aa-4979-949b-0987d39e8b89 tempest-VolumesTransfersV357Test-776537754 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:57:35 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-4f907141-a8aa-4979-949b-0987d39e8b89 tempest-VolumesTransfersV357Test-776537754 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:57:35 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-4f907141-a8aa-4979-949b-0987d39e8b89 tempest-VolumesTransfersV357Test-776537754 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 19:57:35 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-4f907141-a8aa-4979-949b-0987d39e8b89 tempest-VolumesTransfersV357Test-776537754 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 19:57:35 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-4f907141-a8aa-4979-949b-0987d39e8b89 tempest-VolumesTransfersV357Test-776537754 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:57:35 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-4f907141-a8aa-4979-949b-0987d39e8b89 tempest-VolumesTransfersV357Test-776537754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:57:36 devstack sudo[101064]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e
Jul 02 19:57:36 devstack sudo[101064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:57:36 devstack sudo[101064]: pam_unix(sudo:session): session closed for user root
Jul 02 19:57:36 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-4f907141-a8aa-4979-949b-0987d39e8b89 tempest-VolumesTransfersV357Test-776537754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e" returned: 0 in 0.690s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:57:36 devstack cinder-volume[86639]: DEBUG cinder.manager [None req-4f907141-a8aa-4979-949b-0987d39e8b89 tempest-VolumesTransfersV357Test-776537754 None] Notifying Schedulers of capabilities ... {{(pid=86639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 19:57:36 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-4f907141-a8aa-4979-949b-0987d39e8b89 tempest-VolumesTransfersV357Test-776537754 None] Deleted volume successfully.
Jul 02 19:57:36 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-4f907141-a8aa-4979-949b-0987d39e8b89 tempest-VolumesTransfersV357Test-776537754 None] Lock "cinder-afd8b96f-ca56-4e72-b394-16d0040c0017-delete_volume" released by "delete_volume" :: held 3.465s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:57:41 devstack cinder-volume[86639]: DEBUG oslo_service.periodic_task [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86639) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 02 19:57:41 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:57:41 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:57:41 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 19:57:41 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 19:57:41 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:57:41 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:57:41 devstack sudo[101099]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e
Jul 02 19:57:41 devstack sudo[101099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:57:42 devstack sudo[101099]: pam_unix(sudo:session): session closed for user root
Jul 02 19:57:42 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e" returned: 0 in 0.731s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:57:42 devstack cinder-volume[86639]: DEBUG cinder.manager [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] Notifying Schedulers of capabilities ... {{(pid=86639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 19:57:42 devstack cinder-volume[86639]: DEBUG oslo_service.periodic_task [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] Running periodic task VolumeManager._thread_info {{(pid=86639) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 02 19:57:42 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] thread count: 28 {{(pid=86639) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 02 19:57:42 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] thread info: [<_MainThread(MainThread, started 140525261275264)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 140525150678016)>, <Thread(Thread-3 (stat_writer), started daemon 140525150025920)>, <Thread(Rabbit-heartbeat, started daemon 140525150500864)>, <Thread(Thread-5 (_runner), started daemon 140525149847296)>, <Thread(Thread-7 (_runner), started daemon 140525149863424)>, <Thread(fd_logger, started daemon 140525146589376)>, <Thread(privsep_reader, started daemon 140525144562432)>, <Thread(tpool_thread_0, started daemon 140525137151680)>, <Thread(tpool_thread_1, started daemon 140525128758976)>, <Thread(tpool_thread_2, started daemon 140525120349888)>, <Thread(tpool_thread_3, started daemon 140525111940800)>, <Thread(tpool_thread_4, started daemon 140525103531712)>, <Thread(tpool_thread_5, started daemon 140525095122624)>, <Thread(tpool_thread_6, started daemon 140525086713536)>, <Thread(tpool_thread_7, started daemon 140525078304448)>, <Thread(tpool_thread_8, started daemon 140525069895360)>, <Thread(tpool_thread_9, started daemon 140525061486272)>, <Thread(tpool_thread_10, started daemon 140525053077184)>, <Thread(tpool_thread_11, started daemon 140525044668096)>, <Thread(tpool_thread_12, started daemon 140525036259008)>, <Thread(tpool_thread_13, started daemon 140525027849920)>, <Thread(tpool_thread_14, started daemon 140525019440832)>, <Thread(tpool_thread_15, started daemon 140525011031744)>, <Thread(tpool_thread_16, started daemon 140525002622656)>, <Thread(tpool_thread_17, started daemon 140524994213568)>, <Thread(tpool_thread_18, started daemon 140524985804480)>, <Thread(tpool_thread_19, started daemon 140524977395392)>] {{(pid=86639) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 02 19:57:45 devstack cinder-volume[86639]: DEBUG dbcounter [-] [86639] Writing DB stats cinder:SELECT=34,cinder:INSERT=12,cinder:UPDATE=42,cinder:DELETE=2 {{(pid=86639) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 02 19:57:46 devstack cinder-volume[86639]: DEBUG dbcounter [-] [86639] Writing DB stats cinder:UPDATE=55,cinder:DELETE=5,cinder:SELECT=30,cinder:INSERT=13 {{(pid=86639) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 02 19:57:56 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [req-429a4ba9-4745-48ae-86c8-27f6b5c862c6 req-47e84946-03d8-448b-975e-e9481f6dec62 tempest-TestStampPattern-490270338 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:57:56 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [req-429a4ba9-4745-48ae-86c8-27f6b5c862c6 req-47e84946-03d8-448b-975e-e9481f6dec62 tempest-TestStampPattern-490270338 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:57:56 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[43867547-33de-421d-acb7-b003f7fe192e]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 19:57:56 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [req-429a4ba9-4745-48ae-86c8-27f6b5c862c6 req-47e84946-03d8-448b-975e-e9481f6dec62 tempest-TestStampPattern-490270338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-3f01b42d-1ed5-4eb3-be31-1f30a012b64e {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:57:56 devstack sudo[101123]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-3f01b42d-1ed5-4eb3-be31-1f30a012b64e
Jul 02 19:57:56 devstack sudo[101123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:57:57 devstack sudo[101123]: pam_unix(sudo:session): session closed for user root
Jul 02 19:57:57 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [req-429a4ba9-4745-48ae-86c8-27f6b5c862c6 req-47e84946-03d8-448b-975e-e9481f6dec62 tempest-TestStampPattern-490270338 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-3f01b42d-1ed5-4eb3-be31-1f30a012b64e" returned: 0 in 1.011s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:57:57 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [req-429a4ba9-4745-48ae-86c8-27f6b5c862c6 req-47e84946-03d8-448b-975e-e9481f6dec62 tempest-TestStampPattern-490270338 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.035s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:57:57 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [req-429a4ba9-4745-48ae-86c8-27f6b5c862c6 req-47e84946-03d8-448b-975e-e9481f6dec62 tempest-TestStampPattern-490270338 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92', 'name': 'volume-3f01b42d-1ed5-4eb3-be31-1f30a012b64e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '97f5f9d9-53bd-4592-ade3-39ea37dca3ee', 'enforce_multipath': True} {{(pid=86639) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 02 19:57:57 devstack cinder-volume[86639]: INFO cinder.volume.manager [req-429a4ba9-4745-48ae-86c8-27f6b5c862c6 req-47e84946-03d8-448b-975e-e9481f6dec62 tempest-TestStampPattern-490270338 None] attachment_update completed successfully.
Jul 02 19:58:00 devstack cinder-volume[86639]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e208136-26ad-46c1-a0f0-a0efcbf5b092 tempest-VolumesActionsTest-648440304 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 19:58:00 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-9e208136-26ad-46c1-a0f0-a0efcbf5b092 tempest-VolumesActionsTest-648440304 None] Flow 'volume_create_manager' (bbfd4afc-6c1d-4156-85c7-92fb6704f71f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 19:58:00 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-9e208136-26ad-46c1-a0f0-a0efcbf5b092 tempest-VolumesActionsTest-648440304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a803c7bb-bdf0-4d2a-a2be-9f96d6d2ad48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:58:00 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-9e208136-26ad-46c1-a0f0-a0efcbf5b092 tempest-VolumesActionsTest-648440304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a803c7bb-bdf0-4d2a-a2be-9f96d6d2ad48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T17:58:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-152402458',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3253631-10f6-49c9-bdfe-0736345fc3f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8fe2a3ee9a14e9ebca152c5ff60fb55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T17:58:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T17:58:00Z,use_quota=True,user_id='370748ed90e44168a1661fa5d695a9f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:58:00 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-9e208136-26ad-46c1-a0f0-a0efcbf5b092 tempest-VolumesActionsTest-648440304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f3f1c0d-bf70-40e7-9f79-2c2ce14ed5f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:58:00 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-9e208136-26ad-46c1-a0f0-a0efcbf5b092 tempest-VolumesActionsTest-648440304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f3f1c0d-bf70-40e7-9f79-2c2ce14ed5f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:58:00 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-9e208136-26ad-46c1-a0f0-a0efcbf5b092 tempest-VolumesActionsTest-648440304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84c9dbcd-d53a-4e7b-b5e3-9c5113811f5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:58:00 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-9e208136-26ad-46c1-a0f0-a0efcbf5b092 tempest-VolumesActionsTest-648440304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84c9dbcd-d53a-4e7b-b5e3-9c5113811f5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b3253631-10f6-49c9-bdfe-0736345fc3f8', 'volume_name': 'volume-b3253631-10f6-49c9-bdfe-0736345fc3f8', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:58:00 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-9e208136-26ad-46c1-a0f0-a0efcbf5b092 tempest-VolumesActionsTest-648440304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1380c28-b6e4-48ba-b428-3c1d998f92d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:58:00 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-9e208136-26ad-46c1-a0f0-a0efcbf5b092 tempest-VolumesActionsTest-648440304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1380c28-b6e4-48ba-b428-3c1d998f92d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:58:00 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-9e208136-26ad-46c1-a0f0-a0efcbf5b092 tempest-VolumesActionsTest-648440304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e06757a7-de2d-4f3a-ad6b-082c293cf5c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:58:00 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-9e208136-26ad-46c1-a0f0-a0efcbf5b092 tempest-VolumesActionsTest-648440304 None] Volume b3253631-10f6-49c9-bdfe-0736345fc3f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b3253631-10f6-49c9-bdfe-0736345fc3f8', 'volume_size': 1}
Jul 02 19:58:00 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-9e208136-26ad-46c1-a0f0-a0efcbf5b092 tempest-VolumesActionsTest-648440304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:58:00 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-9e208136-26ad-46c1-a0f0-a0efcbf5b092 tempest-VolumesActionsTest-648440304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:58:00 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-9e208136-26ad-46c1-a0f0-a0efcbf5b092 tempest-VolumesActionsTest-648440304 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce906cb830>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T17:58:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-152402458',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3253631-10f6-49c9-bdfe-0736345fc3f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8fe2a3ee9a14e9ebca152c5ff60fb55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T17:58:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T17:58:00Z,use_quota=True,user_id='370748ed90e44168a1661fa5d695a9f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)}" {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 19:58:00 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-9e208136-26ad-46c1-a0f0-a0efcbf5b092 tempest-VolumesActionsTest-648440304 None] Creating volume b3253631-10f6-49c9-bdfe-0736345fc3f8 {{(pid=86639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 19:58:00 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-9e208136-26ad-46c1-a0f0-a0efcbf5b092 tempest-VolumesActionsTest-648440304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:58:00 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-9e208136-26ad-46c1-a0f0-a0efcbf5b092 tempest-VolumesActionsTest-648440304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:58:00 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-9e208136-26ad-46c1-a0f0-a0efcbf5b092 tempest-VolumesActionsTest-648440304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 19:58:00 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-9e208136-26ad-46c1-a0f0-a0efcbf5b092 tempest-VolumesActionsTest-648440304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 19:58:00 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-9e208136-26ad-46c1-a0f0-a0efcbf5b092 tempest-VolumesActionsTest-648440304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:58:00 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-9e208136-26ad-46c1-a0f0-a0efcbf5b092 tempest-VolumesActionsTest-648440304 None] Selected osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92 as target Quobyte volume. {{(pid=86639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 19:58:00 devstack cinder-volume[86639]: INFO cinder.volume.drivers.remotefs [None req-9e208136-26ad-46c1-a0f0-a0efcbf5b092 tempest-VolumesActionsTest-648440304 None] casted to osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92
Jul 02 19:58:00 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-9e208136-26ad-46c1-a0f0-a0efcbf5b092 tempest-VolumesActionsTest-648440304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-b3253631-10f6-49c9-bdfe-0736345fc3f8 1073741824 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:58:00 devstack sudo[101511]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-b3253631-10f6-49c9-bdfe-0736345fc3f8 1073741824
Jul 02 19:58:00 devstack sudo[101511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:58:01 devstack sudo[101511]: pam_unix(sudo:session): session closed for user root
Jul 02 19:58:01 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-9e208136-26ad-46c1-a0f0-a0efcbf5b092 tempest-VolumesActionsTest-648440304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-b3253631-10f6-49c9-bdfe-0736345fc3f8 1073741824" returned: 0 in 1.057s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:58:01 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-9e208136-26ad-46c1-a0f0-a0efcbf5b092 tempest-VolumesActionsTest-648440304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-b3253631-10f6-49c9-bdfe-0736345fc3f8 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:58:01 devstack sudo[101517]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-b3253631-10f6-49c9-bdfe-0736345fc3f8
Jul 02 19:58:01 devstack sudo[101517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:58:02 devstack sudo[101517]: pam_unix(sudo:session): session closed for user root
Jul 02 19:58:02 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-9e208136-26ad-46c1-a0f0-a0efcbf5b092 tempest-VolumesActionsTest-648440304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-b3253631-10f6-49c9-bdfe-0736345fc3f8" returned: 0 in 0.762s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:58:02 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-9e208136-26ad-46c1-a0f0-a0efcbf5b092 tempest-VolumesActionsTest-648440304 None] <== create_volume: return (1883ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'} {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 19:58:02 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-9e208136-26ad-46c1-a0f0-a0efcbf5b092 tempest-VolumesActionsTest-648440304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.887s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:58:02 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-9e208136-26ad-46c1-a0f0-a0efcbf5b092 tempest-VolumesActionsTest-648440304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e06757a7-de2d-4f3a-ad6b-082c293cf5c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3253631-10f6-49c9-bdfe-0736345fc3f8', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:58:02 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-9e208136-26ad-46c1-a0f0-a0efcbf5b092 tempest-VolumesActionsTest-648440304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a635dac1-02f4-45d9-b127-f3f43283fb9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:58:02 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-9e208136-26ad-46c1-a0f0-a0efcbf5b092 tempest-VolumesActionsTest-648440304 None] Volume volume-b3253631-10f6-49c9-bdfe-0736345fc3f8 (b3253631-10f6-49c9-bdfe-0736345fc3f8): created successfully
Jul 02 19:58:02 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-9e208136-26ad-46c1-a0f0-a0efcbf5b092 tempest-VolumesActionsTest-648440304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a635dac1-02f4-45d9-b127-f3f43283fb9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:58:02 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-9e208136-26ad-46c1-a0f0-a0efcbf5b092 tempest-VolumesActionsTest-648440304 None] Flow 'volume_create_manager' (bbfd4afc-6c1d-4156-85c7-92fb6704f71f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 19:58:02 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-9e208136-26ad-46c1-a0f0-a0efcbf5b092 tempest-VolumesActionsTest-648440304 None] Created volume successfully.
Jul 02 19:58:07 devstack cinder-volume[86639]: INFO cinder.volume.manager [req-54a9a1c1-b98c-4078-99e6-5723801556dc req-e220312f-f7a0-429f-ad1b-abb28d5d314e tempest-TestStampPattern-490270338 None] Terminate volume connection completed successfully.
Jul 02 19:58:07 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [req-54a9a1c1-b98c-4078-99e6-5723801556dc req-e220312f-f7a0-429f-ad1b-abb28d5d314e tempest-TestStampPattern-490270338 None] Deleting attachment 97f5f9d9-53bd-4592-ade3-39ea37dca3ee. {{(pid=86639) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 02 19:58:09 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-63b186ab-8cc8-49bd-b5ec-af91ac103a77 tempest-TestStampPattern-490270338 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:58:09 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-63b186ab-8cc8-49bd-b5ec-af91ac103a77 tempest-TestStampPattern-490270338 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:58:09 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-63b186ab-8cc8-49bd-b5ec-af91ac103a77 tempest-TestStampPattern-490270338 None] Creating offline snapshot 61f3494f-e4d3-416d-b996-300f7239497a of volume 3f01b42d-1ed5-4eb3-be31-1f30a012b64e {{(pid=86639) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 02 19:58:10 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba7c18c8-88da-479b-b565-8bf6efc5c46b]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 19:58:10 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-63b186ab-8cc8-49bd-b5ec-af91ac103a77 tempest-TestStampPattern-490270338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-3f01b42d-1ed5-4eb3-be31-1f30a012b64e {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:58:10 devstack sudo[101574]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-3f01b42d-1ed5-4eb3-be31-1f30a012b64e
Jul 02 19:58:10 devstack sudo[101574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:58:11 devstack sudo[101574]: pam_unix(sudo:session): session closed for user root
Jul 02 19:58:11 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-63b186ab-8cc8-49bd-b5ec-af91ac103a77 tempest-TestStampPattern-490270338 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-3f01b42d-1ed5-4eb3-be31-1f30a012b64e" returned: 0 in 0.996s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:58:11 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-63b186ab-8cc8-49bd-b5ec-af91ac103a77 tempest-TestStampPattern-490270338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-3f01b42d-1ed5-4eb3-be31-1f30a012b64e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-3f01b42d-1ed5-4eb3-be31-1f30a012b64e.61f3494f-e4d3-416d-b996-300f7239497a 1G {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:58:11 devstack sudo[101579]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-3f01b42d-1ed5-4eb3-be31-1f30a012b64e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-3f01b42d-1ed5-4eb3-be31-1f30a012b64e.61f3494f-e4d3-416d-b996-300f7239497a 1G
Jul 02 19:58:11 devstack sudo[101579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:58:12 devstack sudo[101579]: pam_unix(sudo:session): session closed for user root
Jul 02 19:58:12 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-63b186ab-8cc8-49bd-b5ec-af91ac103a77 tempest-TestStampPattern-490270338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-3f01b42d-1ed5-4eb3-be31-1f30a012b64e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-3f01b42d-1ed5-4eb3-be31-1f30a012b64e.61f3494f-e4d3-416d-b996-300f7239497a 1G" returned: 0 in 1.052s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:58:12 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-63b186ab-8cc8-49bd-b5ec-af91ac103a77 tempest-TestStampPattern-490270338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f01b42d-1ed5-4eb3-be31-1f30a012b64e -F qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-3f01b42d-1ed5-4eb3-be31-1f30a012b64e.61f3494f-e4d3-416d-b996-300f7239497a {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:58:12 devstack sudo[101595]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f01b42d-1ed5-4eb3-be31-1f30a012b64e -F qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-3f01b42d-1ed5-4eb3-be31-1f30a012b64e.61f3494f-e4d3-416d-b996-300f7239497a
Jul 02 19:58:12 devstack sudo[101595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:58:12 devstack sudo[101595]: pam_unix(sudo:session): session closed for user root
Jul 02 19:58:12 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-63b186ab-8cc8-49bd-b5ec-af91ac103a77 tempest-TestStampPattern-490270338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f01b42d-1ed5-4eb3-be31-1f30a012b64e -F qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-3f01b42d-1ed5-4eb3-be31-1f30a012b64e.61f3494f-e4d3-416d-b996-300f7239497a" returned: 0 in 0.808s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:58:12 devstack cinder-volume[86639]: WARNING cinder.volume.drivers.remotefs [None req-63b186ab-8cc8-49bd-b5ec-af91ac103a77 tempest-TestStampPattern-490270338 None] /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-3f01b42d-1ed5-4eb3-be31-1f30a012b64e.61f3494f-e4d3-416d-b996-300f7239497a is being set with open permissions: ugo+rw
Jul 02 19:58:12 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-63b186ab-8cc8-49bd-b5ec-af91ac103a77 tempest-TestStampPattern-490270338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-3f01b42d-1ed5-4eb3-be31-1f30a012b64e.61f3494f-e4d3-416d-b996-300f7239497a {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:58:12 devstack sudo[101607]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-3f01b42d-1ed5-4eb3-be31-1f30a012b64e.61f3494f-e4d3-416d-b996-300f7239497a
Jul 02 19:58:12 devstack sudo[101607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:58:13 devstack sudo[101607]: pam_unix(sudo:session): session closed for user root
Jul 02 19:58:13 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-63b186ab-8cc8-49bd-b5ec-af91ac103a77 tempest-TestStampPattern-490270338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-3f01b42d-1ed5-4eb3-be31-1f30a012b64e.61f3494f-e4d3-416d-b996-300f7239497a" returned: 0 in 0.707s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:58:13 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-63b186ab-8cc8-49bd-b5ec-af91ac103a77 tempest-TestStampPattern-490270338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-3f01b42d-1ed5-4eb3-be31-1f30a012b64e.info {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:58:13 devstack sudo[101610]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-3f01b42d-1ed5-4eb3-be31-1f30a012b64e.info
Jul 02 19:58:13 devstack sudo[101610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:58:14 devstack sudo[101610]: pam_unix(sudo:session): session closed for user root
Jul 02 19:58:14 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-63b186ab-8cc8-49bd-b5ec-af91ac103a77 tempest-TestStampPattern-490270338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-3f01b42d-1ed5-4eb3-be31-1f30a012b64e.info" returned: 0 in 0.717s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:58:14 devstack cinder-volume[86639]: WARNING cinder.volume.drivers.remotefs [None req-63b186ab-8cc8-49bd-b5ec-af91ac103a77 tempest-TestStampPattern-490270338 None] /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-3f01b42d-1ed5-4eb3-be31-1f30a012b64e.info is being set with open permissions: ugo+rw
Jul 02 19:58:14 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-63b186ab-8cc8-49bd-b5ec-af91ac103a77 tempest-TestStampPattern-490270338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-3f01b42d-1ed5-4eb3-be31-1f30a012b64e.info {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:58:14 devstack sudo[101614]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-3f01b42d-1ed5-4eb3-be31-1f30a012b64e.info
Jul 02 19:58:14 devstack sudo[101614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:58:15 devstack sudo[101614]: pam_unix(sudo:session): session closed for user root
Jul 02 19:58:15 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-63b186ab-8cc8-49bd-b5ec-af91ac103a77 tempest-TestStampPattern-490270338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-3f01b42d-1ed5-4eb3-be31-1f30a012b64e.info" returned: 0 in 0.756s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:58:15 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-63b186ab-8cc8-49bd-b5ec-af91ac103a77 tempest-TestStampPattern-490270338 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.175s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:58:15 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-63b186ab-8cc8-49bd-b5ec-af91ac103a77 tempest-TestStampPattern-490270338 None] Create snapshot completed successfully
Jul 02 19:58:20 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-1a45e22d-632c-4e60-b08b-f49436720170 tempest-VolumesActionsTest-648440304 None] Acquiring lock "cinder-b3253631-10f6-49c9-bdfe-0736345fc3f8" by "attach_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:58:20 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-1a45e22d-632c-4e60-b08b-f49436720170 tempest-VolumesActionsTest-648440304 None] Lock "cinder-b3253631-10f6-49c9-bdfe-0736345fc3f8" acquired by "attach_volume" :: waited 0.032s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:58:20 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-1a45e22d-632c-4e60-b08b-f49436720170 tempest-VolumesActionsTest-648440304 None] Attaching volume b3253631-10f6-49c9-bdfe-0736345fc3f8 to instance 2f86b430-362c-451d-b5ef-131ac3fce95e at mountpoint /dev/vdb on host None.
Jul 02 19:58:20 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-1a45e22d-632c-4e60-b08b-f49436720170 tempest-VolumesActionsTest-648440304 None] Attach volume completed successfully.
Jul 02 19:58:20 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-1a45e22d-632c-4e60-b08b-f49436720170 tempest-VolumesActionsTest-648440304 None] Lock "cinder-b3253631-10f6-49c9-bdfe-0736345fc3f8" released by "attach_volume" :: held 0.161s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:58:21 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-b00a6e30-1271-49bd-bc68-78b40c93f46c tempest-VolumesActionsTest-648440304 None] Acquiring lock "cinder-b3253631-10f6-49c9-bdfe-0736345fc3f8-detach_volume" by "detach_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:58:21 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-b00a6e30-1271-49bd-bc68-78b40c93f46c tempest-VolumesActionsTest-648440304 None] Lock "cinder-b3253631-10f6-49c9-bdfe-0736345fc3f8-detach_volume" acquired by "detach_volume" :: waited 0.028s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:58:21 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-b00a6e30-1271-49bd-bc68-78b40c93f46c tempest-VolumesActionsTest-648440304 None] Detaching volume b3253631-10f6-49c9-bdfe-0736345fc3f8 from instance 2f86b430-362c-451d-b5ef-131ac3fce95e.
Jul 02 19:58:21 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-b00a6e30-1271-49bd-bc68-78b40c93f46c tempest-VolumesActionsTest-648440304 None] Detach volume completed successfully.
Jul 02 19:58:21 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-b00a6e30-1271-49bd-bc68-78b40c93f46c tempest-VolumesActionsTest-648440304 None] Lock "cinder-b3253631-10f6-49c9-bdfe-0736345fc3f8-detach_volume" released by "detach_volume" :: held 0.101s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:58:26 devstack cinder-volume[86639]: DEBUG cinder.volume.flows.manager.create_volume [None req-565e12cc-127d-41e9-af8e-5d70874fad83 tempest-TestStampPattern-490270338 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 19:58:26 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-565e12cc-127d-41e9-af8e-5d70874fad83 tempest-TestStampPattern-490270338 None] Flow 'volume_create_manager' (ec7e6606-6d36-41b0-9b1a-160854b78512) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 19:58:26 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-565e12cc-127d-41e9-af8e-5d70874fad83 tempest-TestStampPattern-490270338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7787fe41-a2c1-4d6c-a001-cc80126188a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:58:26 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-565e12cc-127d-41e9-af8e-5d70874fad83 tempest-TestStampPattern-490270338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7787fe41-a2c1-4d6c-a001-cc80126188a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T17:58:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-899744065',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7cc668b4-3598-40ea-b70b-5236c64a8196,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2b672eb053945e89ba677cfc99f047f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T17:58:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=61f3494f-e4d3-416d-b996-300f7239497a,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T17:58:27Z,use_quota=True,user_id='bee2c39ae9774a96a7c3a987f842ed1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:58:26 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-565e12cc-127d-41e9-af8e-5d70874fad83 tempest-TestStampPattern-490270338 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff77de2c-a06f-4555-b8dc-853381ab2fb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:58:26 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-565e12cc-127d-41e9-af8e-5d70874fad83 tempest-TestStampPattern-490270338 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff77de2c-a06f-4555-b8dc-853381ab2fb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:58:26 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-565e12cc-127d-41e9-af8e-5d70874fad83 tempest-TestStampPattern-490270338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbb06a2c-2601-4840-80ae-ac70818ff950) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:58:26 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-565e12cc-127d-41e9-af8e-5d70874fad83 tempest-TestStampPattern-490270338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbb06a2c-2601-4840-80ae-ac70818ff950) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '7cc668b4-3598-40ea-b70b-5236c64a8196', 'volume_name': 'volume-7cc668b4-3598-40ea-b70b-5236c64a8196', 'volume_size': 1, 'snapshot_id': '61f3494f-e4d3-416d-b996-300f7239497a'}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:58:26 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-565e12cc-127d-41e9-af8e-5d70874fad83 tempest-TestStampPattern-490270338 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4d5362a-6ab8-44b5-a3f3-2a3c88dc1fc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:58:26 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-565e12cc-127d-41e9-af8e-5d70874fad83 tempest-TestStampPattern-490270338 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4d5362a-6ab8-44b5-a3f3-2a3c88dc1fc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:58:26 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-565e12cc-127d-41e9-af8e-5d70874fad83 tempest-TestStampPattern-490270338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1640812f-2d16-4339-8cbd-d5d130598456) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:58:26 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-565e12cc-127d-41e9-af8e-5d70874fad83 tempest-TestStampPattern-490270338 None] Volume 7cc668b4-3598-40ea-b70b-5236c64a8196: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-7cc668b4-3598-40ea-b70b-5236c64a8196', 'volume_size': 1, 'snapshot_id': '61f3494f-e4d3-416d-b996-300f7239497a'}
Jul 02 19:58:26 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-565e12cc-127d-41e9-af8e-5d70874fad83 tempest-TestStampPattern-490270338 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:58:26 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-565e12cc-127d-41e9-af8e-5d70874fad83 tempest-TestStampPattern-490270338 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:58:26 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-565e12cc-127d-41e9-af8e-5d70874fad83 tempest-TestStampPattern-490270338 None] Acquiring lock "cinder-quobyte-61f3494f-e4d3-416d-b996-300f7239497a-7cc668b4-3598-40ea-b70b-5236c64a8196" by "_create_volume_from_snapshot" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:58:26 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-565e12cc-127d-41e9-af8e-5d70874fad83 tempest-TestStampPattern-490270338 None] Lock "cinder-quobyte-61f3494f-e4d3-416d-b996-300f7239497a-7cc668b4-3598-40ea-b70b-5236c64a8196" acquired by "_create_volume_from_snapshot" :: waited 0.022s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:58:26 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-565e12cc-127d-41e9-af8e-5d70874fad83 tempest-TestStampPattern-490270338 None] Creating volume 7cc668b4-3598-40ea-b70b-5236c64a8196 from snapshot 61f3494f-e4d3-416d-b996-300f7239497a {{(pid=86639) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jul 02 19:58:26 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-565e12cc-127d-41e9-af8e-5d70874fad83 tempest-TestStampPattern-490270338 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:58:26 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-565e12cc-127d-41e9-af8e-5d70874fad83 tempest-TestStampPattern-490270338 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:58:26 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-565e12cc-127d-41e9-af8e-5d70874fad83 tempest-TestStampPattern-490270338 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 19:58:26 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-565e12cc-127d-41e9-af8e-5d70874fad83 tempest-TestStampPattern-490270338 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 19:58:26 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-565e12cc-127d-41e9-af8e-5d70874fad83 tempest-TestStampPattern-490270338 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:58:26 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-565e12cc-127d-41e9-af8e-5d70874fad83 tempest-TestStampPattern-490270338 None] Selected osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92 as target Quobyte volume. {{(pid=86639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 19:58:26 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-565e12cc-127d-41e9-af8e-5d70874fad83 tempest-TestStampPattern-490270338 None] Acquiring lock "cinder-quobyte-7cc668b4-3598-40ea-b70b-5236c64a8196" by "_copy_volume_from_snapshot" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:58:26 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-565e12cc-127d-41e9-af8e-5d70874fad83 tempest-TestStampPattern-490270338 None] Lock "cinder-quobyte-7cc668b4-3598-40ea-b70b-5236c64a8196" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:58:26 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-565e12cc-127d-41e9-af8e-5d70874fad83 tempest-TestStampPattern-490270338 None] snapshot: 61f3494f-e4d3-416d-b996-300f7239497a, volume: 7cc668b4-3598-40ea-b70b-5236c64a8196,  {{(pid=86639) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jul 02 19:58:26 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-565e12cc-127d-41e9-af8e-5d70874fad83 tempest-TestStampPattern-490270338 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:58:26 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-565e12cc-127d-41e9-af8e-5d70874fad83 tempest-TestStampPattern-490270338 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:58:26 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-565e12cc-127d-41e9-af8e-5d70874fad83 tempest-TestStampPattern-490270338 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 19:58:26 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-565e12cc-127d-41e9-af8e-5d70874fad83 tempest-TestStampPattern-490270338 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 19:58:26 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-565e12cc-127d-41e9-af8e-5d70874fad83 tempest-TestStampPattern-490270338 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:58:26 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[de4e5949-0b35-448f-ab01-8e195a8b5d12]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 19:58:26 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-565e12cc-127d-41e9-af8e-5d70874fad83 tempest-TestStampPattern-490270338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-3f01b42d-1ed5-4eb3-be31-1f30a012b64e.61f3494f-e4d3-416d-b996-300f7239497a {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:58:27 devstack sudo[101784]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-3f01b42d-1ed5-4eb3-be31-1f30a012b64e.61f3494f-e4d3-416d-b996-300f7239497a
Jul 02 19:58:27 devstack sudo[101784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:58:28 devstack sudo[101784]: pam_unix(sudo:session): session closed for user root
Jul 02 19:58:28 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-565e12cc-127d-41e9-af8e-5d70874fad83 tempest-TestStampPattern-490270338 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-3f01b42d-1ed5-4eb3-be31-1f30a012b64e.61f3494f-e4d3-416d-b996-300f7239497a" returned: 0 in 1.166s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:58:28 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-565e12cc-127d-41e9-af8e-5d70874fad83 tempest-TestStampPattern-490270338 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3f01b42d-1ed5-4eb3-be31-1f30a012b64e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86639) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 02 19:58:28 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-565e12cc-127d-41e9-af8e-5d70874fad83 tempest-TestStampPattern-490270338 None] will copy from snapshot at /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-3f01b42d-1ed5-4eb3-be31-1f30a012b64e {{(pid=86639) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jul 02 19:58:28 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-565e12cc-127d-41e9-af8e-5d70874fad83 tempest-TestStampPattern-490270338 None] Creating direct copy from snapshot {{(pid=86639) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jul 02 19:58:28 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[6729d308-04bb-4e23-a041-3660b6d302f9]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 19:58:28 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-565e12cc-127d-41e9-af8e-5d70874fad83 tempest-TestStampPattern-490270338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-3f01b42d-1ed5-4eb3-be31-1f30a012b64e {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:58:28 devstack sudo[101835]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-3f01b42d-1ed5-4eb3-be31-1f30a012b64e
Jul 02 19:58:28 devstack sudo[101835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:58:29 devstack sudo[101835]: pam_unix(sudo:session): session closed for user root
Jul 02 19:58:29 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-565e12cc-127d-41e9-af8e-5d70874fad83 tempest-TestStampPattern-490270338 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-3f01b42d-1ed5-4eb3-be31-1f30a012b64e" returned: 0 in 1.636s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:58:29 devstack cinder-volume[86639]: DEBUG cinder.utils [None req-565e12cc-127d-41e9-af8e-5d70874fad83 tempest-TestStampPattern-490270338 None] Path /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-7cc668b4-3598-40ea-b70b-5236c64a8196 not found in is_blk_device check {{(pid=86639) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 02 19:58:29 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-565e12cc-127d-41e9-af8e-5d70874fad83 tempest-TestStampPattern-490270338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-3f01b42d-1ed5-4eb3-be31-1f30a012b64e /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-7cc668b4-3598-40ea-b70b-5236c64a8196 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:58:29 devstack sudo[101865]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-3f01b42d-1ed5-4eb3-be31-1f30a012b64e /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-7cc668b4-3598-40ea-b70b-5236c64a8196
Jul 02 19:58:29 devstack sudo[101865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:58:38 devstack cinder-volume[86639]: DEBUG dbcounter [-] [86639] Writing DB stats cinder:SELECT=23,cinder:UPDATE=10,cinder:INSERT=3,cinder:DELETE=1 {{(pid=86639) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 02 19:58:38 devstack cinder-volume[86639]: DEBUG dbcounter [-] [86639] Writing DB stats cinder:SELECT=19,cinder:UPDATE=10,cinder:INSERT=1,cinder:DELETE=1 {{(pid=86639) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 02 19:58:39 devstack sudo[101865]: pam_unix(sudo:session): session closed for user root
Jul 02 19:58:39 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-565e12cc-127d-41e9-af8e-5d70874fad83 tempest-TestStampPattern-490270338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-3f01b42d-1ed5-4eb3-be31-1f30a012b64e /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-7cc668b4-3598-40ea-b70b-5236c64a8196" returned: 0 in 9.876s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:58:39 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc348f46-93eb-49cf-94e7-cfd98d3fa48c]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 19:58:39 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-565e12cc-127d-41e9-af8e-5d70874fad83 tempest-TestStampPattern-490270338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-3f01b42d-1ed5-4eb3-be31-1f30a012b64e {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:58:40 devstack sudo[101928]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-3f01b42d-1ed5-4eb3-be31-1f30a012b64e
Jul 02 19:58:40 devstack sudo[101928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:58:41 devstack cinder-volume[86639]: DEBUG oslo_service.periodic_task [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86639) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 02 19:58:41 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:58:41 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:58:41 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 19:58:41 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 19:58:41 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:58:41 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:58:41 devstack sudo[101949]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e
Jul 02 19:58:41 devstack sudo[101949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:58:42 devstack sudo[101928]: pam_unix(sudo:session): session closed for user root
Jul 02 19:58:42 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-565e12cc-127d-41e9-af8e-5d70874fad83 tempest-TestStampPattern-490270338 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-3f01b42d-1ed5-4eb3-be31-1f30a012b64e" returned: 0 in 2.838s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:58:42 devstack cinder-volume[86639]: DEBUG cinder.image.image_utils [None req-565e12cc-127d-41e9-af8e-5d70874fad83 tempest-TestStampPattern-490270338 None] Image conversion details: src /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-3f01b42d-1ed5-4eb3-be31-1f30a012b64e, size 1024.00 MB, duration 9.88 sec, destination /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-7cc668b4-3598-40ea-b70b-5236c64a8196 {{(pid=86639) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 02 19:58:42 devstack cinder-volume[86639]: INFO cinder.image.image_utils [None req-565e12cc-127d-41e9-af8e-5d70874fad83 tempest-TestStampPattern-490270338 None] Converted 1024.00 MB image at 103.68 MB/s
Jul 02 19:58:42 devstack cinder-volume[86639]: WARNING cinder.volume.drivers.remotefs [None req-565e12cc-127d-41e9-af8e-5d70874fad83 tempest-TestStampPattern-490270338 None] /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-7cc668b4-3598-40ea-b70b-5236c64a8196 is being set with open permissions: ugo+rw
Jul 02 19:58:42 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-565e12cc-127d-41e9-af8e-5d70874fad83 tempest-TestStampPattern-490270338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-7cc668b4-3598-40ea-b70b-5236c64a8196 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:58:42 devstack sudo[101973]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-7cc668b4-3598-40ea-b70b-5236c64a8196
Jul 02 19:58:42 devstack sudo[101973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:58:43 devstack sudo[101949]: pam_unix(sudo:session): session closed for user root
Jul 02 19:58:43 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e" returned: 0 in 1.545s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:58:43 devstack cinder-volume[86639]: DEBUG cinder.manager [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] Notifying Schedulers of capabilities ... {{(pid=86639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 19:58:43 devstack cinder-volume[86639]: DEBUG oslo_service.periodic_task [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] Running periodic task VolumeManager._thread_info {{(pid=86639) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 02 19:58:43 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] thread count: 28 {{(pid=86639) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 02 19:58:43 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] thread info: [<_MainThread(MainThread, started 140525261275264)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 140525150678016)>, <Thread(Thread-3 (stat_writer), started daemon 140525150025920)>, <Thread(Rabbit-heartbeat, started daemon 140525150500864)>, <Thread(Thread-5 (_runner), started daemon 140525149847296)>, <Thread(Thread-7 (_runner), started daemon 140525149863424)>, <Thread(fd_logger, started daemon 140525146589376)>, <Thread(privsep_reader, started daemon 140525144562432)>, <Thread(tpool_thread_0, started daemon 140525137151680)>, <Thread(tpool_thread_1, started daemon 140525128758976)>, <Thread(tpool_thread_2, started daemon 140525120349888)>, <Thread(tpool_thread_3, started daemon 140525111940800)>, <Thread(tpool_thread_4, started daemon 140525103531712)>, <Thread(tpool_thread_5, started daemon 140525095122624)>, <Thread(tpool_thread_6, started daemon 140525086713536)>, <Thread(tpool_thread_7, started daemon 140525078304448)>, <Thread(tpool_thread_8, started daemon 140525069895360)>, <Thread(tpool_thread_9, started daemon 140525061486272)>, <Thread(tpool_thread_10, started daemon 140525053077184)>, <Thread(tpool_thread_11, started daemon 140525044668096)>, <Thread(tpool_thread_12, started daemon 140525036259008)>, <Thread(tpool_thread_13, started daemon 140525027849920)>, <Thread(tpool_thread_14, started daemon 140525019440832)>, <Thread(tpool_thread_15, started daemon 140525011031744)>, <Thread(tpool_thread_16, started daemon 140525002622656)>, <Thread(tpool_thread_17, started daemon 140524994213568)>, <Thread(tpool_thread_18, started daemon 140524985804480)>, <Thread(tpool_thread_19, started daemon 140524977395392)>] {{(pid=86639) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 02 19:58:44 devstack sudo[101973]: pam_unix(sudo:session): session closed for user root
Jul 02 19:58:44 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-565e12cc-127d-41e9-af8e-5d70874fad83 tempest-TestStampPattern-490270338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-7cc668b4-3598-40ea-b70b-5236c64a8196" returned: 0 in 1.424s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:58:44 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-565e12cc-127d-41e9-af8e-5d70874fad83 tempest-TestStampPattern-490270338 None] Lock "cinder-quobyte-7cc668b4-3598-40ea-b70b-5236c64a8196" released by "_copy_volume_from_snapshot" :: held 17.155s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:58:44 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-565e12cc-127d-41e9-af8e-5d70874fad83 tempest-TestStampPattern-490270338 None] Lock "cinder-quobyte-61f3494f-e4d3-416d-b996-300f7239497a-7cc668b4-3598-40ea-b70b-5236c64a8196" released by "_create_volume_from_snapshot" :: held 17.196s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:58:44 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-565e12cc-127d-41e9-af8e-5d70874fad83 tempest-TestStampPattern-490270338 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 17.219s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:58:44 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-565e12cc-127d-41e9-af8e-5d70874fad83 tempest-TestStampPattern-490270338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1640812f-2d16-4339-8cbd-d5d130598456) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7cc668b4-3598-40ea-b70b-5236c64a8196', 'volume_size': 1, 'snapshot_id': '61f3494f-e4d3-416d-b996-300f7239497a'}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:58:44 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-565e12cc-127d-41e9-af8e-5d70874fad83 tempest-TestStampPattern-490270338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14542d2c-c7e8-4c84-98d7-4ea4daf4c41d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:58:44 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-565e12cc-127d-41e9-af8e-5d70874fad83 tempest-TestStampPattern-490270338 None] Volume volume-7cc668b4-3598-40ea-b70b-5236c64a8196 (7cc668b4-3598-40ea-b70b-5236c64a8196): created successfully
Jul 02 19:58:44 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-565e12cc-127d-41e9-af8e-5d70874fad83 tempest-TestStampPattern-490270338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14542d2c-c7e8-4c84-98d7-4ea4daf4c41d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:58:44 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-565e12cc-127d-41e9-af8e-5d70874fad83 tempest-TestStampPattern-490270338 None] Flow 'volume_create_manager' (ec7e6606-6d36-41b0-9b1a-160854b78512) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 19:58:44 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-565e12cc-127d-41e9-af8e-5d70874fad83 tempest-TestStampPattern-490270338 None] Created volume successfully.
Jul 02 19:58:53 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-9e1471e8-60f7-446c-a351-2e30b9b03b26 tempest-VolumesActionsTest-648440304 None] Acquiring lock "cinder-b3253631-10f6-49c9-bdfe-0736345fc3f8" by "attach_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:58:54 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-9e1471e8-60f7-446c-a351-2e30b9b03b26 tempest-VolumesActionsTest-648440304 None] Lock "cinder-b3253631-10f6-49c9-bdfe-0736345fc3f8" acquired by "attach_volume" :: waited 0.038s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:58:54 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-9e1471e8-60f7-446c-a351-2e30b9b03b26 tempest-VolumesActionsTest-648440304 None] Attaching volume b3253631-10f6-49c9-bdfe-0736345fc3f8 to instance d5d8ffdc-1f14-4596-b32e-46cb3bc17e31 at mountpoint /dev/vdb on host None.
Jul 02 19:58:54 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-9e1471e8-60f7-446c-a351-2e30b9b03b26 tempest-VolumesActionsTest-648440304 None] Attach volume completed successfully.
Jul 02 19:58:54 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-9e1471e8-60f7-446c-a351-2e30b9b03b26 tempest-VolumesActionsTest-648440304 None] Lock "cinder-b3253631-10f6-49c9-bdfe-0736345fc3f8" released by "attach_volume" :: held 0.254s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:58:54 devstack cinder-volume[86639]: DEBUG cinder.volume.flows.manager.create_volume [None req-0dd506cf-d4ea-40ae-8f7f-1eaf7596d21d tempest-TestServerVolumeAttachScenarioOldVersion-1686061473 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 19:58:54 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-0dd506cf-d4ea-40ae-8f7f-1eaf7596d21d tempest-TestServerVolumeAttachScenarioOldVersion-1686061473 None] Flow 'volume_create_manager' (de0d84fa-c312-458d-87fc-5ea79ff435bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 19:58:54 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-0dd506cf-d4ea-40ae-8f7f-1eaf7596d21d tempest-TestServerVolumeAttachScenarioOldVersion-1686061473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aba54b12-23f9-491d-b9ec-3b276dc07308) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:58:54 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-0dd506cf-d4ea-40ae-8f7f-1eaf7596d21d tempest-TestServerVolumeAttachScenarioOldVersion-1686061473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aba54b12-23f9-491d-b9ec-3b276dc07308) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T17:58:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1587228213',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=687a90f5-f736-46e1-a939-e38e7b60d9b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a98e5a551134400f8a50cf81ab328aa3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T17:58:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T17:58:54Z,use_quota=True,user_id='0df85f6a0c7940fc858744a811b90ba9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:58:54 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-0dd506cf-d4ea-40ae-8f7f-1eaf7596d21d tempest-TestServerVolumeAttachScenarioOldVersion-1686061473 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b7300ea-cf47-4267-a2a7-6e9522974ca3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:58:54 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-0dd506cf-d4ea-40ae-8f7f-1eaf7596d21d tempest-TestServerVolumeAttachScenarioOldVersion-1686061473 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b7300ea-cf47-4267-a2a7-6e9522974ca3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:58:54 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-0dd506cf-d4ea-40ae-8f7f-1eaf7596d21d tempest-TestServerVolumeAttachScenarioOldVersion-1686061473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0658fb0-6ae9-4e00-acc0-a031748c2223) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:58:54 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-0dd506cf-d4ea-40ae-8f7f-1eaf7596d21d tempest-TestServerVolumeAttachScenarioOldVersion-1686061473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0658fb0-6ae9-4e00-acc0-a031748c2223) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '687a90f5-f736-46e1-a939-e38e7b60d9b8', 'volume_name': 'volume-687a90f5-f736-46e1-a939-e38e7b60d9b8', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:58:54 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-0dd506cf-d4ea-40ae-8f7f-1eaf7596d21d tempest-TestServerVolumeAttachScenarioOldVersion-1686061473 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8a6005a-d9f1-4219-b439-e98d5e4fa4b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:58:54 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-0dd506cf-d4ea-40ae-8f7f-1eaf7596d21d tempest-TestServerVolumeAttachScenarioOldVersion-1686061473 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8a6005a-d9f1-4219-b439-e98d5e4fa4b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:58:54 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-0dd506cf-d4ea-40ae-8f7f-1eaf7596d21d tempest-TestServerVolumeAttachScenarioOldVersion-1686061473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86fa50b7-fa24-4f58-bc39-79711f6884d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:58:54 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-0dd506cf-d4ea-40ae-8f7f-1eaf7596d21d tempest-TestServerVolumeAttachScenarioOldVersion-1686061473 None] Volume 687a90f5-f736-46e1-a939-e38e7b60d9b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-687a90f5-f736-46e1-a939-e38e7b60d9b8', 'volume_size': 1}
Jul 02 19:58:54 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-0dd506cf-d4ea-40ae-8f7f-1eaf7596d21d tempest-TestServerVolumeAttachScenarioOldVersion-1686061473 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:58:54 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-0dd506cf-d4ea-40ae-8f7f-1eaf7596d21d tempest-TestServerVolumeAttachScenarioOldVersion-1686061473 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:58:54 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-0dd506cf-d4ea-40ae-8f7f-1eaf7596d21d tempest-TestServerVolumeAttachScenarioOldVersion-1686061473 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce906cb830>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T17:58:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1587228213',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=687a90f5-f736-46e1-a939-e38e7b60d9b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a98e5a551134400f8a50cf81ab328aa3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T17:58:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T17:58:54Z,use_quota=True,user_id='0df85f6a0c7940fc858744a811b90ba9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)}" {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 19:58:54 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-0dd506cf-d4ea-40ae-8f7f-1eaf7596d21d tempest-TestServerVolumeAttachScenarioOldVersion-1686061473 None] Creating volume 687a90f5-f736-46e1-a939-e38e7b60d9b8 {{(pid=86639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 19:58:54 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-0dd506cf-d4ea-40ae-8f7f-1eaf7596d21d tempest-TestServerVolumeAttachScenarioOldVersion-1686061473 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:58:54 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-0dd506cf-d4ea-40ae-8f7f-1eaf7596d21d tempest-TestServerVolumeAttachScenarioOldVersion-1686061473 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:58:54 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-0dd506cf-d4ea-40ae-8f7f-1eaf7596d21d tempest-TestServerVolumeAttachScenarioOldVersion-1686061473 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 19:58:54 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-0dd506cf-d4ea-40ae-8f7f-1eaf7596d21d tempest-TestServerVolumeAttachScenarioOldVersion-1686061473 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 19:58:54 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-0dd506cf-d4ea-40ae-8f7f-1eaf7596d21d tempest-TestServerVolumeAttachScenarioOldVersion-1686061473 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:58:54 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-0dd506cf-d4ea-40ae-8f7f-1eaf7596d21d tempest-TestServerVolumeAttachScenarioOldVersion-1686061473 None] Selected osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92 as target Quobyte volume. {{(pid=86639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 19:58:54 devstack cinder-volume[86639]: INFO cinder.volume.drivers.remotefs [None req-0dd506cf-d4ea-40ae-8f7f-1eaf7596d21d tempest-TestServerVolumeAttachScenarioOldVersion-1686061473 None] casted to osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92
Jul 02 19:58:54 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-0dd506cf-d4ea-40ae-8f7f-1eaf7596d21d tempest-TestServerVolumeAttachScenarioOldVersion-1686061473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-687a90f5-f736-46e1-a939-e38e7b60d9b8 1073741824 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:58:54 devstack sudo[102150]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-687a90f5-f736-46e1-a939-e38e7b60d9b8 1073741824
Jul 02 19:58:54 devstack sudo[102150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:58:54 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-094bfc3a-67bb-47d7-9f5e-6d17f58d5689 tempest-VolumesActionsTest-648440304 None] Acquiring lock "cinder-b3253631-10f6-49c9-bdfe-0736345fc3f8-detach_volume" by "detach_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:58:54 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-094bfc3a-67bb-47d7-9f5e-6d17f58d5689 tempest-VolumesActionsTest-648440304 None] Lock "cinder-b3253631-10f6-49c9-bdfe-0736345fc3f8-detach_volume" acquired by "detach_volume" :: waited 0.043s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:58:54 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-094bfc3a-67bb-47d7-9f5e-6d17f58d5689 tempest-VolumesActionsTest-648440304 None] Detaching volume b3253631-10f6-49c9-bdfe-0736345fc3f8 from instance d5d8ffdc-1f14-4596-b32e-46cb3bc17e31.
Jul 02 19:58:55 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-094bfc3a-67bb-47d7-9f5e-6d17f58d5689 tempest-VolumesActionsTest-648440304 None] Detach volume completed successfully.
Jul 02 19:58:55 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-094bfc3a-67bb-47d7-9f5e-6d17f58d5689 tempest-VolumesActionsTest-648440304 None] Lock "cinder-b3253631-10f6-49c9-bdfe-0736345fc3f8-detach_volume" released by "detach_volume" :: held 0.170s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:58:56 devstack sudo[102150]: pam_unix(sudo:session): session closed for user root
Jul 02 19:58:56 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-0dd506cf-d4ea-40ae-8f7f-1eaf7596d21d tempest-TestServerVolumeAttachScenarioOldVersion-1686061473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-687a90f5-f736-46e1-a939-e38e7b60d9b8 1073741824" returned: 0 in 2.038s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:58:56 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-0dd506cf-d4ea-40ae-8f7f-1eaf7596d21d tempest-TestServerVolumeAttachScenarioOldVersion-1686061473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-687a90f5-f736-46e1-a939-e38e7b60d9b8 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:58:56 devstack sudo[102157]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-687a90f5-f736-46e1-a939-e38e7b60d9b8
Jul 02 19:58:56 devstack sudo[102157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:58:58 devstack sudo[102157]: pam_unix(sudo:session): session closed for user root
Jul 02 19:58:58 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-0dd506cf-d4ea-40ae-8f7f-1eaf7596d21d tempest-TestServerVolumeAttachScenarioOldVersion-1686061473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-687a90f5-f736-46e1-a939-e38e7b60d9b8" returned: 0 in 1.881s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:58:58 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-0dd506cf-d4ea-40ae-8f7f-1eaf7596d21d tempest-TestServerVolumeAttachScenarioOldVersion-1686061473 None] <== create_volume: return (4001ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'} {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 19:58:58 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-0dd506cf-d4ea-40ae-8f7f-1eaf7596d21d tempest-TestServerVolumeAttachScenarioOldVersion-1686061473 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 4.009s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:58:58 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-0dd506cf-d4ea-40ae-8f7f-1eaf7596d21d tempest-TestServerVolumeAttachScenarioOldVersion-1686061473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86fa50b7-fa24-4f58-bc39-79711f6884d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-687a90f5-f736-46e1-a939-e38e7b60d9b8', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:58:58 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-0dd506cf-d4ea-40ae-8f7f-1eaf7596d21d tempest-TestServerVolumeAttachScenarioOldVersion-1686061473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (610debc3-7ee0-4678-abac-25eea9329871) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 19:58:58 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-0dd506cf-d4ea-40ae-8f7f-1eaf7596d21d tempest-TestServerVolumeAttachScenarioOldVersion-1686061473 None] Volume volume-687a90f5-f736-46e1-a939-e38e7b60d9b8 (687a90f5-f736-46e1-a939-e38e7b60d9b8): created successfully
Jul 02 19:58:58 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-0dd506cf-d4ea-40ae-8f7f-1eaf7596d21d tempest-TestServerVolumeAttachScenarioOldVersion-1686061473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (610debc3-7ee0-4678-abac-25eea9329871) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 19:58:58 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-0dd506cf-d4ea-40ae-8f7f-1eaf7596d21d tempest-TestServerVolumeAttachScenarioOldVersion-1686061473 None] Flow 'volume_create_manager' (de0d84fa-c312-458d-87fc-5ea79ff435bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 19:58:58 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-0dd506cf-d4ea-40ae-8f7f-1eaf7596d21d tempest-TestServerVolumeAttachScenarioOldVersion-1686061473 None] Created volume successfully.
Jul 02 19:59:02 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [req-7684a273-cff6-4e07-897b-386373b7677b req-465b1a91-e382-4e10-a6d0-738b2b4dcea7 tempest-TestServerVolumeAttachScenarioOldVersion-1686061473 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:59:02 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [req-7684a273-cff6-4e07-897b-386373b7677b req-465b1a91-e382-4e10-a6d0-738b2b4dcea7 tempest-TestServerVolumeAttachScenarioOldVersion-1686061473 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:59:02 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f42551c-2307-46a1-b936-904405cee14a]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 19:59:02 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [req-7684a273-cff6-4e07-897b-386373b7677b req-465b1a91-e382-4e10-a6d0-738b2b4dcea7 tempest-TestServerVolumeAttachScenarioOldVersion-1686061473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-687a90f5-f736-46e1-a939-e38e7b60d9b8 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:59:02 devstack sudo[102258]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-687a90f5-f736-46e1-a939-e38e7b60d9b8
Jul 02 19:59:02 devstack sudo[102258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:59:03 devstack sudo[102258]: pam_unix(sudo:session): session closed for user root
Jul 02 19:59:03 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [req-7684a273-cff6-4e07-897b-386373b7677b req-465b1a91-e382-4e10-a6d0-738b2b4dcea7 tempest-TestServerVolumeAttachScenarioOldVersion-1686061473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-687a90f5-f736-46e1-a939-e38e7b60d9b8" returned: 0 in 0.906s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:59:03 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [req-7684a273-cff6-4e07-897b-386373b7677b req-465b1a91-e382-4e10-a6d0-738b2b4dcea7 tempest-TestServerVolumeAttachScenarioOldVersion-1686061473 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.928s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:59:03 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [req-7684a273-cff6-4e07-897b-386373b7677b req-465b1a91-e382-4e10-a6d0-738b2b4dcea7 tempest-TestServerVolumeAttachScenarioOldVersion-1686061473 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92', 'name': 'volume-687a90f5-f736-46e1-a939-e38e7b60d9b8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8b3517dd-266c-4aa5-8a42-45f5525e3ca1', 'enforce_multipath': True} {{(pid=86639) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 02 19:59:03 devstack cinder-volume[86639]: INFO cinder.volume.manager [req-7684a273-cff6-4e07-897b-386373b7677b req-465b1a91-e382-4e10-a6d0-738b2b4dcea7 tempest-TestServerVolumeAttachScenarioOldVersion-1686061473 None] attachment_update completed successfully.
Jul 02 19:59:05 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-ad686665-2eae-4f84-ba15-7d2a9e8dd811 tempest-VolumesActionsTest-648440304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:59:05 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-ad686665-2eae-4f84-ba15-7d2a9e8dd811 tempest-VolumesActionsTest-648440304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.003s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:59:05 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fad1fd0-a188-4a1d-a0d3-70cf3c28f84c]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 19:59:05 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-ad686665-2eae-4f84-ba15-7d2a9e8dd811 tempest-VolumesActionsTest-648440304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-b3253631-10f6-49c9-bdfe-0736345fc3f8 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:59:05 devstack sudo[102657]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-b3253631-10f6-49c9-bdfe-0736345fc3f8
Jul 02 19:59:05 devstack sudo[102657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:59:06 devstack sudo[102657]: pam_unix(sudo:session): session closed for user root
Jul 02 19:59:06 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-ad686665-2eae-4f84-ba15-7d2a9e8dd811 tempest-VolumesActionsTest-648440304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-b3253631-10f6-49c9-bdfe-0736345fc3f8" returned: 0 in 0.902s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:59:06 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f629cdf-b623-49c8-a8b8-602a645c4677]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 19:59:06 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-ad686665-2eae-4f84-ba15-7d2a9e8dd811 tempest-VolumesActionsTest-648440304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-b3253631-10f6-49c9-bdfe-0736345fc3f8 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:59:06 devstack sudo[102662]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-b3253631-10f6-49c9-bdfe-0736345fc3f8
Jul 02 19:59:06 devstack sudo[102662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:59:07 devstack sudo[102662]: pam_unix(sudo:session): session closed for user root
Jul 02 19:59:07 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-ad686665-2eae-4f84-ba15-7d2a9e8dd811 tempest-VolumesActionsTest-648440304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-b3253631-10f6-49c9-bdfe-0736345fc3f8" returned: 0 in 0.872s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:59:07 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-ad686665-2eae-4f84-ba15-7d2a9e8dd811 tempest-VolumesActionsTest-648440304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-b3253631-10f6-49c9-bdfe-0736345fc3f8 /opt/stack/data/cinder/conversion/b3253631-10f6-49c9-bdfe-0736345fc3f8.temp_image.090fab94-4d69-47f6-a612-7c41622cc9dc99l5651m.img {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:59:07 devstack sudo[102667]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-b3253631-10f6-49c9-bdfe-0736345fc3f8 /opt/stack/data/cinder/conversion/b3253631-10f6-49c9-bdfe-0736345fc3f8.temp_image.090fab94-4d69-47f6-a612-7c41622cc9dc99l5651m.img
Jul 02 19:59:07 devstack sudo[102667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:59:12 devstack sudo[102667]: pam_unix(sudo:session): session closed for user root
Jul 02 19:59:12 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-ad686665-2eae-4f84-ba15-7d2a9e8dd811 tempest-VolumesActionsTest-648440304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-b3253631-10f6-49c9-bdfe-0736345fc3f8 /opt/stack/data/cinder/conversion/b3253631-10f6-49c9-bdfe-0736345fc3f8.temp_image.090fab94-4d69-47f6-a612-7c41622cc9dc99l5651m.img" returned: 0 in 5.740s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:59:12 devstack cinder-volume[86639]: INFO cinder.volume.manager [req-506a75fb-29ce-4f55-b3c4-a7f6e0cd5407 req-9c27c144-ebed-429f-9fcd-43203d2631b9 tempest-TestServerVolumeAttachScenarioOldVersion-1686061473 None] Terminate volume connection completed successfully.
Jul 02 19:59:12 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [req-506a75fb-29ce-4f55-b3c4-a7f6e0cd5407 req-9c27c144-ebed-429f-9fcd-43203d2631b9 tempest-TestServerVolumeAttachScenarioOldVersion-1686061473 None] Deleting attachment 8b3517dd-266c-4aa5-8a42-45f5525e3ca1. {{(pid=86639) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 02 19:59:12 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c8c1384-d866-4018-9bd0-f240bd026d22]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 19:59:12 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-ad686665-2eae-4f84-ba15-7d2a9e8dd811 tempest-VolumesActionsTest-648440304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-b3253631-10f6-49c9-bdfe-0736345fc3f8 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:59:12 devstack sudo[102707]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-b3253631-10f6-49c9-bdfe-0736345fc3f8
Jul 02 19:59:12 devstack sudo[102707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:59:13 devstack sudo[102707]: pam_unix(sudo:session): session closed for user root
Jul 02 19:59:13 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-ad686665-2eae-4f84-ba15-7d2a9e8dd811 tempest-VolumesActionsTest-648440304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-b3253631-10f6-49c9-bdfe-0736345fc3f8" returned: 0 in 0.990s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:59:13 devstack cinder-volume[86639]: DEBUG cinder.image.image_utils [None req-ad686665-2eae-4f84-ba15-7d2a9e8dd811 tempest-VolumesActionsTest-648440304 None] Image conversion details: src /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-b3253631-10f6-49c9-bdfe-0736345fc3f8, size 1024.00 MB, duration 5.74 sec, destination /opt/stack/data/cinder/conversion/b3253631-10f6-49c9-bdfe-0736345fc3f8.temp_image.090fab94-4d69-47f6-a612-7c41622cc9dc99l5651m.img {{(pid=86639) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 02 19:59:13 devstack cinder-volume[86639]: INFO cinder.image.image_utils [None req-ad686665-2eae-4f84-ba15-7d2a9e8dd811 tempest-VolumesActionsTest-648440304 None] Converted 1024.00 MB image at 178.38 MB/s
Jul 02 19:59:13 devstack cinder-volume[86639]: DEBUG cinder.image.image_utils [None req-ad686665-2eae-4f84-ba15-7d2a9e8dd811 tempest-VolumesActionsTest-648440304 None] 090fab94-4d69-47f6-a612-7c41622cc9dc was raw, no need to convert to raw {{(pid=86639) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}}
Jul 02 19:59:14 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-17f59f61-53cd-4e0a-8441-4260161e07e0 tempest-TestServerVolumeAttachScenarioOldVersion-1686061473 None] Acquiring lock "cinder-687a90f5-f736-46e1-a939-e38e7b60d9b8-delete_volume" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:59:14 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-17f59f61-53cd-4e0a-8441-4260161e07e0 tempest-TestServerVolumeAttachScenarioOldVersion-1686061473 None] Lock "cinder-687a90f5-f736-46e1-a939-e38e7b60d9b8-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:59:15 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-17f59f61-53cd-4e0a-8441-4260161e07e0 tempest-TestServerVolumeAttachScenarioOldVersion-1686061473 None] Acquiring lock "cinder-quobyte-687a90f5-f736-46e1-a939-e38e7b60d9b8" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:59:15 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-17f59f61-53cd-4e0a-8441-4260161e07e0 tempest-TestServerVolumeAttachScenarioOldVersion-1686061473 None] Lock "cinder-quobyte-687a90f5-f736-46e1-a939-e38e7b60d9b8" acquired by "delete_volume" :: waited 0.022s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:59:15 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e689fc2-189e-4879-8e94-156f1727adf2]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 19:59:15 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-17f59f61-53cd-4e0a-8441-4260161e07e0 tempest-TestServerVolumeAttachScenarioOldVersion-1686061473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-687a90f5-f736-46e1-a939-e38e7b60d9b8 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:59:15 devstack sudo[102713]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-687a90f5-f736-46e1-a939-e38e7b60d9b8
Jul 02 19:59:15 devstack sudo[102713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:59:15 devstack sudo[102713]: pam_unix(sudo:session): session closed for user root
Jul 02 19:59:15 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-17f59f61-53cd-4e0a-8441-4260161e07e0 tempest-TestServerVolumeAttachScenarioOldVersion-1686061473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-687a90f5-f736-46e1-a939-e38e7b60d9b8" returned: 0 in 0.848s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:59:15 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-17f59f61-53cd-4e0a-8441-4260161e07e0 tempest-TestServerVolumeAttachScenarioOldVersion-1686061473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-687a90f5-f736-46e1-a939-e38e7b60d9b8 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:59:15 devstack sudo[102718]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-687a90f5-f736-46e1-a939-e38e7b60d9b8
Jul 02 19:59:15 devstack sudo[102718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:59:16 devstack sudo[102718]: pam_unix(sudo:session): session closed for user root
Jul 02 19:59:16 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-17f59f61-53cd-4e0a-8441-4260161e07e0 tempest-TestServerVolumeAttachScenarioOldVersion-1686061473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-687a90f5-f736-46e1-a939-e38e7b60d9b8" returned: 0 in 0.821s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:59:16 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-17f59f61-53cd-4e0a-8441-4260161e07e0 tempest-TestServerVolumeAttachScenarioOldVersion-1686061473 None] Lock "cinder-quobyte-687a90f5-f736-46e1-a939-e38e7b60d9b8" released by "delete_volume" :: held 1.727s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:59:16 devstack cinder-volume[86639]: DEBUG cinder.quota [None req-17f59f61-53cd-4e0a-8441-4260161e07e0 tempest-TestServerVolumeAttachScenarioOldVersion-1686061473 None] Created reservations ['482b9964-f580-43f8-aa3c-f906aa3245dc', '4920e1bc-2be1-4daa-93d7-ac9c884fb1f8', '28478822-b20c-4950-9ab8-2980eba0b3d3', 'f53292bd-db9e-4dd2-86a8-8217e941a824'] {{(pid=86639) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 19:59:17 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-17f59f61-53cd-4e0a-8441-4260161e07e0 tempest-TestServerVolumeAttachScenarioOldVersion-1686061473 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:59:17 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-17f59f61-53cd-4e0a-8441-4260161e07e0 tempest-TestServerVolumeAttachScenarioOldVersion-1686061473 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:59:17 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-17f59f61-53cd-4e0a-8441-4260161e07e0 tempest-TestServerVolumeAttachScenarioOldVersion-1686061473 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 19:59:17 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-17f59f61-53cd-4e0a-8441-4260161e07e0 tempest-TestServerVolumeAttachScenarioOldVersion-1686061473 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 19:59:17 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-17f59f61-53cd-4e0a-8441-4260161e07e0 tempest-TestServerVolumeAttachScenarioOldVersion-1686061473 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:59:17 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-17f59f61-53cd-4e0a-8441-4260161e07e0 tempest-TestServerVolumeAttachScenarioOldVersion-1686061473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:59:17 devstack sudo[102721]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e
Jul 02 19:59:17 devstack sudo[102721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:59:17 devstack sudo[102721]: pam_unix(sudo:session): session closed for user root
Jul 02 19:59:17 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-17f59f61-53cd-4e0a-8441-4260161e07e0 tempest-TestServerVolumeAttachScenarioOldVersion-1686061473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e" returned: 0 in 0.969s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:59:17 devstack cinder-volume[86639]: DEBUG cinder.manager [None req-17f59f61-53cd-4e0a-8441-4260161e07e0 tempest-TestServerVolumeAttachScenarioOldVersion-1686061473 None] Notifying Schedulers of capabilities ... {{(pid=86639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 19:59:18 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-17f59f61-53cd-4e0a-8441-4260161e07e0 tempest-TestServerVolumeAttachScenarioOldVersion-1686061473 None] Deleted volume successfully.
Jul 02 19:59:18 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-17f59f61-53cd-4e0a-8441-4260161e07e0 tempest-TestServerVolumeAttachScenarioOldVersion-1686061473 None] Lock "cinder-687a90f5-f736-46e1-a939-e38e7b60d9b8-delete_volume" released by "delete_volume" :: held 3.056s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:59:22 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [req-67aa358a-b1ee-4db4-b8e6-21d6723f1a46 req-6b4b746d-eb95-4fb2-9c45-38d5fe58bf94 tempest-TestStampPattern-490270338 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:59:32 devstack cinder-volume[86639]: DEBUG dbcounter [-] [86639] Writing DB stats cinder:UPDATE=23,cinder:SELECT=23,cinder:INSERT=5 {{(pid=86639) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 02 19:59:32 devstack cinder-volume[86639]: DEBUG dbcounter [-] [86639] Writing DB stats cinder:SELECT=23,cinder:UPDATE=11,cinder:DELETE=3,cinder:INSERT=2 {{(pid=86639) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 02 19:59:36 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-ad686665-2eae-4f84-ba15-7d2a9e8dd811 tempest-VolumesActionsTest-648440304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 31.490s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:59:36 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-ad686665-2eae-4f84-ba15-7d2a9e8dd811 tempest-VolumesActionsTest-648440304 None] Uploaded volume to glance image-id: 090fab94-4d69-47f6-a612-7c41622cc9dc. {{(pid=86639) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Jul 02 19:59:36 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [req-67aa358a-b1ee-4db4-b8e6-21d6723f1a46 req-6b4b746d-eb95-4fb2-9c45-38d5fe58bf94 tempest-TestStampPattern-490270338 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 14.523s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:59:36 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[dca4b547-95ba-4069-b849-ab88353e3fee]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 19:59:36 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [req-67aa358a-b1ee-4db4-b8e6-21d6723f1a46 req-6b4b746d-eb95-4fb2-9c45-38d5fe58bf94 tempest-TestStampPattern-490270338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-7cc668b4-3598-40ea-b70b-5236c64a8196 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:59:36 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-ad686665-2eae-4f84-ba15-7d2a9e8dd811 tempest-VolumesActionsTest-648440304 None] Copy volume to image completed successfully.
Jul 02 19:59:36 devstack sudo[102827]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-7cc668b4-3598-40ea-b70b-5236c64a8196
Jul 02 19:59:36 devstack sudo[102827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:59:38 devstack sudo[102827]: pam_unix(sudo:session): session closed for user root
Jul 02 19:59:38 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [req-67aa358a-b1ee-4db4-b8e6-21d6723f1a46 req-6b4b746d-eb95-4fb2-9c45-38d5fe58bf94 tempest-TestStampPattern-490270338 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-7cc668b4-3598-40ea-b70b-5236c64a8196" returned: 0 in 1.327s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:59:38 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [req-67aa358a-b1ee-4db4-b8e6-21d6723f1a46 req-6b4b746d-eb95-4fb2-9c45-38d5fe58bf94 tempest-TestStampPattern-490270338 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.360s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:59:38 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-b13beeee-988f-4d71-b85e-05be347d9ed8 tempest-VolumesActionsTest-648440304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:59:38 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-b13beeee-988f-4d71-b85e-05be347d9ed8 tempest-VolumesActionsTest-648440304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:59:38 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[d69b47be-f1e4-4fc3-b369-056415c41de3]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 19:59:38 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-b13beeee-988f-4d71-b85e-05be347d9ed8 tempest-VolumesActionsTest-648440304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-b3253631-10f6-49c9-bdfe-0736345fc3f8 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:59:38 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [req-67aa358a-b1ee-4db4-b8e6-21d6723f1a46 req-6b4b746d-eb95-4fb2-9c45-38d5fe58bf94 tempest-TestStampPattern-490270338 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92', 'name': 'volume-7cc668b4-3598-40ea-b70b-5236c64a8196', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'fefac67d-1de4-4e67-98ba-82affb4fee4a', 'enforce_multipath': True} {{(pid=86639) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 02 19:59:38 devstack cinder-volume[86639]: INFO cinder.volume.manager [req-67aa358a-b1ee-4db4-b8e6-21d6723f1a46 req-6b4b746d-eb95-4fb2-9c45-38d5fe58bf94 tempest-TestStampPattern-490270338 None] attachment_update completed successfully.
Jul 02 19:59:38 devstack sudo[102834]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-b3253631-10f6-49c9-bdfe-0736345fc3f8
Jul 02 19:59:38 devstack sudo[102834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:59:39 devstack sudo[102834]: pam_unix(sudo:session): session closed for user root
Jul 02 19:59:39 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-b13beeee-988f-4d71-b85e-05be347d9ed8 tempest-VolumesActionsTest-648440304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-b3253631-10f6-49c9-bdfe-0736345fc3f8" returned: 0 in 1.121s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:59:39 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[380c1ce9-7701-4f75-b883-f7d8279baba5]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 19:59:39 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-b13beeee-988f-4d71-b85e-05be347d9ed8 tempest-VolumesActionsTest-648440304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-b3253631-10f6-49c9-bdfe-0736345fc3f8 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:59:39 devstack sudo[102919]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-b3253631-10f6-49c9-bdfe-0736345fc3f8
Jul 02 19:59:39 devstack sudo[102919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:59:40 devstack sudo[102919]: pam_unix(sudo:session): session closed for user root
Jul 02 19:59:40 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-b13beeee-988f-4d71-b85e-05be347d9ed8 tempest-VolumesActionsTest-648440304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-b3253631-10f6-49c9-bdfe-0736345fc3f8" returned: 0 in 1.011s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:59:40 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-b13beeee-988f-4d71-b85e-05be347d9ed8 tempest-VolumesActionsTest-648440304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-b3253631-10f6-49c9-bdfe-0736345fc3f8 /opt/stack/data/cinder/conversion/b3253631-10f6-49c9-bdfe-0736345fc3f8.temp_image.e6384441-cf09-4779-8c7d-bf7b65719769p_kndohb.img {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:59:40 devstack sudo[103240]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-b3253631-10f6-49c9-bdfe-0736345fc3f8 /opt/stack/data/cinder/conversion/b3253631-10f6-49c9-bdfe-0736345fc3f8.temp_image.e6384441-cf09-4779-8c7d-bf7b65719769p_kndohb.img
Jul 02 19:59:40 devstack sudo[103240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:59:41 devstack cinder-volume[86639]: DEBUG oslo_service.periodic_task [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86639) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 02 19:59:41 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:59:41 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:59:41 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 19:59:41 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 19:59:41 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:59:41 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:59:41 devstack sudo[103253]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e
Jul 02 19:59:41 devstack sudo[103253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:59:43 devstack sudo[103253]: pam_unix(sudo:session): session closed for user root
Jul 02 19:59:43 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e" returned: 0 in 2.304s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:59:43 devstack cinder-volume[86639]: DEBUG cinder.manager [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] Notifying Schedulers of capabilities ... {{(pid=86639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 19:59:43 devstack cinder-volume[86639]: DEBUG oslo_service.periodic_task [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] Running periodic task VolumeManager._thread_info {{(pid=86639) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 02 19:59:43 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] thread count: 28 {{(pid=86639) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 02 19:59:43 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] thread info: [<_MainThread(MainThread, started 140525261275264)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 140525150678016)>, <Thread(Thread-3 (stat_writer), started daemon 140525150025920)>, <Thread(Rabbit-heartbeat, started daemon 140525150500864)>, <Thread(Thread-5 (_runner), started daemon 140525149847296)>, <Thread(Thread-7 (_runner), started daemon 140525149863424)>, <Thread(fd_logger, started daemon 140525146589376)>, <Thread(privsep_reader, started daemon 140525144562432)>, <Thread(tpool_thread_0, started daemon 140525137151680)>, <Thread(tpool_thread_1, started daemon 140525128758976)>, <Thread(tpool_thread_2, started daemon 140525120349888)>, <Thread(tpool_thread_3, started daemon 140525111940800)>, <Thread(tpool_thread_4, started daemon 140525103531712)>, <Thread(tpool_thread_5, started daemon 140525095122624)>, <Thread(tpool_thread_6, started daemon 140525086713536)>, <Thread(tpool_thread_7, started daemon 140525078304448)>, <Thread(tpool_thread_8, started daemon 140525069895360)>, <Thread(tpool_thread_9, started daemon 140525061486272)>, <Thread(tpool_thread_10, started daemon 140525053077184)>, <Thread(tpool_thread_11, started daemon 140525044668096)>, <Thread(tpool_thread_12, started daemon 140525036259008)>, <Thread(tpool_thread_13, started daemon 140525027849920)>, <Thread(tpool_thread_14, started daemon 140525019440832)>, <Thread(tpool_thread_15, started daemon 140525011031744)>, <Thread(tpool_thread_16, started daemon 140525002622656)>, <Thread(tpool_thread_17, started daemon 140524994213568)>, <Thread(tpool_thread_18, started daemon 140524985804480)>, <Thread(tpool_thread_19, started daemon 140524977395392)>] {{(pid=86639) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 02 19:59:46 devstack sudo[103240]: pam_unix(sudo:session): session closed for user root
Jul 02 19:59:46 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-b13beeee-988f-4d71-b85e-05be347d9ed8 tempest-VolumesActionsTest-648440304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-b3253631-10f6-49c9-bdfe-0736345fc3f8 /opt/stack/data/cinder/conversion/b3253631-10f6-49c9-bdfe-0736345fc3f8.temp_image.e6384441-cf09-4779-8c7d-bf7b65719769p_kndohb.img" returned: 0 in 6.298s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:59:46 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b10720d-d19e-4ddb-a078-9022a312d95c]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 19:59:46 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-b13beeee-988f-4d71-b85e-05be347d9ed8 tempest-VolumesActionsTest-648440304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-b3253631-10f6-49c9-bdfe-0736345fc3f8 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:59:46 devstack sudo[103274]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-b3253631-10f6-49c9-bdfe-0736345fc3f8
Jul 02 19:59:46 devstack sudo[103274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:59:47 devstack cinder-volume[86639]: INFO cinder.volume.manager [req-bb6ae9f7-9f37-4e14-a2b8-151e25e22571 req-a1050eaf-699c-4594-881e-9e3340aa298d tempest-TestStampPattern-490270338 None] Terminate volume connection completed successfully.
Jul 02 19:59:47 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [req-bb6ae9f7-9f37-4e14-a2b8-151e25e22571 req-a1050eaf-699c-4594-881e-9e3340aa298d tempest-TestStampPattern-490270338 None] Deleting attachment fefac67d-1de4-4e67-98ba-82affb4fee4a. {{(pid=86639) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 02 19:59:47 devstack sudo[103274]: pam_unix(sudo:session): session closed for user root
Jul 02 19:59:47 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-b13beeee-988f-4d71-b85e-05be347d9ed8 tempest-VolumesActionsTest-648440304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-b3253631-10f6-49c9-bdfe-0736345fc3f8" returned: 0 in 1.173s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:59:47 devstack cinder-volume[86639]: DEBUG cinder.image.image_utils [None req-b13beeee-988f-4d71-b85e-05be347d9ed8 tempest-VolumesActionsTest-648440304 None] Image conversion details: src /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-b3253631-10f6-49c9-bdfe-0736345fc3f8, size 1024.00 MB, duration 6.30 sec, destination /opt/stack/data/cinder/conversion/b3253631-10f6-49c9-bdfe-0736345fc3f8.temp_image.e6384441-cf09-4779-8c7d-bf7b65719769p_kndohb.img {{(pid=86639) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 02 19:59:47 devstack cinder-volume[86639]: INFO cinder.image.image_utils [None req-b13beeee-988f-4d71-b85e-05be347d9ed8 tempest-VolumesActionsTest-648440304 None] Converted 1024.00 MB image at 162.53 MB/s
Jul 02 19:59:47 devstack cinder-volume[86639]: DEBUG cinder.image.image_utils [None req-b13beeee-988f-4d71-b85e-05be347d9ed8 tempest-VolumesActionsTest-648440304 None] e6384441-cf09-4779-8c7d-bf7b65719769 was raw, converting to qcow2 {{(pid=86639) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}}
Jul 02 19:59:47 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[25149233-69f7-4db0-bad6-8b268dd114a1]: (4, 'raw') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 19:59:47 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-b13beeee-988f-4d71-b85e-05be347d9ed8 tempest-VolumesActionsTest-648440304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/b3253631-10f6-49c9-bdfe-0736345fc3f8.temp_image.e6384441-cf09-4779-8c7d-bf7b65719769p_kndohb.img {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:59:48 devstack sudo[103306]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/b3253631-10f6-49c9-bdfe-0736345fc3f8.temp_image.e6384441-cf09-4779-8c7d-bf7b65719769p_kndohb.img
Jul 02 19:59:48 devstack sudo[103306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:59:48 devstack sudo[103306]: pam_unix(sudo:session): session closed for user root
Jul 02 19:59:48 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-b13beeee-988f-4d71-b85e-05be347d9ed8 tempest-VolumesActionsTest-648440304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/b3253631-10f6-49c9-bdfe-0736345fc3f8.temp_image.e6384441-cf09-4779-8c7d-bf7b65719769p_kndohb.img" returned: 0 in 0.832s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:59:48 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-b13beeee-988f-4d71-b85e-05be347d9ed8 tempest-VolumesActionsTest-648440304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/b3253631-10f6-49c9-bdfe-0736345fc3f8.temp_image.e6384441-cf09-4779-8c7d-bf7b65719769p_kndohb.img {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:59:48 devstack sudo[103310]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/b3253631-10f6-49c9-bdfe-0736345fc3f8.temp_image.e6384441-cf09-4779-8c7d-bf7b65719769p_kndohb.img
Jul 02 19:59:48 devstack sudo[103310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:59:49 devstack sudo[103310]: pam_unix(sudo:session): session closed for user root
Jul 02 19:59:49 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-b13beeee-988f-4d71-b85e-05be347d9ed8 tempest-VolumesActionsTest-648440304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/b3253631-10f6-49c9-bdfe-0736345fc3f8.temp_image.e6384441-cf09-4779-8c7d-bf7b65719769p_kndohb.img" returned: 1 in 0.905s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:59:49 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-b13beeee-988f-4d71-b85e-05be347d9ed8 tempest-VolumesActionsTest-648440304 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/b3253631-10f6-49c9-bdfe-0736345fc3f8.temp_image.e6384441-cf09-4779-8c7d-bf7b65719769p_kndohb.img' failed. Not Retrying. {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 02 19:59:49 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-b13beeee-988f-4d71-b85e-05be347d9ed8 tempest-VolumesActionsTest-648440304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/b3253631-10f6-49c9-bdfe-0736345fc3f8.temp_image.e6384441-cf09-4779-8c7d-bf7b65719769p_kndohb.img /opt/stack/data/cinder/conversion/vol_upload_7k0kknx1 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:59:49 devstack sudo[103315]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/b3253631-10f6-49c9-bdfe-0736345fc3f8.temp_image.e6384441-cf09-4779-8c7d-bf7b65719769p_kndohb.img /opt/stack/data/cinder/conversion/vol_upload_7k0kknx1
Jul 02 19:59:49 devstack sudo[103315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:59:50 devstack sudo[103315]: pam_unix(sudo:session): session closed for user root
Jul 02 19:59:50 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-b13beeee-988f-4d71-b85e-05be347d9ed8 tempest-VolumesActionsTest-648440304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/b3253631-10f6-49c9-bdfe-0736345fc3f8.temp_image.e6384441-cf09-4779-8c7d-bf7b65719769p_kndohb.img /opt/stack/data/cinder/conversion/vol_upload_7k0kknx1" returned: 0 in 0.905s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:59:50 devstack cinder-volume[86639]: DEBUG cinder.image.image_utils [None req-b13beeee-988f-4d71-b85e-05be347d9ed8 tempest-VolumesActionsTest-648440304 None] Image conversion details: src /opt/stack/data/cinder/conversion/b3253631-10f6-49c9-bdfe-0736345fc3f8.temp_image.e6384441-cf09-4779-8c7d-bf7b65719769p_kndohb.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_7k0kknx1 {{(pid=86639) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 02 19:59:50 devstack cinder-volume[86639]: INFO cinder.image.image_utils [None req-b13beeee-988f-4d71-b85e-05be347d9ed8 tempest-VolumesActionsTest-648440304 None] Converted 1024.00 MB image at 1024.00 MB/s
Jul 02 19:59:50 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[e04252bf-70e2-4e40-8227-03671bfcaef4]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 19:59:50 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-b13beeee-988f-4d71-b85e-05be347d9ed8 tempest-VolumesActionsTest-648440304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_7k0kknx1 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:59:50 devstack sudo[103323]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_7k0kknx1
Jul 02 19:59:50 devstack sudo[103323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:59:51 devstack sudo[103323]: pam_unix(sudo:session): session closed for user root
Jul 02 19:59:51 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-b13beeee-988f-4d71-b85e-05be347d9ed8 tempest-VolumesActionsTest-648440304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_7k0kknx1" returned: 0 in 1.046s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:59:53 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-b13beeee-988f-4d71-b85e-05be347d9ed8 tempest-VolumesActionsTest-648440304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 15.554s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:59:53 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-b13beeee-988f-4d71-b85e-05be347d9ed8 tempest-VolumesActionsTest-648440304 None] Uploaded volume to glance image-id: e6384441-cf09-4779-8c7d-bf7b65719769. {{(pid=86639) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Jul 02 19:59:53 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-b13beeee-988f-4d71-b85e-05be347d9ed8 tempest-VolumesActionsTest-648440304 None] Copy volume to image completed successfully.
Jul 02 19:59:55 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-fea746ec-d6d5-459f-a775-e26bd8c93698 tempest-VolumesActionsTest-648440304 None] Acquiring lock "cinder-b3253631-10f6-49c9-bdfe-0736345fc3f8-delete_volume" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:59:55 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-fea746ec-d6d5-459f-a775-e26bd8c93698 tempest-VolumesActionsTest-648440304 None] Lock "cinder-b3253631-10f6-49c9-bdfe-0736345fc3f8-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:59:55 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-fea746ec-d6d5-459f-a775-e26bd8c93698 tempest-VolumesActionsTest-648440304 None] Acquiring lock "cinder-quobyte-b3253631-10f6-49c9-bdfe-0736345fc3f8" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:59:55 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-fea746ec-d6d5-459f-a775-e26bd8c93698 tempest-VolumesActionsTest-648440304 None] Lock "cinder-quobyte-b3253631-10f6-49c9-bdfe-0736345fc3f8" acquired by "delete_volume" :: waited 0.020s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:59:55 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdf74aea-68b2-4d9b-b8d0-d9abe010ea50]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 19:59:55 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-fea746ec-d6d5-459f-a775-e26bd8c93698 tempest-VolumesActionsTest-648440304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-b3253631-10f6-49c9-bdfe-0736345fc3f8 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:59:55 devstack sudo[103369]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-b3253631-10f6-49c9-bdfe-0736345fc3f8
Jul 02 19:59:55 devstack sudo[103369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:59:56 devstack sudo[103369]: pam_unix(sudo:session): session closed for user root
Jul 02 19:59:56 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-fea746ec-d6d5-459f-a775-e26bd8c93698 tempest-VolumesActionsTest-648440304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-b3253631-10f6-49c9-bdfe-0736345fc3f8" returned: 0 in 0.978s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:59:56 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-fea746ec-d6d5-459f-a775-e26bd8c93698 tempest-VolumesActionsTest-648440304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-b3253631-10f6-49c9-bdfe-0736345fc3f8 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:59:56 devstack sudo[103374]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-b3253631-10f6-49c9-bdfe-0736345fc3f8
Jul 02 19:59:56 devstack sudo[103374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:59:57 devstack sudo[103374]: pam_unix(sudo:session): session closed for user root
Jul 02 19:59:57 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-fea746ec-d6d5-459f-a775-e26bd8c93698 tempest-VolumesActionsTest-648440304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-b3253631-10f6-49c9-bdfe-0736345fc3f8" returned: 0 in 0.777s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:59:57 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-fea746ec-d6d5-459f-a775-e26bd8c93698 tempest-VolumesActionsTest-648440304 None] Lock "cinder-quobyte-b3253631-10f6-49c9-bdfe-0736345fc3f8" released by "delete_volume" :: held 1.820s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:59:57 devstack cinder-volume[86639]: DEBUG cinder.quota [None req-fea746ec-d6d5-459f-a775-e26bd8c93698 tempest-VolumesActionsTest-648440304 None] Created reservations ['d6734784-bad9-4960-b34c-1bd584261b84', 'f9065e8c-884c-4bf4-a4f3-76f2987fd47a', '9b34112d-884f-4aab-bfff-0a4f8f17d1bd', 'ec6f7b3d-4f9d-4a91-9e6b-7caed110b846'] {{(pid=86639) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 19:59:57 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-fea746ec-d6d5-459f-a775-e26bd8c93698 tempest-VolumesActionsTest-648440304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 19:59:57 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-fea746ec-d6d5-459f-a775-e26bd8c93698 tempest-VolumesActionsTest-648440304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 19:59:57 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-fea746ec-d6d5-459f-a775-e26bd8c93698 tempest-VolumesActionsTest-648440304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 19:59:57 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-fea746ec-d6d5-459f-a775-e26bd8c93698 tempest-VolumesActionsTest-648440304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 19:59:57 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-fea746ec-d6d5-459f-a775-e26bd8c93698 tempest-VolumesActionsTest-648440304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 19:59:57 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-fea746ec-d6d5-459f-a775-e26bd8c93698 tempest-VolumesActionsTest-648440304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:59:57 devstack sudo[103377]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e
Jul 02 19:59:57 devstack sudo[103377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:59:57 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-accd04ea-e50b-4e05-a376-6b225ec9c0cf tempest-TestStampPattern-490270338 None] Acquiring lock "cinder-7cc668b4-3598-40ea-b70b-5236c64a8196-delete_volume" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:59:57 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-accd04ea-e50b-4e05-a376-6b225ec9c0cf tempest-TestStampPattern-490270338 None] Lock "cinder-7cc668b4-3598-40ea-b70b-5236c64a8196-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:59:57 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-accd04ea-e50b-4e05-a376-6b225ec9c0cf tempest-TestStampPattern-490270338 None] Acquiring lock "cinder-quobyte-7cc668b4-3598-40ea-b70b-5236c64a8196" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 19:59:57 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-accd04ea-e50b-4e05-a376-6b225ec9c0cf tempest-TestStampPattern-490270338 None] Lock "cinder-quobyte-7cc668b4-3598-40ea-b70b-5236c64a8196" acquired by "delete_volume" :: waited 0.021s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 19:59:58 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[343ae61d-f485-4e4b-9ae0-7694abf59cb7]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 19:59:58 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-accd04ea-e50b-4e05-a376-6b225ec9c0cf tempest-TestStampPattern-490270338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-7cc668b4-3598-40ea-b70b-5236c64a8196 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:59:58 devstack sudo[103379]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-7cc668b4-3598-40ea-b70b-5236c64a8196
Jul 02 19:59:58 devstack sudo[103379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:59:58 devstack sudo[103377]: pam_unix(sudo:session): session closed for user root
Jul 02 19:59:58 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-fea746ec-d6d5-459f-a775-e26bd8c93698 tempest-VolumesActionsTest-648440304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e" returned: 0 in 0.998s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:59:58 devstack cinder-volume[86639]: DEBUG cinder.manager [None req-fea746ec-d6d5-459f-a775-e26bd8c93698 tempest-VolumesActionsTest-648440304 None] Notifying Schedulers of capabilities ... {{(pid=86639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 19:59:58 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-fea746ec-d6d5-459f-a775-e26bd8c93698 tempest-VolumesActionsTest-648440304 None] Deleted volume successfully.
Jul 02 19:59:58 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-fea746ec-d6d5-459f-a775-e26bd8c93698 tempest-VolumesActionsTest-648440304 None] Lock "cinder-b3253631-10f6-49c9-bdfe-0736345fc3f8-delete_volume" released by "delete_volume" :: held 3.125s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 19:59:59 devstack sudo[103379]: pam_unix(sudo:session): session closed for user root
Jul 02 19:59:59 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-accd04ea-e50b-4e05-a376-6b225ec9c0cf tempest-TestStampPattern-490270338 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-7cc668b4-3598-40ea-b70b-5236c64a8196" returned: 0 in 1.044s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:59:59 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-accd04ea-e50b-4e05-a376-6b225ec9c0cf tempest-TestStampPattern-490270338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-7cc668b4-3598-40ea-b70b-5236c64a8196 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 19:59:59 devstack sudo[103385]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-7cc668b4-3598-40ea-b70b-5236c64a8196
Jul 02 19:59:59 devstack sudo[103385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 19:59:59 devstack sudo[103385]: pam_unix(sudo:session): session closed for user root
Jul 02 19:59:59 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-accd04ea-e50b-4e05-a376-6b225ec9c0cf tempest-TestStampPattern-490270338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-7cc668b4-3598-40ea-b70b-5236c64a8196" returned: 0 in 0.853s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 19:59:59 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-accd04ea-e50b-4e05-a376-6b225ec9c0cf tempest-TestStampPattern-490270338 None] Lock "cinder-quobyte-7cc668b4-3598-40ea-b70b-5236c64a8196" released by "delete_volume" :: held 1.953s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 20:00:00 devstack cinder-volume[86639]: DEBUG cinder.quota [None req-accd04ea-e50b-4e05-a376-6b225ec9c0cf tempest-TestStampPattern-490270338 None] Created reservations ['6d40d409-2fa3-423d-9d2e-45ccdb9245bc', '46c62016-44bf-44ae-9294-c6552eec54b3', '905d70bf-734c-4ab7-98c8-34bab8e60efc', '382b669a-4e8e-4692-bc36-58993bcd0bee'] {{(pid=86639) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 20:00:00 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-accd04ea-e50b-4e05-a376-6b225ec9c0cf tempest-TestStampPattern-490270338 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 20:00:00 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-accd04ea-e50b-4e05-a376-6b225ec9c0cf tempest-TestStampPattern-490270338 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 20:00:00 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-accd04ea-e50b-4e05-a376-6b225ec9c0cf tempest-TestStampPattern-490270338 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 20:00:00 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-accd04ea-e50b-4e05-a376-6b225ec9c0cf tempest-TestStampPattern-490270338 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 20:00:00 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-accd04ea-e50b-4e05-a376-6b225ec9c0cf tempest-TestStampPattern-490270338 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 20:00:00 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-accd04ea-e50b-4e05-a376-6b225ec9c0cf tempest-TestStampPattern-490270338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:00:00 devstack sudo[103389]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e
Jul 02 20:00:00 devstack sudo[103389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:00:00 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-782b75c0-bdcc-45b0-b8d9-c92f2c4b9edf tempest-TestStampPattern-490270338 None] Acquiring lock "cinder-61f3494f-e4d3-416d-b996-300f7239497a-delete_snapshot" by "delete_snapshot" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 20:00:00 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-782b75c0-bdcc-45b0-b8d9-c92f2c4b9edf tempest-TestStampPattern-490270338 None] Lock "cinder-61f3494f-e4d3-416d-b996-300f7239497a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 20:00:00 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-782b75c0-bdcc-45b0-b8d9-c92f2c4b9edf tempest-TestStampPattern-490270338 None] Acquiring lock "cinder-quobyte-3f01b42d-1ed5-4eb3-be31-1f30a012b64e" by "delete_snapshot" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 20:00:00 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-782b75c0-bdcc-45b0-b8d9-c92f2c4b9edf tempest-TestStampPattern-490270338 None] Lock "cinder-quobyte-3f01b42d-1ed5-4eb3-be31-1f30a012b64e" acquired by "delete_snapshot" :: waited 0.043s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 20:00:00 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-782b75c0-bdcc-45b0-b8d9-c92f2c4b9edf tempest-TestStampPattern-490270338 None] Acquiring lock "cinder-quobyte-61f3494f-e4d3-416d-b996-300f7239497a" by "_delete_snapshot" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 20:00:00 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-782b75c0-bdcc-45b0-b8d9-c92f2c4b9edf tempest-TestStampPattern-490270338 None] Lock "cinder-quobyte-61f3494f-e4d3-416d-b996-300f7239497a" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 20:00:00 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-782b75c0-bdcc-45b0-b8d9-c92f2c4b9edf tempest-TestStampPattern-490270338 None] Deleting offline snapshot 61f3494f-e4d3-416d-b996-300f7239497a of volume 3f01b42d-1ed5-4eb3-be31-1f30a012b64e {{(pid=86639) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 02 20:00:00 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-782b75c0-bdcc-45b0-b8d9-c92f2c4b9edf tempest-TestStampPattern-490270338 None] snapshot_file for this snap is: volume-3f01b42d-1ed5-4eb3-be31-1f30a012b64e.61f3494f-e4d3-416d-b996-300f7239497a {{(pid=86639) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 02 20:00:00 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dc9167d-db41-40a4-94fb-8ed007d5faa5]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 20:00:00 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-782b75c0-bdcc-45b0-b8d9-c92f2c4b9edf tempest-TestStampPattern-490270338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-3f01b42d-1ed5-4eb3-be31-1f30a012b64e.61f3494f-e4d3-416d-b996-300f7239497a {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:00:00 devstack sudo[103391]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-3f01b42d-1ed5-4eb3-be31-1f30a012b64e.61f3494f-e4d3-416d-b996-300f7239497a
Jul 02 20:00:00 devstack sudo[103391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:00:01 devstack sudo[103389]: pam_unix(sudo:session): session closed for user root
Jul 02 20:00:01 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-accd04ea-e50b-4e05-a376-6b225ec9c0cf tempest-TestStampPattern-490270338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e" returned: 0 in 1.042s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:00:01 devstack cinder-volume[86639]: DEBUG cinder.manager [None req-accd04ea-e50b-4e05-a376-6b225ec9c0cf tempest-TestStampPattern-490270338 None] Notifying Schedulers of capabilities ... {{(pid=86639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 20:00:01 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-accd04ea-e50b-4e05-a376-6b225ec9c0cf tempest-TestStampPattern-490270338 None] Deleted volume successfully.
Jul 02 20:00:01 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-accd04ea-e50b-4e05-a376-6b225ec9c0cf tempest-TestStampPattern-490270338 None] Lock "cinder-7cc668b4-3598-40ea-b70b-5236c64a8196-delete_volume" released by "delete_volume" :: held 3.325s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 20:00:01 devstack sudo[103391]: pam_unix(sudo:session): session closed for user root
Jul 02 20:00:01 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-782b75c0-bdcc-45b0-b8d9-c92f2c4b9edf tempest-TestStampPattern-490270338 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-3f01b42d-1ed5-4eb3-be31-1f30a012b64e.61f3494f-e4d3-416d-b996-300f7239497a" returned: 0 in 1.233s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:00:01 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-782b75c0-bdcc-45b0-b8d9-c92f2c4b9edf tempest-TestStampPattern-490270338 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3f01b42d-1ed5-4eb3-be31-1f30a012b64e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86639) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 02 20:00:02 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fbc4d6d-1293-4dd3-ab9a-a80d623c569f]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 20:00:02 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-782b75c0-bdcc-45b0-b8d9-c92f2c4b9edf tempest-TestStampPattern-490270338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-3f01b42d-1ed5-4eb3-be31-1f30a012b64e {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:00:02 devstack sudo[103398]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-3f01b42d-1ed5-4eb3-be31-1f30a012b64e
Jul 02 20:00:02 devstack sudo[103398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:00:03 devstack sudo[103398]: pam_unix(sudo:session): session closed for user root
Jul 02 20:00:03 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-782b75c0-bdcc-45b0-b8d9-c92f2c4b9edf tempest-TestStampPattern-490270338 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-3f01b42d-1ed5-4eb3-be31-1f30a012b64e" returned: 0 in 1.070s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:00:03 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-782b75c0-bdcc-45b0-b8d9-c92f2c4b9edf tempest-TestStampPattern-490270338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-3f01b42d-1ed5-4eb3-be31-1f30a012b64e.61f3494f-e4d3-416d-b996-300f7239497a {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:00:03 devstack sudo[103404]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-3f01b42d-1ed5-4eb3-be31-1f30a012b64e.61f3494f-e4d3-416d-b996-300f7239497a
Jul 02 20:00:03 devstack sudo[103404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:00:04 devstack sudo[103404]: pam_unix(sudo:session): session closed for user root
Jul 02 20:00:04 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-782b75c0-bdcc-45b0-b8d9-c92f2c4b9edf tempest-TestStampPattern-490270338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-3f01b42d-1ed5-4eb3-be31-1f30a012b64e.61f3494f-e4d3-416d-b996-300f7239497a" returned: 0 in 1.052s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:00:04 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-782b75c0-bdcc-45b0-b8d9-c92f2c4b9edf tempest-TestStampPattern-490270338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-3f01b42d-1ed5-4eb3-be31-1f30a012b64e.61f3494f-e4d3-416d-b996-300f7239497a {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:00:04 devstack sudo[103410]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-3f01b42d-1ed5-4eb3-be31-1f30a012b64e.61f3494f-e4d3-416d-b996-300f7239497a
Jul 02 20:00:04 devstack sudo[103410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:00:04 devstack sudo[103410]: pam_unix(sudo:session): session closed for user root
Jul 02 20:00:04 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-782b75c0-bdcc-45b0-b8d9-c92f2c4b9edf tempest-TestStampPattern-490270338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-3f01b42d-1ed5-4eb3-be31-1f30a012b64e.61f3494f-e4d3-416d-b996-300f7239497a" returned: 0 in 0.751s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:00:05 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-782b75c0-bdcc-45b0-b8d9-c92f2c4b9edf tempest-TestStampPattern-490270338 None] Lock "cinder-quobyte-61f3494f-e4d3-416d-b996-300f7239497a" released by "_delete_snapshot" :: held 4.311s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 20:00:05 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-782b75c0-bdcc-45b0-b8d9-c92f2c4b9edf tempest-TestStampPattern-490270338 None] Lock "cinder-quobyte-3f01b42d-1ed5-4eb3-be31-1f30a012b64e" released by "delete_snapshot" :: held 4.366s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 20:00:05 devstack cinder-volume[86639]: DEBUG cinder.quota [None req-782b75c0-bdcc-45b0-b8d9-c92f2c4b9edf tempest-TestStampPattern-490270338 None] Created reservations ['4248ffa1-d439-4945-81d3-ad4e1d7c9a6f', '72373b22-d056-4b2f-b317-f3dba4086a7a', 'c2fe7977-426d-41c8-b6fc-16bd74442711', '1b687dec-8adb-4733-9d3c-6136e26d4e32'] {{(pid=86639) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 20:00:05 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-782b75c0-bdcc-45b0-b8d9-c92f2c4b9edf tempest-TestStampPattern-490270338 None] Delete snapshot completed successfully.
Jul 02 20:00:05 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-782b75c0-bdcc-45b0-b8d9-c92f2c4b9edf tempest-TestStampPattern-490270338 None] Lock "cinder-61f3494f-e4d3-416d-b996-300f7239497a-delete_snapshot" released by "delete_snapshot" :: held 4.663s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 20:00:06 devstack cinder-volume[86639]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b8137b4-866e-48af-a909-344c8b588a29 tempest-VolumesSnapshotListTestJSON-723237481 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 20:00:06 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-2b8137b4-866e-48af-a909-344c8b588a29 tempest-VolumesSnapshotListTestJSON-723237481 None] Flow 'volume_create_manager' (f76b3784-c617-4d97-8403-f41c4e38e6a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 20:00:06 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-2b8137b4-866e-48af-a909-344c8b588a29 tempest-VolumesSnapshotListTestJSON-723237481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7c6d084-a0ba-4171-b452-fdcc45ffdd74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:00:06 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-2b8137b4-866e-48af-a909-344c8b588a29 tempest-VolumesSnapshotListTestJSON-723237481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7c6d084-a0ba-4171-b452-fdcc45ffdd74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T18:00:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1589830549',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c7a7bc3-e4c0-45ef-9778-3a355bcf057b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1cb554f6b974151801fb55f4c5875c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T18:00:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T18:00:06Z,use_quota=True,user_id='f4a9a7fbaddf497494b9cf319f1dc67b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:00:06 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-2b8137b4-866e-48af-a909-344c8b588a29 tempest-VolumesSnapshotListTestJSON-723237481 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfb119c1-941a-485a-9075-85bd1ea43ccb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:00:06 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-2b8137b4-866e-48af-a909-344c8b588a29 tempest-VolumesSnapshotListTestJSON-723237481 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfb119c1-941a-485a-9075-85bd1ea43ccb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:00:06 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-2b8137b4-866e-48af-a909-344c8b588a29 tempest-VolumesSnapshotListTestJSON-723237481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bfc212f-0dd7-443b-a7c0-711b46f776f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:00:06 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-2b8137b4-866e-48af-a909-344c8b588a29 tempest-VolumesSnapshotListTestJSON-723237481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bfc212f-0dd7-443b-a7c0-711b46f776f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8c7a7bc3-e4c0-45ef-9778-3a355bcf057b', 'volume_name': 'volume-8c7a7bc3-e4c0-45ef-9778-3a355bcf057b', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:00:06 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-2b8137b4-866e-48af-a909-344c8b588a29 tempest-VolumesSnapshotListTestJSON-723237481 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (deb254e4-a459-4429-92cd-40e2683cb9f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:00:06 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-2b8137b4-866e-48af-a909-344c8b588a29 tempest-VolumesSnapshotListTestJSON-723237481 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (deb254e4-a459-4429-92cd-40e2683cb9f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:00:06 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-2b8137b4-866e-48af-a909-344c8b588a29 tempest-VolumesSnapshotListTestJSON-723237481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0643bc5b-3c93-45a6-b55e-3e57599aa6c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:00:06 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-2b8137b4-866e-48af-a909-344c8b588a29 tempest-VolumesSnapshotListTestJSON-723237481 None] Volume 8c7a7bc3-e4c0-45ef-9778-3a355bcf057b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8c7a7bc3-e4c0-45ef-9778-3a355bcf057b', 'volume_size': 1}
Jul 02 20:00:06 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-2b8137b4-866e-48af-a909-344c8b588a29 tempest-VolumesSnapshotListTestJSON-723237481 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 20:00:06 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-2b8137b4-866e-48af-a909-344c8b588a29 tempest-VolumesSnapshotListTestJSON-723237481 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 20:00:06 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-2b8137b4-866e-48af-a909-344c8b588a29 tempest-VolumesSnapshotListTestJSON-723237481 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce906cb830>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T18:00:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1589830549',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c7a7bc3-e4c0-45ef-9778-3a355bcf057b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1cb554f6b974151801fb55f4c5875c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T18:00:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T18:00:06Z,use_quota=True,user_id='f4a9a7fbaddf497494b9cf319f1dc67b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)}" {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 20:00:06 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-2b8137b4-866e-48af-a909-344c8b588a29 tempest-VolumesSnapshotListTestJSON-723237481 None] Creating volume 8c7a7bc3-e4c0-45ef-9778-3a355bcf057b {{(pid=86639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 20:00:06 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-2b8137b4-866e-48af-a909-344c8b588a29 tempest-VolumesSnapshotListTestJSON-723237481 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 20:00:06 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-2b8137b4-866e-48af-a909-344c8b588a29 tempest-VolumesSnapshotListTestJSON-723237481 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 20:00:06 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-2b8137b4-866e-48af-a909-344c8b588a29 tempest-VolumesSnapshotListTestJSON-723237481 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 20:00:06 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-2b8137b4-866e-48af-a909-344c8b588a29 tempest-VolumesSnapshotListTestJSON-723237481 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 20:00:06 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-2b8137b4-866e-48af-a909-344c8b588a29 tempest-VolumesSnapshotListTestJSON-723237481 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 20:00:06 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-2b8137b4-866e-48af-a909-344c8b588a29 tempest-VolumesSnapshotListTestJSON-723237481 None] Selected osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92 as target Quobyte volume. {{(pid=86639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 20:00:06 devstack cinder-volume[86639]: INFO cinder.volume.drivers.remotefs [None req-2b8137b4-866e-48af-a909-344c8b588a29 tempest-VolumesSnapshotListTestJSON-723237481 None] casted to osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92
Jul 02 20:00:06 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-2b8137b4-866e-48af-a909-344c8b588a29 tempest-VolumesSnapshotListTestJSON-723237481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8c7a7bc3-e4c0-45ef-9778-3a355bcf057b 1073741824 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:00:06 devstack sudo[103413]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8c7a7bc3-e4c0-45ef-9778-3a355bcf057b 1073741824
Jul 02 20:00:06 devstack sudo[103413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:00:07 devstack sudo[103413]: pam_unix(sudo:session): session closed for user root
Jul 02 20:00:07 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-2b8137b4-866e-48af-a909-344c8b588a29 tempest-VolumesSnapshotListTestJSON-723237481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8c7a7bc3-e4c0-45ef-9778-3a355bcf057b 1073741824" returned: 0 in 1.189s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:00:07 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-2b8137b4-866e-48af-a909-344c8b588a29 tempest-VolumesSnapshotListTestJSON-723237481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8c7a7bc3-e4c0-45ef-9778-3a355bcf057b {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:00:07 devstack sudo[103419]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8c7a7bc3-e4c0-45ef-9778-3a355bcf057b
Jul 02 20:00:07 devstack sudo[103419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:00:08 devstack sudo[103419]: pam_unix(sudo:session): session closed for user root
Jul 02 20:00:08 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-2b8137b4-866e-48af-a909-344c8b588a29 tempest-VolumesSnapshotListTestJSON-723237481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8c7a7bc3-e4c0-45ef-9778-3a355bcf057b" returned: 0 in 0.903s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:00:08 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-2b8137b4-866e-48af-a909-344c8b588a29 tempest-VolumesSnapshotListTestJSON-723237481 None] <== create_volume: return (2177ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'} {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 20:00:08 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-2b8137b4-866e-48af-a909-344c8b588a29 tempest-VolumesSnapshotListTestJSON-723237481 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.180s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 20:00:08 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-2b8137b4-866e-48af-a909-344c8b588a29 tempest-VolumesSnapshotListTestJSON-723237481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0643bc5b-3c93-45a6-b55e-3e57599aa6c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c7a7bc3-e4c0-45ef-9778-3a355bcf057b', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:00:08 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-2b8137b4-866e-48af-a909-344c8b588a29 tempest-VolumesSnapshotListTestJSON-723237481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3c9f993-f89c-4dc1-964c-02f7414c51ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:00:08 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-2b8137b4-866e-48af-a909-344c8b588a29 tempest-VolumesSnapshotListTestJSON-723237481 None] Volume volume-8c7a7bc3-e4c0-45ef-9778-3a355bcf057b (8c7a7bc3-e4c0-45ef-9778-3a355bcf057b): created successfully
Jul 02 20:00:08 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-2b8137b4-866e-48af-a909-344c8b588a29 tempest-VolumesSnapshotListTestJSON-723237481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3c9f993-f89c-4dc1-964c-02f7414c51ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:00:08 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-2b8137b4-866e-48af-a909-344c8b588a29 tempest-VolumesSnapshotListTestJSON-723237481 None] Flow 'volume_create_manager' (f76b3784-c617-4d97-8403-f41c4e38e6a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 20:00:08 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-2b8137b4-866e-48af-a909-344c8b588a29 tempest-VolumesSnapshotListTestJSON-723237481 None] Created volume successfully.
Jul 02 20:00:09 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-05b347ff-d35c-4cd6-a594-79d1823dac2c tempest-VolumesSnapshotListTestJSON-723237481 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 20:00:09 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-05b347ff-d35c-4cd6-a594-79d1823dac2c tempest-VolumesSnapshotListTestJSON-723237481 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 20:00:09 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-05b347ff-d35c-4cd6-a594-79d1823dac2c tempest-VolumesSnapshotListTestJSON-723237481 None] Creating offline snapshot f7b450b1-8a58-4ff3-a7ce-6dbba83cb309 of volume 8c7a7bc3-e4c0-45ef-9778-3a355bcf057b {{(pid=86639) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 02 20:00:09 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[9260708d-8719-4e15-9d38-3798cd6210ce]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 20:00:09 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-05b347ff-d35c-4cd6-a594-79d1823dac2c tempest-VolumesSnapshotListTestJSON-723237481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8c7a7bc3-e4c0-45ef-9778-3a355bcf057b {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:00:10 devstack sudo[103462]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8c7a7bc3-e4c0-45ef-9778-3a355bcf057b
Jul 02 20:00:10 devstack sudo[103462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:00:11 devstack sudo[103462]: pam_unix(sudo:session): session closed for user root
Jul 02 20:00:11 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-05b347ff-d35c-4cd6-a594-79d1823dac2c tempest-VolumesSnapshotListTestJSON-723237481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8c7a7bc3-e4c0-45ef-9778-3a355bcf057b" returned: 0 in 1.237s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:00:11 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-05b347ff-d35c-4cd6-a594-79d1823dac2c tempest-VolumesSnapshotListTestJSON-723237481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8c7a7bc3-e4c0-45ef-9778-3a355bcf057b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8c7a7bc3-e4c0-45ef-9778-3a355bcf057b.f7b450b1-8a58-4ff3-a7ce-6dbba83cb309 1G {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:00:11 devstack sudo[103469]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8c7a7bc3-e4c0-45ef-9778-3a355bcf057b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8c7a7bc3-e4c0-45ef-9778-3a355bcf057b.f7b450b1-8a58-4ff3-a7ce-6dbba83cb309 1G
Jul 02 20:00:11 devstack sudo[103469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:00:12 devstack sudo[103469]: pam_unix(sudo:session): session closed for user root
Jul 02 20:00:12 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-05b347ff-d35c-4cd6-a594-79d1823dac2c tempest-VolumesSnapshotListTestJSON-723237481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8c7a7bc3-e4c0-45ef-9778-3a355bcf057b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8c7a7bc3-e4c0-45ef-9778-3a355bcf057b.f7b450b1-8a58-4ff3-a7ce-6dbba83cb309 1G" returned: 0 in 1.542s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:00:12 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-05b347ff-d35c-4cd6-a594-79d1823dac2c tempest-VolumesSnapshotListTestJSON-723237481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8c7a7bc3-e4c0-45ef-9778-3a355bcf057b -F qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8c7a7bc3-e4c0-45ef-9778-3a355bcf057b.f7b450b1-8a58-4ff3-a7ce-6dbba83cb309 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:00:12 devstack sudo[103477]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8c7a7bc3-e4c0-45ef-9778-3a355bcf057b -F qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8c7a7bc3-e4c0-45ef-9778-3a355bcf057b.f7b450b1-8a58-4ff3-a7ce-6dbba83cb309
Jul 02 20:00:12 devstack sudo[103477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:00:13 devstack sudo[103477]: pam_unix(sudo:session): session closed for user root
Jul 02 20:00:13 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-05b347ff-d35c-4cd6-a594-79d1823dac2c tempest-VolumesSnapshotListTestJSON-723237481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8c7a7bc3-e4c0-45ef-9778-3a355bcf057b -F qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8c7a7bc3-e4c0-45ef-9778-3a355bcf057b.f7b450b1-8a58-4ff3-a7ce-6dbba83cb309" returned: 0 in 0.943s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:00:13 devstack cinder-volume[86639]: WARNING cinder.volume.drivers.remotefs [None req-05b347ff-d35c-4cd6-a594-79d1823dac2c tempest-VolumesSnapshotListTestJSON-723237481 None] /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8c7a7bc3-e4c0-45ef-9778-3a355bcf057b.f7b450b1-8a58-4ff3-a7ce-6dbba83cb309 is being set with open permissions: ugo+rw
Jul 02 20:00:13 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-05b347ff-d35c-4cd6-a594-79d1823dac2c tempest-VolumesSnapshotListTestJSON-723237481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8c7a7bc3-e4c0-45ef-9778-3a355bcf057b.f7b450b1-8a58-4ff3-a7ce-6dbba83cb309 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:00:13 devstack sudo[103482]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8c7a7bc3-e4c0-45ef-9778-3a355bcf057b.f7b450b1-8a58-4ff3-a7ce-6dbba83cb309
Jul 02 20:00:13 devstack sudo[103482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:00:14 devstack sudo[103482]: pam_unix(sudo:session): session closed for user root
Jul 02 20:00:14 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-05b347ff-d35c-4cd6-a594-79d1823dac2c tempest-VolumesSnapshotListTestJSON-723237481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8c7a7bc3-e4c0-45ef-9778-3a355bcf057b.f7b450b1-8a58-4ff3-a7ce-6dbba83cb309" returned: 0 in 0.805s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:00:14 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-05b347ff-d35c-4cd6-a594-79d1823dac2c tempest-VolumesSnapshotListTestJSON-723237481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8c7a7bc3-e4c0-45ef-9778-3a355bcf057b.info {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:00:14 devstack sudo[103486]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8c7a7bc3-e4c0-45ef-9778-3a355bcf057b.info
Jul 02 20:00:14 devstack sudo[103486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:00:15 devstack sudo[103486]: pam_unix(sudo:session): session closed for user root
Jul 02 20:00:15 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-05b347ff-d35c-4cd6-a594-79d1823dac2c tempest-VolumesSnapshotListTestJSON-723237481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8c7a7bc3-e4c0-45ef-9778-3a355bcf057b.info" returned: 0 in 0.776s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:00:15 devstack cinder-volume[86639]: WARNING cinder.volume.drivers.remotefs [None req-05b347ff-d35c-4cd6-a594-79d1823dac2c tempest-VolumesSnapshotListTestJSON-723237481 None] /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8c7a7bc3-e4c0-45ef-9778-3a355bcf057b.info is being set with open permissions: ugo+rw
Jul 02 20:00:15 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-05b347ff-d35c-4cd6-a594-79d1823dac2c tempest-VolumesSnapshotListTestJSON-723237481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8c7a7bc3-e4c0-45ef-9778-3a355bcf057b.info {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:00:15 devstack sudo[103489]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8c7a7bc3-e4c0-45ef-9778-3a355bcf057b.info
Jul 02 20:00:15 devstack sudo[103489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:00:16 devstack sudo[103489]: pam_unix(sudo:session): session closed for user root
Jul 02 20:00:16 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-05b347ff-d35c-4cd6-a594-79d1823dac2c tempest-VolumesSnapshotListTestJSON-723237481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8c7a7bc3-e4c0-45ef-9778-3a355bcf057b.info" returned: 0 in 0.772s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:00:16 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-05b347ff-d35c-4cd6-a594-79d1823dac2c tempest-VolumesSnapshotListTestJSON-723237481 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.223s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 20:00:16 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-05b347ff-d35c-4cd6-a594-79d1823dac2c tempest-VolumesSnapshotListTestJSON-723237481 None] Create snapshot completed successfully
Jul 02 20:00:16 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-42e5add5-5e92-49a8-a927-93c27f2212cc tempest-TestStampPattern-490270338 None] Acquiring lock "cinder-3f01b42d-1ed5-4eb3-be31-1f30a012b64e-delete_volume" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 20:00:16 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-42e5add5-5e92-49a8-a927-93c27f2212cc tempest-TestStampPattern-490270338 None] Lock "cinder-3f01b42d-1ed5-4eb3-be31-1f30a012b64e-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 20:00:16 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-42e5add5-5e92-49a8-a927-93c27f2212cc tempest-TestStampPattern-490270338 None] Acquiring lock "cinder-quobyte-3f01b42d-1ed5-4eb3-be31-1f30a012b64e" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 20:00:16 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-42e5add5-5e92-49a8-a927-93c27f2212cc tempest-TestStampPattern-490270338 None] Lock "cinder-quobyte-3f01b42d-1ed5-4eb3-be31-1f30a012b64e" acquired by "delete_volume" :: waited 0.021s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 20:00:16 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[299993d2-da43-431b-98a0-c997f2e262c5]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 20:00:16 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-42e5add5-5e92-49a8-a927-93c27f2212cc tempest-TestStampPattern-490270338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-3f01b42d-1ed5-4eb3-be31-1f30a012b64e {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:00:16 devstack sudo[103492]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-3f01b42d-1ed5-4eb3-be31-1f30a012b64e
Jul 02 20:00:16 devstack sudo[103492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:00:16 devstack cinder-volume[86639]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea9e3765-8d1d-4010-968e-79f6596b0ae8 tempest-TestShelveInstance-1204606342 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 20:00:16 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-ea9e3765-8d1d-4010-968e-79f6596b0ae8 tempest-TestShelveInstance-1204606342 None] Flow 'volume_create_manager' (4b826cc5-d5b0-414c-9d17-3e0a7a3c05d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 20:00:16 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-ea9e3765-8d1d-4010-968e-79f6596b0ae8 tempest-TestShelveInstance-1204606342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a31a8f4d-f1c5-4556-9d0c-33dc119e9ded) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:00:16 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-ea9e3765-8d1d-4010-968e-79f6596b0ae8 tempest-TestShelveInstance-1204606342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a31a8f4d-f1c5-4556-9d0c-33dc119e9ded) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T18:00:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1170897012',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a992da0d-c1f8-4a49-8b48-729e67de065d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed6a81659f734da3aef967ad63db3b11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T18:00:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T18:00:17Z,use_quota=True,user_id='fc9a0c4f63de41f7b4bc448e1405373d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:00:16 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-ea9e3765-8d1d-4010-968e-79f6596b0ae8 tempest-TestShelveInstance-1204606342 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16516a97-2540-4c38-919a-df3dcc684de2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:00:16 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-ea9e3765-8d1d-4010-968e-79f6596b0ae8 tempest-TestShelveInstance-1204606342 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16516a97-2540-4c38-919a-df3dcc684de2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:00:16 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-ea9e3765-8d1d-4010-968e-79f6596b0ae8 tempest-TestShelveInstance-1204606342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (492888d2-5c8c-44d1-ad52-7131123b1530) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:00:16 devstack cinder-volume[86639]: DEBUG cinder.image.glance [None req-ea9e3765-8d1d-4010-968e-79f6596b0ae8 tempest-TestShelveInstance-1204606342 None] Creating Keystone auth plugin from conf {{(pid=86639) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jul 02 20:00:17 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-ea9e3765-8d1d-4010-968e-79f6596b0ae8 tempest-TestShelveInstance-1204606342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (492888d2-5c8c-44d1-ad52-7131123b1530) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a992da0d-c1f8-4a49-8b48-729e67de065d', 'volume_name': 'volume-a992da0d-c1f8-4a49-8b48-729e67de065d', 'volume_size': 1, 'image_id': 'a2dc855a-b708-430d-973d-a136c6e54873', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a2dc855a-b708-430d-973d-a136c6e54873', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b6fd8f5b5bb142078118935d5734f463', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a2dc855a-b708-430d-973d-a136c6e54873', 'created_at': datetime.datetime(2026, 7, 2, 17, 34, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 2, 17, 34, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a2dc855a-b708-430d-973d-a136c6e54873/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fce8efd1340>}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:00:17 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-ea9e3765-8d1d-4010-968e-79f6596b0ae8 tempest-TestShelveInstance-1204606342 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e568a18-06df-4c30-beee-d5753c0368aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:00:17 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-ea9e3765-8d1d-4010-968e-79f6596b0ae8 tempest-TestShelveInstance-1204606342 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e568a18-06df-4c30-beee-d5753c0368aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:00:17 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-ea9e3765-8d1d-4010-968e-79f6596b0ae8 tempest-TestShelveInstance-1204606342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3b197d1-bd9e-4923-bb00-680786af34d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:00:17 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-ea9e3765-8d1d-4010-968e-79f6596b0ae8 tempest-TestShelveInstance-1204606342 None] Volume a992da0d-c1f8-4a49-8b48-729e67de065d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a992da0d-c1f8-4a49-8b48-729e67de065d', 'volume_size': 1, 'image_id': 'a2dc855a-b708-430d-973d-a136c6e54873', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a2dc855a-b708-430d-973d-a136c6e54873', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b6fd8f5b5bb142078118935d5734f463', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a2dc855a-b708-430d-973d-a136c6e54873', 'created_at': datetime.datetime(2026, 7, 2, 17, 34, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 2, 17, 34, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a2dc855a-b708-430d-973d-a136c6e54873/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fce8efd1340>}
Jul 02 20:00:17 devstack cinder-volume[86639]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea9e3765-8d1d-4010-968e-79f6596b0ae8 tempest-TestShelveInstance-1204606342 None] Trying to clone a992da0d-c1f8-4a49-8b48-729e67de065d from image a2dc855a-b708-430d-973d-a136c6e54873 at location (None, [{'url': 'file:///opt/stack/data/glance/images/a2dc855a-b708-430d-973d-a136c6e54873', 'metadata': {}}]). {{(pid=86639) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jul 02 20:00:17 devstack sudo[103492]: pam_unix(sudo:session): session closed for user root
Jul 02 20:00:17 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-42e5add5-5e92-49a8-a927-93c27f2212cc tempest-TestStampPattern-490270338 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-3f01b42d-1ed5-4eb3-be31-1f30a012b64e" returned: 0 in 0.884s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:00:17 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-42e5add5-5e92-49a8-a927-93c27f2212cc tempest-TestStampPattern-490270338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-3f01b42d-1ed5-4eb3-be31-1f30a012b64e {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:00:17 devstack sudo[103498]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-3f01b42d-1ed5-4eb3-be31-1f30a012b64e
Jul 02 20:00:17 devstack sudo[103498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:00:17 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-a98ae138-0ca0-456f-9a1d-6240cdf53fcf tempest-VolumesSnapshotListTestJSON-723237481 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 20:00:17 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-a98ae138-0ca0-456f-9a1d-6240cdf53fcf tempest-VolumesSnapshotListTestJSON-723237481 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 20:00:17 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-a98ae138-0ca0-456f-9a1d-6240cdf53fcf tempest-VolumesSnapshotListTestJSON-723237481 None] Creating offline snapshot cb113554-f426-40d7-9256-41c93f73b255 of volume 8c7a7bc3-e4c0-45ef-9778-3a355bcf057b {{(pid=86639) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 02 20:00:17 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[417ea824-da17-4bb5-afc0-2051d751eb93]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 20:00:17 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-a98ae138-0ca0-456f-9a1d-6240cdf53fcf tempest-VolumesSnapshotListTestJSON-723237481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8c7a7bc3-e4c0-45ef-9778-3a355bcf057b.f7b450b1-8a58-4ff3-a7ce-6dbba83cb309 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:00:17 devstack cinder-volume[86639]: DEBUG cinder.image.image_utils [None req-ea9e3765-8d1d-4010-968e-79f6596b0ae8 tempest-TestShelveInstance-1204606342 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_a2dc855a-b708-430d-973d-a136c6e54873_k56duckpdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86639) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jul 02 20:00:17 devstack cinder-volume[86639]: INFO cinder.image.image_utils [None req-ea9e3765-8d1d-4010-968e-79f6596b0ae8 tempest-TestShelveInstance-1204606342 None] Image download 20.69 MB at 20.69 MB/s
Jul 02 20:00:17 devstack sudo[103501]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8c7a7bc3-e4c0-45ef-9778-3a355bcf057b.f7b450b1-8a58-4ff3-a7ce-6dbba83cb309
Jul 02 20:00:17 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[f73237e8-13bc-43b6-be7b-678b4cb3d2b5]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 20:00:17 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-ea9e3765-8d1d-4010-968e-79f6596b0ae8 tempest-TestShelveInstance-1204606342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a2dc855a-b708-430d-973d-a136c6e54873_k56duckpdevstack@QuobyteHD {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:00:17 devstack sudo[103501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:00:17 devstack sudo[103503]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a2dc855a-b708-430d-973d-a136c6e54873_k56duckpdevstack@QuobyteHD
Jul 02 20:00:17 devstack sudo[103503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:00:18 devstack sudo[103498]: pam_unix(sudo:session): session closed for user root
Jul 02 20:00:18 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-42e5add5-5e92-49a8-a927-93c27f2212cc tempest-TestStampPattern-490270338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-3f01b42d-1ed5-4eb3-be31-1f30a012b64e" returned: 0 in 0.914s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:00:18 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-42e5add5-5e92-49a8-a927-93c27f2212cc tempest-TestStampPattern-490270338 None] Lock "cinder-quobyte-3f01b42d-1ed5-4eb3-be31-1f30a012b64e" released by "delete_volume" :: held 1.879s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 20:00:18 devstack cinder-volume[86639]: DEBUG cinder.quota [None req-42e5add5-5e92-49a8-a927-93c27f2212cc tempest-TestStampPattern-490270338 None] Created reservations ['c7dc986b-2127-4561-ae49-c448e329b013', 'c2b5e6e9-0d40-426f-aff2-795b7c867615', '321ff37d-3a51-4509-920e-fba17bc9138e', '38ed8097-e71f-472a-8d92-4eae3e381634'] {{(pid=86639) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 20:00:18 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-42e5add5-5e92-49a8-a927-93c27f2212cc tempest-TestStampPattern-490270338 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 20:00:18 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-42e5add5-5e92-49a8-a927-93c27f2212cc tempest-TestStampPattern-490270338 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 20:00:18 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-42e5add5-5e92-49a8-a927-93c27f2212cc tempest-TestStampPattern-490270338 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 20:00:18 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-42e5add5-5e92-49a8-a927-93c27f2212cc tempest-TestStampPattern-490270338 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 20:00:18 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-42e5add5-5e92-49a8-a927-93c27f2212cc tempest-TestStampPattern-490270338 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 20:00:18 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-42e5add5-5e92-49a8-a927-93c27f2212cc tempest-TestStampPattern-490270338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:00:18 devstack sudo[103510]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e
Jul 02 20:00:18 devstack sudo[103510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:00:18 devstack sudo[103501]: pam_unix(sudo:session): session closed for user root
Jul 02 20:00:18 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-a98ae138-0ca0-456f-9a1d-6240cdf53fcf tempest-VolumesSnapshotListTestJSON-723237481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8c7a7bc3-e4c0-45ef-9778-3a355bcf057b.f7b450b1-8a58-4ff3-a7ce-6dbba83cb309" returned: 0 in 1.016s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:00:18 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-a98ae138-0ca0-456f-9a1d-6240cdf53fcf tempest-VolumesSnapshotListTestJSON-723237481 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8c7a7bc3-e4c0-45ef-9778-3a355bcf057b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86639) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 02 20:00:18 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-a98ae138-0ca0-456f-9a1d-6240cdf53fcf tempest-VolumesSnapshotListTestJSON-723237481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8c7a7bc3-e4c0-45ef-9778-3a355bcf057b.f7b450b1-8a58-4ff3-a7ce-6dbba83cb309,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8c7a7bc3-e4c0-45ef-9778-3a355bcf057b.cb113554-f426-40d7-9256-41c93f73b255 1G {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:00:18 devstack sudo[103516]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8c7a7bc3-e4c0-45ef-9778-3a355bcf057b.f7b450b1-8a58-4ff3-a7ce-6dbba83cb309,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8c7a7bc3-e4c0-45ef-9778-3a355bcf057b.cb113554-f426-40d7-9256-41c93f73b255 1G
Jul 02 20:00:18 devstack sudo[103516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:00:18 devstack sudo[103503]: pam_unix(sudo:session): session closed for user root
Jul 02 20:00:18 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-ea9e3765-8d1d-4010-968e-79f6596b0ae8 tempest-TestShelveInstance-1204606342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a2dc855a-b708-430d-973d-a136c6e54873_k56duckpdevstack@QuobyteHD" returned: 0 in 0.985s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:00:18 devstack cinder-volume[86639]: DEBUG cinder.image.image_utils [None req-ea9e3765-8d1d-4010-968e-79f6596b0ae8 tempest-TestShelveInstance-1204606342 None] Temporary image a2dc855a-b708-430d-973d-a136c6e54873 is fetched for user fc9a0c4f63de41f7b4bc448e1405373d. {{(pid=86639) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jul 02 20:00:18 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[45f50251-4349-45c5-bbb5-dcb429457758]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 20:00:18 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-ea9e3765-8d1d-4010-968e-79f6596b0ae8 tempest-TestShelveInstance-1204606342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a2dc855a-b708-430d-973d-a136c6e54873_k56duckpdevstack@QuobyteHD {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:00:19 devstack sudo[103518]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a2dc855a-b708-430d-973d-a136c6e54873_k56duckpdevstack@QuobyteHD
Jul 02 20:00:19 devstack sudo[103518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:00:19 devstack sudo[103510]: pam_unix(sudo:session): session closed for user root
Jul 02 20:00:19 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-42e5add5-5e92-49a8-a927-93c27f2212cc tempest-TestStampPattern-490270338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e" returned: 0 in 1.023s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:00:19 devstack cinder-volume[86639]: DEBUG cinder.manager [None req-42e5add5-5e92-49a8-a927-93c27f2212cc tempest-TestStampPattern-490270338 None] Notifying Schedulers of capabilities ... {{(pid=86639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 20:00:19 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-42e5add5-5e92-49a8-a927-93c27f2212cc tempest-TestStampPattern-490270338 None] Deleted volume successfully.
Jul 02 20:00:19 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-42e5add5-5e92-49a8-a927-93c27f2212cc tempest-TestStampPattern-490270338 None] Lock "cinder-3f01b42d-1ed5-4eb3-be31-1f30a012b64e-delete_volume" released by "delete_volume" :: held 3.227s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 20:00:19 devstack sudo[103516]: pam_unix(sudo:session): session closed for user root
Jul 02 20:00:19 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-a98ae138-0ca0-456f-9a1d-6240cdf53fcf tempest-VolumesSnapshotListTestJSON-723237481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8c7a7bc3-e4c0-45ef-9778-3a355bcf057b.f7b450b1-8a58-4ff3-a7ce-6dbba83cb309,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8c7a7bc3-e4c0-45ef-9778-3a355bcf057b.cb113554-f426-40d7-9256-41c93f73b255 1G" returned: 0 in 1.150s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:00:19 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-a98ae138-0ca0-456f-9a1d-6240cdf53fcf tempest-VolumesSnapshotListTestJSON-723237481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8c7a7bc3-e4c0-45ef-9778-3a355bcf057b.f7b450b1-8a58-4ff3-a7ce-6dbba83cb309 -F qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8c7a7bc3-e4c0-45ef-9778-3a355bcf057b.cb113554-f426-40d7-9256-41c93f73b255 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:00:19 devstack sudo[103527]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8c7a7bc3-e4c0-45ef-9778-3a355bcf057b.f7b450b1-8a58-4ff3-a7ce-6dbba83cb309 -F qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8c7a7bc3-e4c0-45ef-9778-3a355bcf057b.cb113554-f426-40d7-9256-41c93f73b255
Jul 02 20:00:19 devstack sudo[103527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:00:19 devstack sudo[103518]: pam_unix(sudo:session): session closed for user root
Jul 02 20:00:19 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-ea9e3765-8d1d-4010-968e-79f6596b0ae8 tempest-TestShelveInstance-1204606342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a2dc855a-b708-430d-973d-a136c6e54873_k56duckpdevstack@QuobyteHD" returned: 0 in 0.986s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:00:19 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-ea9e3765-8d1d-4010-968e-79f6596b0ae8 tempest-TestShelveInstance-1204606342 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 20:00:20 devstack sudo[103527]: pam_unix(sudo:session): session closed for user root
Jul 02 20:00:20 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-a98ae138-0ca0-456f-9a1d-6240cdf53fcf tempest-VolumesSnapshotListTestJSON-723237481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8c7a7bc3-e4c0-45ef-9778-3a355bcf057b.f7b450b1-8a58-4ff3-a7ce-6dbba83cb309 -F qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8c7a7bc3-e4c0-45ef-9778-3a355bcf057b.cb113554-f426-40d7-9256-41c93f73b255" returned: 0 in 0.766s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:00:20 devstack cinder-volume[86639]: WARNING cinder.volume.drivers.remotefs [None req-a98ae138-0ca0-456f-9a1d-6240cdf53fcf tempest-VolumesSnapshotListTestJSON-723237481 None] /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8c7a7bc3-e4c0-45ef-9778-3a355bcf057b.cb113554-f426-40d7-9256-41c93f73b255 is being set with open permissions: ugo+rw
Jul 02 20:00:20 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-a98ae138-0ca0-456f-9a1d-6240cdf53fcf tempest-VolumesSnapshotListTestJSON-723237481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8c7a7bc3-e4c0-45ef-9778-3a355bcf057b.cb113554-f426-40d7-9256-41c93f73b255 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:00:20 devstack sudo[103532]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8c7a7bc3-e4c0-45ef-9778-3a355bcf057b.cb113554-f426-40d7-9256-41c93f73b255
Jul 02 20:00:20 devstack sudo[103532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:00:21 devstack sudo[103532]: pam_unix(sudo:session): session closed for user root
Jul 02 20:00:21 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-a98ae138-0ca0-456f-9a1d-6240cdf53fcf tempest-VolumesSnapshotListTestJSON-723237481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8c7a7bc3-e4c0-45ef-9778-3a355bcf057b.cb113554-f426-40d7-9256-41c93f73b255" returned: 0 in 0.771s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:00:21 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-a98ae138-0ca0-456f-9a1d-6240cdf53fcf tempest-VolumesSnapshotListTestJSON-723237481 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.947s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 20:00:21 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-ea9e3765-8d1d-4010-968e-79f6596b0ae8 tempest-TestShelveInstance-1204606342 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.577s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 20:00:21 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-ea9e3765-8d1d-4010-968e-79f6596b0ae8 tempest-TestShelveInstance-1204606342 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce906cb830>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T18:00:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1170897012',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a992da0d-c1f8-4a49-8b48-729e67de065d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed6a81659f734da3aef967ad63db3b11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T18:00:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T18:00:17Z,use_quota=True,user_id='fc9a0c4f63de41f7b4bc448e1405373d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)}" {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 20:00:21 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-ea9e3765-8d1d-4010-968e-79f6596b0ae8 tempest-TestShelveInstance-1204606342 None] Creating volume a992da0d-c1f8-4a49-8b48-729e67de065d {{(pid=86639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 20:00:21 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-ea9e3765-8d1d-4010-968e-79f6596b0ae8 tempest-TestShelveInstance-1204606342 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 20:00:21 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-ea9e3765-8d1d-4010-968e-79f6596b0ae8 tempest-TestShelveInstance-1204606342 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 20:00:21 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-ea9e3765-8d1d-4010-968e-79f6596b0ae8 tempest-TestShelveInstance-1204606342 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 20:00:21 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-ea9e3765-8d1d-4010-968e-79f6596b0ae8 tempest-TestShelveInstance-1204606342 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 20:00:21 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-ea9e3765-8d1d-4010-968e-79f6596b0ae8 tempest-TestShelveInstance-1204606342 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 20:00:21 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-ea9e3765-8d1d-4010-968e-79f6596b0ae8 tempest-TestShelveInstance-1204606342 None] Selected osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92 as target Quobyte volume. {{(pid=86639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 20:00:21 devstack cinder-volume[86639]: INFO cinder.volume.drivers.remotefs [None req-ea9e3765-8d1d-4010-968e-79f6596b0ae8 tempest-TestShelveInstance-1204606342 None] casted to osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92
Jul 02 20:00:21 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-ea9e3765-8d1d-4010-968e-79f6596b0ae8 tempest-TestShelveInstance-1204606342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-a992da0d-c1f8-4a49-8b48-729e67de065d 1073741824 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:00:21 devstack sudo[103536]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-a992da0d-c1f8-4a49-8b48-729e67de065d 1073741824
Jul 02 20:00:21 devstack sudo[103536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:00:21 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-a98ae138-0ca0-456f-9a1d-6240cdf53fcf tempest-VolumesSnapshotListTestJSON-723237481 None] Create snapshot completed successfully
Jul 02 20:00:21 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-7a099c34-5748-4338-bb44-f56f4ccb67df tempest-VolumesSnapshotListTestJSON-723237481 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 20:00:22 devstack sudo[103536]: pam_unix(sudo:session): session closed for user root
Jul 02 20:00:22 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-ea9e3765-8d1d-4010-968e-79f6596b0ae8 tempest-TestShelveInstance-1204606342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-a992da0d-c1f8-4a49-8b48-729e67de065d 1073741824" returned: 0 in 0.996s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:00:22 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-ea9e3765-8d1d-4010-968e-79f6596b0ae8 tempest-TestShelveInstance-1204606342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-a992da0d-c1f8-4a49-8b48-729e67de065d {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:00:22 devstack sudo[103542]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-a992da0d-c1f8-4a49-8b48-729e67de065d
Jul 02 20:00:22 devstack sudo[103542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:00:23 devstack sudo[103542]: pam_unix(sudo:session): session closed for user root
Jul 02 20:00:23 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-ea9e3765-8d1d-4010-968e-79f6596b0ae8 tempest-TestShelveInstance-1204606342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-a992da0d-c1f8-4a49-8b48-729e67de065d" returned: 0 in 0.826s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:00:23 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-ea9e3765-8d1d-4010-968e-79f6596b0ae8 tempest-TestShelveInstance-1204606342 None] <== create_volume: return (1900ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'} {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 20:00:23 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-ea9e3765-8d1d-4010-968e-79f6596b0ae8 tempest-TestShelveInstance-1204606342 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.906s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 20:00:23 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-7a099c34-5748-4338-bb44-f56f4ccb67df tempest-VolumesSnapshotListTestJSON-723237481 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.486s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 20:00:23 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-7a099c34-5748-4338-bb44-f56f4ccb67df tempest-VolumesSnapshotListTestJSON-723237481 None] Creating offline snapshot 712468bd-a16a-41a9-ba61-660277517f95 of volume 8c7a7bc3-e4c0-45ef-9778-3a355bcf057b {{(pid=86639) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 02 20:00:23 devstack cinder-volume[86639]: DEBUG cinder.volume.volume_utils [None req-ea9e3765-8d1d-4010-968e-79f6596b0ae8 tempest-TestShelveInstance-1204606342 None] Attempting download of a2dc855a-b708-430d-973d-a136c6e54873 ((None, [{'url': 'file:///opt/stack/data/glance/images/a2dc855a-b708-430d-973d-a136c6e54873', 'metadata': {}}])) to volume a992da0d-c1f8-4a49-8b48-729e67de065d. {{(pid=86639) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jul 02 20:00:23 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6c59024-1577-4083-a1d9-9dc4f6cce719]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 20:00:23 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-7a099c34-5748-4338-bb44-f56f4ccb67df tempest-VolumesSnapshotListTestJSON-723237481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8c7a7bc3-e4c0-45ef-9778-3a355bcf057b.cb113554-f426-40d7-9256-41c93f73b255 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:00:23 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[581f72a2-6cbb-4b72-957f-b1b05dc597eb]: (4, 'raw') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 20:00:23 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-ea9e3765-8d1d-4010-968e-79f6596b0ae8 tempest-TestShelveInstance-1204606342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a2dc855a-b708-430d-973d-a136c6e54873_0nvwtufj {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:00:23 devstack sudo[103545]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8c7a7bc3-e4c0-45ef-9778-3a355bcf057b.cb113554-f426-40d7-9256-41c93f73b255
Jul 02 20:00:23 devstack sudo[103545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:00:23 devstack sudo[103546]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a2dc855a-b708-430d-973d-a136c6e54873_0nvwtufj
Jul 02 20:00:23 devstack sudo[103546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:00:24 devstack sudo[103545]: pam_unix(sudo:session): session closed for user root
Jul 02 20:00:24 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-7a099c34-5748-4338-bb44-f56f4ccb67df tempest-VolumesSnapshotListTestJSON-723237481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8c7a7bc3-e4c0-45ef-9778-3a355bcf057b.cb113554-f426-40d7-9256-41c93f73b255" returned: 0 in 0.990s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:00:24 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-7a099c34-5748-4338-bb44-f56f4ccb67df tempest-VolumesSnapshotListTestJSON-723237481 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8c7a7bc3-e4c0-45ef-9778-3a355bcf057b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86639) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 02 20:00:24 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-7a099c34-5748-4338-bb44-f56f4ccb67df tempest-VolumesSnapshotListTestJSON-723237481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8c7a7bc3-e4c0-45ef-9778-3a355bcf057b.cb113554-f426-40d7-9256-41c93f73b255,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8c7a7bc3-e4c0-45ef-9778-3a355bcf057b.712468bd-a16a-41a9-ba61-660277517f95 1G {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:00:24 devstack sudo[103546]: pam_unix(sudo:session): session closed for user root
Jul 02 20:00:24 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-ea9e3765-8d1d-4010-968e-79f6596b0ae8 tempest-TestShelveInstance-1204606342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a2dc855a-b708-430d-973d-a136c6e54873_0nvwtufj" returned: 0 in 0.944s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:00:24 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-ea9e3765-8d1d-4010-968e-79f6596b0ae8 tempest-TestShelveInstance-1204606342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a2dc855a-b708-430d-973d-a136c6e54873_0nvwtufj {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:00:24 devstack sudo[103556]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8c7a7bc3-e4c0-45ef-9778-3a355bcf057b.cb113554-f426-40d7-9256-41c93f73b255,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8c7a7bc3-e4c0-45ef-9778-3a355bcf057b.712468bd-a16a-41a9-ba61-660277517f95 1G
Jul 02 20:00:24 devstack sudo[103556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:00:24 devstack sudo[103557]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a2dc855a-b708-430d-973d-a136c6e54873_0nvwtufj
Jul 02 20:00:24 devstack sudo[103557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:00:25 devstack sudo[103557]: pam_unix(sudo:session): session closed for user root
Jul 02 20:00:25 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-ea9e3765-8d1d-4010-968e-79f6596b0ae8 tempest-TestShelveInstance-1204606342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a2dc855a-b708-430d-973d-a136c6e54873_0nvwtufj" returned: 1 in 0.895s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:00:25 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-ea9e3765-8d1d-4010-968e-79f6596b0ae8 tempest-TestShelveInstance-1204606342 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a2dc855a-b708-430d-973d-a136c6e54873_0nvwtufj' failed. Not Retrying. {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 02 20:00:25 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[7af71d16-5dfc-4c94-a13f-c4730f6fe8cd]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 20:00:25 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-ea9e3765-8d1d-4010-968e-79f6596b0ae8 tempest-TestShelveInstance-1204606342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a2dc855a-b708-430d-973d-a136c6e54873_k56duckpdevstack@QuobyteHD {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:00:25 devstack sudo[103556]: pam_unix(sudo:session): session closed for user root
Jul 02 20:00:25 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-7a099c34-5748-4338-bb44-f56f4ccb67df tempest-VolumesSnapshotListTestJSON-723237481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8c7a7bc3-e4c0-45ef-9778-3a355bcf057b.cb113554-f426-40d7-9256-41c93f73b255,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8c7a7bc3-e4c0-45ef-9778-3a355bcf057b.712468bd-a16a-41a9-ba61-660277517f95 1G" returned: 0 in 1.020s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:00:25 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-7a099c34-5748-4338-bb44-f56f4ccb67df tempest-VolumesSnapshotListTestJSON-723237481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8c7a7bc3-e4c0-45ef-9778-3a355bcf057b.cb113554-f426-40d7-9256-41c93f73b255 -F qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8c7a7bc3-e4c0-45ef-9778-3a355bcf057b.712468bd-a16a-41a9-ba61-660277517f95 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:00:25 devstack sudo[103567]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8c7a7bc3-e4c0-45ef-9778-3a355bcf057b.cb113554-f426-40d7-9256-41c93f73b255 -F qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8c7a7bc3-e4c0-45ef-9778-3a355bcf057b.712468bd-a16a-41a9-ba61-660277517f95
Jul 02 20:00:25 devstack sudo[103567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:00:25 devstack sudo[103566]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a2dc855a-b708-430d-973d-a136c6e54873_k56duckpdevstack@QuobyteHD
Jul 02 20:00:25 devstack sudo[103566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:00:26 devstack sudo[103567]: pam_unix(sudo:session): session closed for user root
Jul 02 20:00:26 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-7a099c34-5748-4338-bb44-f56f4ccb67df tempest-VolumesSnapshotListTestJSON-723237481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8c7a7bc3-e4c0-45ef-9778-3a355bcf057b.cb113554-f426-40d7-9256-41c93f73b255 -F qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8c7a7bc3-e4c0-45ef-9778-3a355bcf057b.712468bd-a16a-41a9-ba61-660277517f95" returned: 0 in 0.764s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:00:26 devstack cinder-volume[86639]: WARNING cinder.volume.drivers.remotefs [None req-7a099c34-5748-4338-bb44-f56f4ccb67df tempest-VolumesSnapshotListTestJSON-723237481 None] /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8c7a7bc3-e4c0-45ef-9778-3a355bcf057b.712468bd-a16a-41a9-ba61-660277517f95 is being set with open permissions: ugo+rw
Jul 02 20:00:26 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-7a099c34-5748-4338-bb44-f56f4ccb67df tempest-VolumesSnapshotListTestJSON-723237481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8c7a7bc3-e4c0-45ef-9778-3a355bcf057b.712468bd-a16a-41a9-ba61-660277517f95 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:00:26 devstack sudo[103566]: pam_unix(sudo:session): session closed for user root
Jul 02 20:00:26 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-ea9e3765-8d1d-4010-968e-79f6596b0ae8 tempest-TestShelveInstance-1204606342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a2dc855a-b708-430d-973d-a136c6e54873_k56duckpdevstack@QuobyteHD" returned: 0 in 0.884s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:00:26 devstack cinder-volume[86639]: DEBUG cinder.image.image_utils [None req-ea9e3765-8d1d-4010-968e-79f6596b0ae8 tempest-TestShelveInstance-1204606342 None] a2dc855a-b708-430d-973d-a136c6e54873 was qcow2, converting to raw {{(pid=86639) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jul 02 20:00:26 devstack sudo[103579]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8c7a7bc3-e4c0-45ef-9778-3a355bcf057b.712468bd-a16a-41a9-ba61-660277517f95
Jul 02 20:00:26 devstack sudo[103579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:00:26 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-ea9e3765-8d1d-4010-968e-79f6596b0ae8 tempest-TestShelveInstance-1204606342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a2dc855a-b708-430d-973d-a136c6e54873_k56duckpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-a992da0d-c1f8-4a49-8b48-729e67de065d {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:00:26 devstack sudo[103581]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a2dc855a-b708-430d-973d-a136c6e54873_k56duckpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-a992da0d-c1f8-4a49-8b48-729e67de065d
Jul 02 20:00:26 devstack sudo[103581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:00:26 devstack sudo[103579]: pam_unix(sudo:session): session closed for user root
Jul 02 20:00:26 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-7a099c34-5748-4338-bb44-f56f4ccb67df tempest-VolumesSnapshotListTestJSON-723237481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8c7a7bc3-e4c0-45ef-9778-3a355bcf057b.712468bd-a16a-41a9-ba61-660277517f95" returned: 0 in 0.717s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:00:27 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-7a099c34-5748-4338-bb44-f56f4ccb67df tempest-VolumesSnapshotListTestJSON-723237481 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.608s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 20:00:27 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-7a099c34-5748-4338-bb44-f56f4ccb67df tempest-VolumesSnapshotListTestJSON-723237481 None] Create snapshot completed successfully
Jul 02 20:00:28 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-1d48d14e-b9a6-44b0-9d50-110774fc5f48 tempest-VolumesSnapshotListTestJSON-723237481 None] Acquiring lock "cinder-712468bd-a16a-41a9-ba61-660277517f95-delete_snapshot" by "delete_snapshot" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 20:00:28 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-1d48d14e-b9a6-44b0-9d50-110774fc5f48 tempest-VolumesSnapshotListTestJSON-723237481 None] Lock "cinder-712468bd-a16a-41a9-ba61-660277517f95-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 20:00:28 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-1d48d14e-b9a6-44b0-9d50-110774fc5f48 tempest-VolumesSnapshotListTestJSON-723237481 None] Acquiring lock "cinder-quobyte-8c7a7bc3-e4c0-45ef-9778-3a355bcf057b" by "delete_snapshot" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 20:00:28 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-1d48d14e-b9a6-44b0-9d50-110774fc5f48 tempest-VolumesSnapshotListTestJSON-723237481 None] Lock "cinder-quobyte-8c7a7bc3-e4c0-45ef-9778-3a355bcf057b" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 20:00:28 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-1d48d14e-b9a6-44b0-9d50-110774fc5f48 tempest-VolumesSnapshotListTestJSON-723237481 None] Acquiring lock "cinder-quobyte-712468bd-a16a-41a9-ba61-660277517f95" by "_delete_snapshot" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 20:00:28 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-1d48d14e-b9a6-44b0-9d50-110774fc5f48 tempest-VolumesSnapshotListTestJSON-723237481 None] Lock "cinder-quobyte-712468bd-a16a-41a9-ba61-660277517f95" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 20:00:28 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-1d48d14e-b9a6-44b0-9d50-110774fc5f48 tempest-VolumesSnapshotListTestJSON-723237481 None] Deleting offline snapshot 712468bd-a16a-41a9-ba61-660277517f95 of volume 8c7a7bc3-e4c0-45ef-9778-3a355bcf057b {{(pid=86639) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 02 20:00:28 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-1d48d14e-b9a6-44b0-9d50-110774fc5f48 tempest-VolumesSnapshotListTestJSON-723237481 None] snapshot_file for this snap is: volume-8c7a7bc3-e4c0-45ef-9778-3a355bcf057b.712468bd-a16a-41a9-ba61-660277517f95 {{(pid=86639) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 02 20:00:28 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[2060490b-8933-4cf0-ac58-c798b93b1e42]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 20:00:28 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-1d48d14e-b9a6-44b0-9d50-110774fc5f48 tempest-VolumesSnapshotListTestJSON-723237481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8c7a7bc3-e4c0-45ef-9778-3a355bcf057b.712468bd-a16a-41a9-ba61-660277517f95 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:00:28 devstack sudo[103590]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8c7a7bc3-e4c0-45ef-9778-3a355bcf057b.712468bd-a16a-41a9-ba61-660277517f95
Jul 02 20:00:28 devstack sudo[103590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:00:28 devstack sudo[103581]: pam_unix(sudo:session): session closed for user root
Jul 02 20:00:28 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-ea9e3765-8d1d-4010-968e-79f6596b0ae8 tempest-TestShelveInstance-1204606342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a2dc855a-b708-430d-973d-a136c6e54873_k56duckpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-a992da0d-c1f8-4a49-8b48-729e67de065d" returned: 0 in 2.553s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:00:28 devstack cinder-volume[86639]: DEBUG cinder.image.image_utils [None req-ea9e3765-8d1d-4010-968e-79f6596b0ae8 tempest-TestShelveInstance-1204606342 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_a2dc855a-b708-430d-973d-a136c6e54873_k56duckpdevstack@QuobyteHD, size 112.00 MB, duration 2.56 sec, destination /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-a992da0d-c1f8-4a49-8b48-729e67de065d {{(pid=86639) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 02 20:00:28 devstack cinder-volume[86639]: INFO cinder.image.image_utils [None req-ea9e3765-8d1d-4010-968e-79f6596b0ae8 tempest-TestShelveInstance-1204606342 None] Converted 112.00 MB image at 43.82 MB/s
Jul 02 20:00:28 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-ea9e3765-8d1d-4010-968e-79f6596b0ae8 tempest-TestShelveInstance-1204606342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-a992da0d-c1f8-4a49-8b48-729e67de065d 1G {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:00:28 devstack sudo[103592]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-a992da0d-c1f8-4a49-8b48-729e67de065d 1G
Jul 02 20:00:28 devstack sudo[103592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:00:29 devstack sudo[103590]: pam_unix(sudo:session): session closed for user root
Jul 02 20:00:29 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-1d48d14e-b9a6-44b0-9d50-110774fc5f48 tempest-VolumesSnapshotListTestJSON-723237481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8c7a7bc3-e4c0-45ef-9778-3a355bcf057b.712468bd-a16a-41a9-ba61-660277517f95" returned: 0 in 0.911s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:00:29 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-1d48d14e-b9a6-44b0-9d50-110774fc5f48 tempest-VolumesSnapshotListTestJSON-723237481 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8c7a7bc3-e4c0-45ef-9778-3a355bcf057b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86639) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 02 20:00:29 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0b79f87-f921-4966-9608-b17f1dc517a9]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 20:00:29 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-1d48d14e-b9a6-44b0-9d50-110774fc5f48 tempest-VolumesSnapshotListTestJSON-723237481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8c7a7bc3-e4c0-45ef-9778-3a355bcf057b.cb113554-f426-40d7-9256-41c93f73b255 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:00:29 devstack sudo[103598]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8c7a7bc3-e4c0-45ef-9778-3a355bcf057b.cb113554-f426-40d7-9256-41c93f73b255
Jul 02 20:00:29 devstack sudo[103598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:00:29 devstack sudo[103592]: pam_unix(sudo:session): session closed for user root
Jul 02 20:00:29 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-ea9e3765-8d1d-4010-968e-79f6596b0ae8 tempest-TestShelveInstance-1204606342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-a992da0d-c1f8-4a49-8b48-729e67de065d 1G" returned: 0 in 0.784s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:00:29 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[91c4290c-3a90-4b25-ab91-27c039e1e4ac]: (4, 'raw') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 20:00:29 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-ea9e3765-8d1d-4010-968e-79f6596b0ae8 tempest-TestShelveInstance-1204606342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-a992da0d-c1f8-4a49-8b48-729e67de065d {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:00:29 devstack sudo[103603]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-a992da0d-c1f8-4a49-8b48-729e67de065d
Jul 02 20:00:29 devstack sudo[103603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:00:30 devstack sudo[103598]: pam_unix(sudo:session): session closed for user root
Jul 02 20:00:30 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-1d48d14e-b9a6-44b0-9d50-110774fc5f48 tempest-VolumesSnapshotListTestJSON-723237481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8c7a7bc3-e4c0-45ef-9778-3a355bcf057b.cb113554-f426-40d7-9256-41c93f73b255" returned: 0 in 0.975s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:00:30 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-1d48d14e-b9a6-44b0-9d50-110774fc5f48 tempest-VolumesSnapshotListTestJSON-723237481 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8c7a7bc3-e4c0-45ef-9778-3a355bcf057b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86639) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 02 20:00:30 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-1d48d14e-b9a6-44b0-9d50-110774fc5f48 tempest-VolumesSnapshotListTestJSON-723237481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8c7a7bc3-e4c0-45ef-9778-3a355bcf057b.712468bd-a16a-41a9-ba61-660277517f95 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:00:30 devstack sudo[103608]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8c7a7bc3-e4c0-45ef-9778-3a355bcf057b.712468bd-a16a-41a9-ba61-660277517f95
Jul 02 20:00:30 devstack sudo[103608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:00:30 devstack sudo[103603]: pam_unix(sudo:session): session closed for user root
Jul 02 20:00:30 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-ea9e3765-8d1d-4010-968e-79f6596b0ae8 tempest-TestShelveInstance-1204606342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-a992da0d-c1f8-4a49-8b48-729e67de065d" returned: 0 in 0.881s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:00:30 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-ea9e3765-8d1d-4010-968e-79f6596b0ae8 tempest-TestShelveInstance-1204606342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-a992da0d-c1f8-4a49-8b48-729e67de065d {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:00:30 devstack sudo[103612]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-a992da0d-c1f8-4a49-8b48-729e67de065d
Jul 02 20:00:30 devstack sudo[103612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:00:31 devstack sudo[103608]: pam_unix(sudo:session): session closed for user root
Jul 02 20:00:31 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-1d48d14e-b9a6-44b0-9d50-110774fc5f48 tempest-VolumesSnapshotListTestJSON-723237481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8c7a7bc3-e4c0-45ef-9778-3a355bcf057b.712468bd-a16a-41a9-ba61-660277517f95" returned: 0 in 1.068s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:00:31 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-1d48d14e-b9a6-44b0-9d50-110774fc5f48 tempest-VolumesSnapshotListTestJSON-723237481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8c7a7bc3-e4c0-45ef-9778-3a355bcf057b.712468bd-a16a-41a9-ba61-660277517f95 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:00:31 devstack sudo[103620]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8c7a7bc3-e4c0-45ef-9778-3a355bcf057b.712468bd-a16a-41a9-ba61-660277517f95
Jul 02 20:00:31 devstack sudo[103620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:00:31 devstack sudo[103612]: pam_unix(sudo:session): session closed for user root
Jul 02 20:00:31 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-ea9e3765-8d1d-4010-968e-79f6596b0ae8 tempest-TestShelveInstance-1204606342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-a992da0d-c1f8-4a49-8b48-729e67de065d" returned: 1 in 0.911s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:00:31 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-ea9e3765-8d1d-4010-968e-79f6596b0ae8 tempest-TestShelveInstance-1204606342 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-a992da0d-c1f8-4a49-8b48-729e67de065d' failed. Not Retrying. {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 02 20:00:31 devstack cinder-volume[86639]: DEBUG cinder.volume.volume_utils [None req-ea9e3765-8d1d-4010-968e-79f6596b0ae8 tempest-TestShelveInstance-1204606342 None] Downloaded image a2dc855a-b708-430d-973d-a136c6e54873 ((None, [{'url': 'file:///opt/stack/data/glance/images/a2dc855a-b708-430d-973d-a136c6e54873', 'metadata': {}}])) to volume a992da0d-c1f8-4a49-8b48-729e67de065d successfully. {{(pid=86639) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jul 02 20:00:31 devstack cinder-volume[86639]: DEBUG cinder.image.image_utils [None req-ea9e3765-8d1d-4010-968e-79f6596b0ae8 tempest-TestShelveInstance-1204606342 None] Temporary image a2dc855a-b708-430d-973d-a136c6e54873 for user fc9a0c4f63de41f7b4bc448e1405373d is deleted. {{(pid=86639) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jul 02 20:00:31 devstack cinder-volume[86639]: DEBUG cinder.volume.volume_utils [None req-ea9e3765-8d1d-4010-968e-79f6596b0ae8 tempest-TestShelveInstance-1204606342 None] Marking volume a992da0d-c1f8-4a49-8b48-729e67de065d as bootable. {{(pid=86639) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jul 02 20:00:31 devstack cinder-volume[86639]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea9e3765-8d1d-4010-968e-79f6596b0ae8 tempest-TestShelveInstance-1204606342 None] Copying metadata from image a2dc855a-b708-430d-973d-a136c6e54873 to a992da0d-c1f8-4a49-8b48-729e67de065d. {{(pid=86639) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jul 02 20:00:31 devstack cinder-volume[86639]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea9e3765-8d1d-4010-968e-79f6596b0ae8 tempest-TestShelveInstance-1204606342 None] Creating volume glance metadata for volume a992da0d-c1f8-4a49-8b48-729e67de065d backed by image a2dc855a-b708-430d-973d-a136c6e54873 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'a2dc855a-b708-430d-973d-a136c6e54873', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86639) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jul 02 20:00:31 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-ea9e3765-8d1d-4010-968e-79f6596b0ae8 tempest-TestShelveInstance-1204606342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3b197d1-bd9e-4923-bb00-680786af34d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a992da0d-c1f8-4a49-8b48-729e67de065d', 'volume_size': 1, 'image_id': 'a2dc855a-b708-430d-973d-a136c6e54873', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a2dc855a-b708-430d-973d-a136c6e54873', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b6fd8f5b5bb142078118935d5734f463', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a2dc855a-b708-430d-973d-a136c6e54873', 'created_at': datetime.datetime(2026, 7, 2, 17, 34, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 2, 17, 34, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a2dc855a-b708-430d-973d-a136c6e54873/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fce8efd1340>}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:00:31 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-ea9e3765-8d1d-4010-968e-79f6596b0ae8 tempest-TestShelveInstance-1204606342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (727d0842-c90a-45c0-b52d-2f6895fe8a52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:00:31 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-ea9e3765-8d1d-4010-968e-79f6596b0ae8 tempest-TestShelveInstance-1204606342 None] Volume volume-a992da0d-c1f8-4a49-8b48-729e67de065d (a992da0d-c1f8-4a49-8b48-729e67de065d): created successfully
Jul 02 20:00:31 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-ea9e3765-8d1d-4010-968e-79f6596b0ae8 tempest-TestShelveInstance-1204606342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (727d0842-c90a-45c0-b52d-2f6895fe8a52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:00:31 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-ea9e3765-8d1d-4010-968e-79f6596b0ae8 tempest-TestShelveInstance-1204606342 None] Flow 'volume_create_manager' (4b826cc5-d5b0-414c-9d17-3e0a7a3c05d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 20:00:31 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-ea9e3765-8d1d-4010-968e-79f6596b0ae8 tempest-TestShelveInstance-1204606342 None] Created volume successfully.
Jul 02 20:00:32 devstack sudo[103620]: pam_unix(sudo:session): session closed for user root
Jul 02 20:00:32 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-1d48d14e-b9a6-44b0-9d50-110774fc5f48 tempest-VolumesSnapshotListTestJSON-723237481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8c7a7bc3-e4c0-45ef-9778-3a355bcf057b.712468bd-a16a-41a9-ba61-660277517f95" returned: 0 in 0.869s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:00:32 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-1d48d14e-b9a6-44b0-9d50-110774fc5f48 tempest-VolumesSnapshotListTestJSON-723237481 None] Lock "cinder-quobyte-712468bd-a16a-41a9-ba61-660277517f95" released by "_delete_snapshot" :: held 3.961s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 20:00:32 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-1d48d14e-b9a6-44b0-9d50-110774fc5f48 tempest-VolumesSnapshotListTestJSON-723237481 None] Lock "cinder-quobyte-8c7a7bc3-e4c0-45ef-9778-3a355bcf057b" released by "delete_snapshot" :: held 3.994s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 20:00:32 devstack cinder-volume[86639]: DEBUG dbcounter [-] [86639] Writing DB stats cinder:UPDATE=39,cinder:SELECT=50,cinder:INSERT=14,cinder:DELETE=4 {{(pid=86639) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 02 20:00:32 devstack cinder-volume[86639]: DEBUG dbcounter [-] [86639] Writing DB stats cinder:SELECT=50,cinder:INSERT=18,cinder:UPDATE=48,cinder:DELETE=4 {{(pid=86639) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 02 20:00:32 devstack cinder-volume[86639]: DEBUG cinder.quota [None req-1d48d14e-b9a6-44b0-9d50-110774fc5f48 tempest-VolumesSnapshotListTestJSON-723237481 None] Created reservations ['106a1aa1-9f99-4622-9c47-49b75ef887c0', 'a8eaeefb-74f6-4559-bbf3-577f3030bad0', 'ef133164-8a5e-406f-b407-c611c2d220c1', '3f6cd8f1-1d69-47cb-a083-b7528d70d4c8'] {{(pid=86639) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 20:00:32 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-1d48d14e-b9a6-44b0-9d50-110774fc5f48 tempest-VolumesSnapshotListTestJSON-723237481 None] Delete snapshot completed successfully.
Jul 02 20:00:32 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-1d48d14e-b9a6-44b0-9d50-110774fc5f48 tempest-VolumesSnapshotListTestJSON-723237481 None] Lock "cinder-712468bd-a16a-41a9-ba61-660277517f95-delete_snapshot" released by "delete_snapshot" :: held 4.214s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 20:00:32 devstack cinder-volume[86639]: DEBUG cinder.volume.flows.manager.create_volume [None req-aed51d46-7cdf-485e-a744-df2e7c92c978 tempest-CreateVolumesFromSnapshotTest-737681603 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 20:00:32 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-aed51d46-7cdf-485e-a744-df2e7c92c978 tempest-CreateVolumesFromSnapshotTest-737681603 None] Flow 'volume_create_manager' (62394c63-8630-4bdf-a73c-f125ebf217de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 20:00:32 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-aed51d46-7cdf-485e-a744-df2e7c92c978 tempest-CreateVolumesFromSnapshotTest-737681603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abe5c043-3c6f-4f55-86d3-69b35c83e620) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:00:33 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-aed51d46-7cdf-485e-a744-df2e7c92c978 tempest-CreateVolumesFromSnapshotTest-737681603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abe5c043-3c6f-4f55-86d3-69b35c83e620) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T18:00:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-858402077',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf3a8616-b2fc-4a08-9427-5a2f10e84383,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4cace2b4ecc44e91aa4d67b58026e3a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T18:00:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T18:00:33Z,use_quota=True,user_id='0643d9c6d40a4f9e98ee2b395c98f864',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:00:33 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-aed51d46-7cdf-485e-a744-df2e7c92c978 tempest-CreateVolumesFromSnapshotTest-737681603 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08bb77c2-37f4-436f-a159-edea1094b01d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:00:33 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-aed51d46-7cdf-485e-a744-df2e7c92c978 tempest-CreateVolumesFromSnapshotTest-737681603 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08bb77c2-37f4-436f-a159-edea1094b01d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:00:33 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-aed51d46-7cdf-485e-a744-df2e7c92c978 tempest-CreateVolumesFromSnapshotTest-737681603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2781bca9-99b3-4e6c-98a8-0d728ebce2f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:00:33 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-aed51d46-7cdf-485e-a744-df2e7c92c978 tempest-CreateVolumesFromSnapshotTest-737681603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2781bca9-99b3-4e6c-98a8-0d728ebce2f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cf3a8616-b2fc-4a08-9427-5a2f10e84383', 'volume_name': 'volume-cf3a8616-b2fc-4a08-9427-5a2f10e84383', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:00:33 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-aed51d46-7cdf-485e-a744-df2e7c92c978 tempest-CreateVolumesFromSnapshotTest-737681603 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8616bb70-fa1f-4971-bbaf-c2da0d4333cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:00:33 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-aed51d46-7cdf-485e-a744-df2e7c92c978 tempest-CreateVolumesFromSnapshotTest-737681603 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8616bb70-fa1f-4971-bbaf-c2da0d4333cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:00:33 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-aed51d46-7cdf-485e-a744-df2e7c92c978 tempest-CreateVolumesFromSnapshotTest-737681603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (145b58e5-5da9-44d8-83b1-e1e6e7a1520b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:00:33 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-aed51d46-7cdf-485e-a744-df2e7c92c978 tempest-CreateVolumesFromSnapshotTest-737681603 None] Volume cf3a8616-b2fc-4a08-9427-5a2f10e84383: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cf3a8616-b2fc-4a08-9427-5a2f10e84383', 'volume_size': 1}
Jul 02 20:00:33 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-aed51d46-7cdf-485e-a744-df2e7c92c978 tempest-CreateVolumesFromSnapshotTest-737681603 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 20:00:33 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-aed51d46-7cdf-485e-a744-df2e7c92c978 tempest-CreateVolumesFromSnapshotTest-737681603 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 20:00:33 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-aed51d46-7cdf-485e-a744-df2e7c92c978 tempest-CreateVolumesFromSnapshotTest-737681603 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce906cb830>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T18:00:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-858402077',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf3a8616-b2fc-4a08-9427-5a2f10e84383,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4cace2b4ecc44e91aa4d67b58026e3a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T18:00:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T18:00:33Z,use_quota=True,user_id='0643d9c6d40a4f9e98ee2b395c98f864',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)}" {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 20:00:33 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-aed51d46-7cdf-485e-a744-df2e7c92c978 tempest-CreateVolumesFromSnapshotTest-737681603 None] Creating volume cf3a8616-b2fc-4a08-9427-5a2f10e84383 {{(pid=86639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 20:00:33 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-aed51d46-7cdf-485e-a744-df2e7c92c978 tempest-CreateVolumesFromSnapshotTest-737681603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 20:00:33 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-aed51d46-7cdf-485e-a744-df2e7c92c978 tempest-CreateVolumesFromSnapshotTest-737681603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 20:00:33 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-aed51d46-7cdf-485e-a744-df2e7c92c978 tempest-CreateVolumesFromSnapshotTest-737681603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 20:00:33 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-aed51d46-7cdf-485e-a744-df2e7c92c978 tempest-CreateVolumesFromSnapshotTest-737681603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 20:00:33 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-aed51d46-7cdf-485e-a744-df2e7c92c978 tempest-CreateVolumesFromSnapshotTest-737681603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 20:00:33 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-aed51d46-7cdf-485e-a744-df2e7c92c978 tempest-CreateVolumesFromSnapshotTest-737681603 None] Selected osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92 as target Quobyte volume. {{(pid=86639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 20:00:33 devstack cinder-volume[86639]: INFO cinder.volume.drivers.remotefs [None req-aed51d46-7cdf-485e-a744-df2e7c92c978 tempest-CreateVolumesFromSnapshotTest-737681603 None] casted to osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92
Jul 02 20:00:33 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-aed51d46-7cdf-485e-a744-df2e7c92c978 tempest-CreateVolumesFromSnapshotTest-737681603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-cf3a8616-b2fc-4a08-9427-5a2f10e84383 1073741824 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:00:33 devstack sudo[103661]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-cf3a8616-b2fc-4a08-9427-5a2f10e84383 1073741824
Jul 02 20:00:33 devstack sudo[103661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:00:33 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-26762658-0b4e-4954-ae39-e25e22bb39e2 tempest-VolumesSnapshotListTestJSON-723237481 None] Acquiring lock "cinder-cb113554-f426-40d7-9256-41c93f73b255-delete_snapshot" by "delete_snapshot" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 20:00:33 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-26762658-0b4e-4954-ae39-e25e22bb39e2 tempest-VolumesSnapshotListTestJSON-723237481 None] Lock "cinder-cb113554-f426-40d7-9256-41c93f73b255-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 20:00:33 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-26762658-0b4e-4954-ae39-e25e22bb39e2 tempest-VolumesSnapshotListTestJSON-723237481 None] Acquiring lock "cinder-quobyte-8c7a7bc3-e4c0-45ef-9778-3a355bcf057b" by "delete_snapshot" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 20:00:33 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-26762658-0b4e-4954-ae39-e25e22bb39e2 tempest-VolumesSnapshotListTestJSON-723237481 None] Lock "cinder-quobyte-8c7a7bc3-e4c0-45ef-9778-3a355bcf057b" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 20:00:33 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-26762658-0b4e-4954-ae39-e25e22bb39e2 tempest-VolumesSnapshotListTestJSON-723237481 None] Acquiring lock "cinder-quobyte-cb113554-f426-40d7-9256-41c93f73b255" by "_delete_snapshot" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 20:00:33 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-26762658-0b4e-4954-ae39-e25e22bb39e2 tempest-VolumesSnapshotListTestJSON-723237481 None] Lock "cinder-quobyte-cb113554-f426-40d7-9256-41c93f73b255" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 20:00:33 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-26762658-0b4e-4954-ae39-e25e22bb39e2 tempest-VolumesSnapshotListTestJSON-723237481 None] Deleting offline snapshot cb113554-f426-40d7-9256-41c93f73b255 of volume 8c7a7bc3-e4c0-45ef-9778-3a355bcf057b {{(pid=86639) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 02 20:00:33 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-26762658-0b4e-4954-ae39-e25e22bb39e2 tempest-VolumesSnapshotListTestJSON-723237481 None] snapshot_file for this snap is: volume-8c7a7bc3-e4c0-45ef-9778-3a355bcf057b.cb113554-f426-40d7-9256-41c93f73b255 {{(pid=86639) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 02 20:00:33 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[98fafe33-0409-4352-9354-b1b16918cf64]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 20:00:33 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-26762658-0b4e-4954-ae39-e25e22bb39e2 tempest-VolumesSnapshotListTestJSON-723237481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8c7a7bc3-e4c0-45ef-9778-3a355bcf057b.cb113554-f426-40d7-9256-41c93f73b255 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:00:33 devstack sudo[103668]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8c7a7bc3-e4c0-45ef-9778-3a355bcf057b.cb113554-f426-40d7-9256-41c93f73b255
Jul 02 20:00:33 devstack sudo[103668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:00:34 devstack sudo[103661]: pam_unix(sudo:session): session closed for user root
Jul 02 20:00:34 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-aed51d46-7cdf-485e-a744-df2e7c92c978 tempest-CreateVolumesFromSnapshotTest-737681603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-cf3a8616-b2fc-4a08-9427-5a2f10e84383 1073741824" returned: 0 in 0.979s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:00:34 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-aed51d46-7cdf-485e-a744-df2e7c92c978 tempest-CreateVolumesFromSnapshotTest-737681603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-cf3a8616-b2fc-4a08-9427-5a2f10e84383 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:00:34 devstack sudo[103678]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-cf3a8616-b2fc-4a08-9427-5a2f10e84383
Jul 02 20:00:34 devstack sudo[103678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:00:34 devstack sudo[103668]: pam_unix(sudo:session): session closed for user root
Jul 02 20:00:34 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-26762658-0b4e-4954-ae39-e25e22bb39e2 tempest-VolumesSnapshotListTestJSON-723237481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8c7a7bc3-e4c0-45ef-9778-3a355bcf057b.cb113554-f426-40d7-9256-41c93f73b255" returned: 0 in 0.929s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:00:34 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-26762658-0b4e-4954-ae39-e25e22bb39e2 tempest-VolumesSnapshotListTestJSON-723237481 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8c7a7bc3-e4c0-45ef-9778-3a355bcf057b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86639) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 02 20:00:34 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6fc0edc-ec95-4187-a81b-9c4c5fba0872]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 20:00:34 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-26762658-0b4e-4954-ae39-e25e22bb39e2 tempest-VolumesSnapshotListTestJSON-723237481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8c7a7bc3-e4c0-45ef-9778-3a355bcf057b.f7b450b1-8a58-4ff3-a7ce-6dbba83cb309 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:00:34 devstack sudo[103683]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8c7a7bc3-e4c0-45ef-9778-3a355bcf057b.f7b450b1-8a58-4ff3-a7ce-6dbba83cb309
Jul 02 20:00:34 devstack sudo[103683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:00:34 devstack sudo[103678]: pam_unix(sudo:session): session closed for user root
Jul 02 20:00:34 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-aed51d46-7cdf-485e-a744-df2e7c92c978 tempest-CreateVolumesFromSnapshotTest-737681603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-cf3a8616-b2fc-4a08-9427-5a2f10e84383" returned: 0 in 0.805s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:00:34 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-aed51d46-7cdf-485e-a744-df2e7c92c978 tempest-CreateVolumesFromSnapshotTest-737681603 None] <== create_volume: return (1849ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'} {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 20:00:34 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-aed51d46-7cdf-485e-a744-df2e7c92c978 tempest-CreateVolumesFromSnapshotTest-737681603 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.854s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 20:00:34 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-aed51d46-7cdf-485e-a744-df2e7c92c978 tempest-CreateVolumesFromSnapshotTest-737681603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (145b58e5-5da9-44d8-83b1-e1e6e7a1520b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf3a8616-b2fc-4a08-9427-5a2f10e84383', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:00:34 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-aed51d46-7cdf-485e-a744-df2e7c92c978 tempest-CreateVolumesFromSnapshotTest-737681603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8d434fa-1228-4841-b19a-964de6ebcb2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:00:34 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-aed51d46-7cdf-485e-a744-df2e7c92c978 tempest-CreateVolumesFromSnapshotTest-737681603 None] Volume volume-cf3a8616-b2fc-4a08-9427-5a2f10e84383 (cf3a8616-b2fc-4a08-9427-5a2f10e84383): created successfully
Jul 02 20:00:34 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-aed51d46-7cdf-485e-a744-df2e7c92c978 tempest-CreateVolumesFromSnapshotTest-737681603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8d434fa-1228-4841-b19a-964de6ebcb2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:00:35 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-aed51d46-7cdf-485e-a744-df2e7c92c978 tempest-CreateVolumesFromSnapshotTest-737681603 None] Flow 'volume_create_manager' (62394c63-8630-4bdf-a73c-f125ebf217de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 20:00:35 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-aed51d46-7cdf-485e-a744-df2e7c92c978 tempest-CreateVolumesFromSnapshotTest-737681603 None] Created volume successfully.
Jul 02 20:00:35 devstack sudo[103683]: pam_unix(sudo:session): session closed for user root
Jul 02 20:00:35 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-26762658-0b4e-4954-ae39-e25e22bb39e2 tempest-VolumesSnapshotListTestJSON-723237481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8c7a7bc3-e4c0-45ef-9778-3a355bcf057b.f7b450b1-8a58-4ff3-a7ce-6dbba83cb309" returned: 0 in 0.906s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:00:35 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-26762658-0b4e-4954-ae39-e25e22bb39e2 tempest-VolumesSnapshotListTestJSON-723237481 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8c7a7bc3-e4c0-45ef-9778-3a355bcf057b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86639) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 02 20:00:35 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-26762658-0b4e-4954-ae39-e25e22bb39e2 tempest-VolumesSnapshotListTestJSON-723237481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8c7a7bc3-e4c0-45ef-9778-3a355bcf057b.cb113554-f426-40d7-9256-41c93f73b255 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:00:35 devstack sudo[103689]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8c7a7bc3-e4c0-45ef-9778-3a355bcf057b.cb113554-f426-40d7-9256-41c93f73b255
Jul 02 20:00:35 devstack sudo[103689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:00:36 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-d443db79-7217-40c9-8958-41395c0f3289 tempest-CreateVolumesFromSnapshotTest-737681603 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 20:00:36 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-d443db79-7217-40c9-8958-41395c0f3289 tempest-CreateVolumesFromSnapshotTest-737681603 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 20:00:36 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-d443db79-7217-40c9-8958-41395c0f3289 tempest-CreateVolumesFromSnapshotTest-737681603 None] Creating offline snapshot acc694d1-c6de-4ce3-b648-4dddaa601536 of volume cf3a8616-b2fc-4a08-9427-5a2f10e84383 {{(pid=86639) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 02 20:00:36 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebc60f4c-3955-440d-a2ec-43959d7bde00]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 20:00:36 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-d443db79-7217-40c9-8958-41395c0f3289 tempest-CreateVolumesFromSnapshotTest-737681603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-cf3a8616-b2fc-4a08-9427-5a2f10e84383 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:00:36 devstack sudo[103696]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-cf3a8616-b2fc-4a08-9427-5a2f10e84383
Jul 02 20:00:36 devstack sudo[103696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:00:36 devstack sudo[103689]: pam_unix(sudo:session): session closed for user root
Jul 02 20:00:36 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-26762658-0b4e-4954-ae39-e25e22bb39e2 tempest-VolumesSnapshotListTestJSON-723237481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8c7a7bc3-e4c0-45ef-9778-3a355bcf057b.cb113554-f426-40d7-9256-41c93f73b255" returned: 0 in 0.976s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:00:36 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-26762658-0b4e-4954-ae39-e25e22bb39e2 tempest-VolumesSnapshotListTestJSON-723237481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8c7a7bc3-e4c0-45ef-9778-3a355bcf057b.cb113554-f426-40d7-9256-41c93f73b255 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:00:36 devstack sudo[103698]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8c7a7bc3-e4c0-45ef-9778-3a355bcf057b.cb113554-f426-40d7-9256-41c93f73b255
Jul 02 20:00:36 devstack sudo[103698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:00:37 devstack sudo[103698]: pam_unix(sudo:session): session closed for user root
Jul 02 20:00:37 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-26762658-0b4e-4954-ae39-e25e22bb39e2 tempest-VolumesSnapshotListTestJSON-723237481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8c7a7bc3-e4c0-45ef-9778-3a355bcf057b.cb113554-f426-40d7-9256-41c93f73b255" returned: 0 in 0.743s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:00:37 devstack sudo[103696]: pam_unix(sudo:session): session closed for user root
Jul 02 20:00:37 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-26762658-0b4e-4954-ae39-e25e22bb39e2 tempest-VolumesSnapshotListTestJSON-723237481 None] Lock "cinder-quobyte-cb113554-f426-40d7-9256-41c93f73b255" released by "_delete_snapshot" :: held 3.674s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 20:00:37 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-d443db79-7217-40c9-8958-41395c0f3289 tempest-CreateVolumesFromSnapshotTest-737681603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-cf3a8616-b2fc-4a08-9427-5a2f10e84383" returned: 0 in 0.956s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:00:37 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-d443db79-7217-40c9-8958-41395c0f3289 tempest-CreateVolumesFromSnapshotTest-737681603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-cf3a8616-b2fc-4a08-9427-5a2f10e84383,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-cf3a8616-b2fc-4a08-9427-5a2f10e84383.acc694d1-c6de-4ce3-b648-4dddaa601536 1G {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:00:37 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-26762658-0b4e-4954-ae39-e25e22bb39e2 tempest-VolumesSnapshotListTestJSON-723237481 None] Lock "cinder-quobyte-8c7a7bc3-e4c0-45ef-9778-3a355bcf057b" released by "delete_snapshot" :: held 3.722s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 20:00:37 devstack sudo[103704]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-cf3a8616-b2fc-4a08-9427-5a2f10e84383,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-cf3a8616-b2fc-4a08-9427-5a2f10e84383.acc694d1-c6de-4ce3-b648-4dddaa601536 1G
Jul 02 20:00:37 devstack sudo[103704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:00:37 devstack cinder-volume[86639]: DEBUG cinder.quota [None req-26762658-0b4e-4954-ae39-e25e22bb39e2 tempest-VolumesSnapshotListTestJSON-723237481 None] Created reservations ['8ad334fd-e899-4881-a2e0-d18b2ba43c83', '38684f93-910e-4264-abc6-968dcd29b1bb', 'c2fe9f15-f3c7-4360-b4fd-c8b66fb8bf87', '627aa038-246f-49a0-a28d-73e4f846388a'] {{(pid=86639) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 20:00:37 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-26762658-0b4e-4954-ae39-e25e22bb39e2 tempest-VolumesSnapshotListTestJSON-723237481 None] Delete snapshot completed successfully.
Jul 02 20:00:37 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-26762658-0b4e-4954-ae39-e25e22bb39e2 tempest-VolumesSnapshotListTestJSON-723237481 None] Lock "cinder-cb113554-f426-40d7-9256-41c93f73b255-delete_snapshot" released by "delete_snapshot" :: held 3.879s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 20:00:37 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-915bcf4a-cd87-4ad5-9b0f-1a69d6374daf tempest-VolumesSnapshotListTestJSON-723237481 None] Acquiring lock "cinder-f7b450b1-8a58-4ff3-a7ce-6dbba83cb309-delete_snapshot" by "delete_snapshot" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 20:00:37 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-915bcf4a-cd87-4ad5-9b0f-1a69d6374daf tempest-VolumesSnapshotListTestJSON-723237481 None] Lock "cinder-f7b450b1-8a58-4ff3-a7ce-6dbba83cb309-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 20:00:37 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-915bcf4a-cd87-4ad5-9b0f-1a69d6374daf tempest-VolumesSnapshotListTestJSON-723237481 None] Acquiring lock "cinder-quobyte-8c7a7bc3-e4c0-45ef-9778-3a355bcf057b" by "delete_snapshot" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 20:00:37 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-915bcf4a-cd87-4ad5-9b0f-1a69d6374daf tempest-VolumesSnapshotListTestJSON-723237481 None] Lock "cinder-quobyte-8c7a7bc3-e4c0-45ef-9778-3a355bcf057b" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 20:00:37 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-915bcf4a-cd87-4ad5-9b0f-1a69d6374daf tempest-VolumesSnapshotListTestJSON-723237481 None] Acquiring lock "cinder-quobyte-f7b450b1-8a58-4ff3-a7ce-6dbba83cb309" by "_delete_snapshot" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 20:00:37 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-915bcf4a-cd87-4ad5-9b0f-1a69d6374daf tempest-VolumesSnapshotListTestJSON-723237481 None] Lock "cinder-quobyte-f7b450b1-8a58-4ff3-a7ce-6dbba83cb309" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 20:00:37 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-915bcf4a-cd87-4ad5-9b0f-1a69d6374daf tempest-VolumesSnapshotListTestJSON-723237481 None] Deleting offline snapshot f7b450b1-8a58-4ff3-a7ce-6dbba83cb309 of volume 8c7a7bc3-e4c0-45ef-9778-3a355bcf057b {{(pid=86639) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 02 20:00:37 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-915bcf4a-cd87-4ad5-9b0f-1a69d6374daf tempest-VolumesSnapshotListTestJSON-723237481 None] snapshot_file for this snap is: volume-8c7a7bc3-e4c0-45ef-9778-3a355bcf057b.f7b450b1-8a58-4ff3-a7ce-6dbba83cb309 {{(pid=86639) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 02 20:00:37 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[66f881cc-b049-47a2-886e-8e42f8db849e]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 20:00:38 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-915bcf4a-cd87-4ad5-9b0f-1a69d6374daf tempest-VolumesSnapshotListTestJSON-723237481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8c7a7bc3-e4c0-45ef-9778-3a355bcf057b.f7b450b1-8a58-4ff3-a7ce-6dbba83cb309 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:00:38 devstack sudo[103710]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8c7a7bc3-e4c0-45ef-9778-3a355bcf057b.f7b450b1-8a58-4ff3-a7ce-6dbba83cb309
Jul 02 20:00:38 devstack sudo[103710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:00:38 devstack sudo[103704]: pam_unix(sudo:session): session closed for user root
Jul 02 20:00:38 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-d443db79-7217-40c9-8958-41395c0f3289 tempest-CreateVolumesFromSnapshotTest-737681603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-cf3a8616-b2fc-4a08-9427-5a2f10e84383,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-cf3a8616-b2fc-4a08-9427-5a2f10e84383.acc694d1-c6de-4ce3-b648-4dddaa601536 1G" returned: 0 in 0.980s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:00:38 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-d443db79-7217-40c9-8958-41395c0f3289 tempest-CreateVolumesFromSnapshotTest-737681603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf3a8616-b2fc-4a08-9427-5a2f10e84383 -F qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-cf3a8616-b2fc-4a08-9427-5a2f10e84383.acc694d1-c6de-4ce3-b648-4dddaa601536 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:00:38 devstack sudo[103714]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf3a8616-b2fc-4a08-9427-5a2f10e84383 -F qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-cf3a8616-b2fc-4a08-9427-5a2f10e84383.acc694d1-c6de-4ce3-b648-4dddaa601536
Jul 02 20:00:38 devstack sudo[103714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:00:38 devstack sudo[103710]: pam_unix(sudo:session): session closed for user root
Jul 02 20:00:38 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-915bcf4a-cd87-4ad5-9b0f-1a69d6374daf tempest-VolumesSnapshotListTestJSON-723237481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8c7a7bc3-e4c0-45ef-9778-3a355bcf057b.f7b450b1-8a58-4ff3-a7ce-6dbba83cb309" returned: 0 in 0.980s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:00:38 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-915bcf4a-cd87-4ad5-9b0f-1a69d6374daf tempest-VolumesSnapshotListTestJSON-723237481 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8c7a7bc3-e4c0-45ef-9778-3a355bcf057b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86639) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 02 20:00:39 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3395af1-4fd1-46fe-ba88-b932ad3654c1]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 20:00:39 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-915bcf4a-cd87-4ad5-9b0f-1a69d6374daf tempest-VolumesSnapshotListTestJSON-723237481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8c7a7bc3-e4c0-45ef-9778-3a355bcf057b {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:00:39 devstack sudo[103719]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8c7a7bc3-e4c0-45ef-9778-3a355bcf057b
Jul 02 20:00:39 devstack sudo[103719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:00:39 devstack sudo[103714]: pam_unix(sudo:session): session closed for user root
Jul 02 20:00:39 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-d443db79-7217-40c9-8958-41395c0f3289 tempest-CreateVolumesFromSnapshotTest-737681603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf3a8616-b2fc-4a08-9427-5a2f10e84383 -F qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-cf3a8616-b2fc-4a08-9427-5a2f10e84383.acc694d1-c6de-4ce3-b648-4dddaa601536" returned: 0 in 1.008s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:00:39 devstack cinder-volume[86639]: WARNING cinder.volume.drivers.remotefs [None req-d443db79-7217-40c9-8958-41395c0f3289 tempest-CreateVolumesFromSnapshotTest-737681603 None] /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-cf3a8616-b2fc-4a08-9427-5a2f10e84383.acc694d1-c6de-4ce3-b648-4dddaa601536 is being set with open permissions: ugo+rw
Jul 02 20:00:39 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-d443db79-7217-40c9-8958-41395c0f3289 tempest-CreateVolumesFromSnapshotTest-737681603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-cf3a8616-b2fc-4a08-9427-5a2f10e84383.acc694d1-c6de-4ce3-b648-4dddaa601536 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:00:39 devstack sudo[103724]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-cf3a8616-b2fc-4a08-9427-5a2f10e84383.acc694d1-c6de-4ce3-b648-4dddaa601536
Jul 02 20:00:39 devstack sudo[103724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:00:40 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [req-e11c0d0c-7b81-4e6d-8b08-060c43601985 req-57040ecb-a473-4397-8edc-f27981631236 tempest-TestShelveInstance-1204606342 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 20:00:40 devstack sudo[103719]: pam_unix(sudo:session): session closed for user root
Jul 02 20:00:40 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-915bcf4a-cd87-4ad5-9b0f-1a69d6374daf tempest-VolumesSnapshotListTestJSON-723237481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8c7a7bc3-e4c0-45ef-9778-3a355bcf057b" returned: 0 in 1.147s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:00:40 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-915bcf4a-cd87-4ad5-9b0f-1a69d6374daf tempest-VolumesSnapshotListTestJSON-723237481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8c7a7bc3-e4c0-45ef-9778-3a355bcf057b.f7b450b1-8a58-4ff3-a7ce-6dbba83cb309 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:00:40 devstack sudo[103738]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8c7a7bc3-e4c0-45ef-9778-3a355bcf057b.f7b450b1-8a58-4ff3-a7ce-6dbba83cb309
Jul 02 20:00:40 devstack sudo[103738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:00:40 devstack sudo[103724]: pam_unix(sudo:session): session closed for user root
Jul 02 20:00:40 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-d443db79-7217-40c9-8958-41395c0f3289 tempest-CreateVolumesFromSnapshotTest-737681603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-cf3a8616-b2fc-4a08-9427-5a2f10e84383.acc694d1-c6de-4ce3-b648-4dddaa601536" returned: 0 in 1.015s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:00:40 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-d443db79-7217-40c9-8958-41395c0f3289 tempest-CreateVolumesFromSnapshotTest-737681603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-cf3a8616-b2fc-4a08-9427-5a2f10e84383.info {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:00:40 devstack sudo[103741]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-cf3a8616-b2fc-4a08-9427-5a2f10e84383.info
Jul 02 20:00:40 devstack sudo[103741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:00:41 devstack sudo[103738]: pam_unix(sudo:session): session closed for user root
Jul 02 20:00:41 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-915bcf4a-cd87-4ad5-9b0f-1a69d6374daf tempest-VolumesSnapshotListTestJSON-723237481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8c7a7bc3-e4c0-45ef-9778-3a355bcf057b.f7b450b1-8a58-4ff3-a7ce-6dbba83cb309" returned: 0 in 1.035s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:00:41 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-915bcf4a-cd87-4ad5-9b0f-1a69d6374daf tempest-VolumesSnapshotListTestJSON-723237481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8c7a7bc3-e4c0-45ef-9778-3a355bcf057b.f7b450b1-8a58-4ff3-a7ce-6dbba83cb309 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:00:41 devstack sudo[103748]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8c7a7bc3-e4c0-45ef-9778-3a355bcf057b.f7b450b1-8a58-4ff3-a7ce-6dbba83cb309
Jul 02 20:00:41 devstack sudo[103748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:00:41 devstack sudo[103741]: pam_unix(sudo:session): session closed for user root
Jul 02 20:00:41 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-d443db79-7217-40c9-8958-41395c0f3289 tempest-CreateVolumesFromSnapshotTest-737681603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-cf3a8616-b2fc-4a08-9427-5a2f10e84383.info" returned: 0 in 0.933s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:00:41 devstack cinder-volume[86639]: WARNING cinder.volume.drivers.remotefs [None req-d443db79-7217-40c9-8958-41395c0f3289 tempest-CreateVolumesFromSnapshotTest-737681603 None] /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-cf3a8616-b2fc-4a08-9427-5a2f10e84383.info is being set with open permissions: ugo+rw
Jul 02 20:00:41 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-d443db79-7217-40c9-8958-41395c0f3289 tempest-CreateVolumesFromSnapshotTest-737681603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-cf3a8616-b2fc-4a08-9427-5a2f10e84383.info {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:00:41 devstack sudo[103750]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-cf3a8616-b2fc-4a08-9427-5a2f10e84383.info
Jul 02 20:00:41 devstack sudo[103750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:00:41 devstack cinder-volume[86639]: DEBUG oslo_service.periodic_task [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] Running periodic task VolumeManager._thread_info {{(pid=86639) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 02 20:00:41 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] thread count: 28 {{(pid=86639) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 02 20:00:41 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] thread info: [<_MainThread(MainThread, started 140525261275264)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 140525150678016)>, <Thread(Thread-3 (stat_writer), started daemon 140525150025920)>, <Thread(Rabbit-heartbeat, started daemon 140525150500864)>, <Thread(Thread-5 (_runner), started daemon 140525149847296)>, <Thread(Thread-7 (_runner), started daemon 140525149863424)>, <Thread(fd_logger, started daemon 140525146589376)>, <Thread(privsep_reader, started daemon 140525144562432)>, <Thread(tpool_thread_0, started daemon 140525137151680)>, <Thread(tpool_thread_1, started daemon 140525128758976)>, <Thread(tpool_thread_2, started daemon 140525120349888)>, <Thread(tpool_thread_3, started daemon 140525111940800)>, <Thread(tpool_thread_4, started daemon 140525103531712)>, <Thread(tpool_thread_5, started daemon 140525095122624)>, <Thread(tpool_thread_6, started daemon 140525086713536)>, <Thread(tpool_thread_7, started daemon 140525078304448)>, <Thread(tpool_thread_8, started daemon 140525069895360)>, <Thread(tpool_thread_9, started daemon 140525061486272)>, <Thread(tpool_thread_10, started daemon 140525053077184)>, <Thread(tpool_thread_11, started daemon 140525044668096)>, <Thread(tpool_thread_12, started daemon 140525036259008)>, <Thread(tpool_thread_13, started daemon 140525027849920)>, <Thread(tpool_thread_14, started daemon 140525019440832)>, <Thread(tpool_thread_15, started daemon 140525011031744)>, <Thread(tpool_thread_16, started daemon 140525002622656)>, <Thread(tpool_thread_17, started daemon 140524994213568)>, <Thread(tpool_thread_18, started daemon 140524985804480)>, <Thread(tpool_thread_19, started daemon 140524977395392)>] {{(pid=86639) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 02 20:00:42 devstack sudo[103748]: pam_unix(sudo:session): session closed for user root
Jul 02 20:00:42 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-915bcf4a-cd87-4ad5-9b0f-1a69d6374daf tempest-VolumesSnapshotListTestJSON-723237481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8c7a7bc3-e4c0-45ef-9778-3a355bcf057b.f7b450b1-8a58-4ff3-a7ce-6dbba83cb309" returned: 0 in 0.876s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:00:42 devstack sudo[103750]: pam_unix(sudo:session): session closed for user root
Jul 02 20:00:42 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-d443db79-7217-40c9-8958-41395c0f3289 tempest-CreateVolumesFromSnapshotTest-737681603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-cf3a8616-b2fc-4a08-9427-5a2f10e84383.info" returned: 0 in 0.779s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:00:42 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-d443db79-7217-40c9-8958-41395c0f3289 tempest-CreateVolumesFromSnapshotTest-737681603 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.799s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 20:00:42 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-915bcf4a-cd87-4ad5-9b0f-1a69d6374daf tempest-VolumesSnapshotListTestJSON-723237481 None] Lock "cinder-quobyte-f7b450b1-8a58-4ff3-a7ce-6dbba83cb309" released by "_delete_snapshot" :: held 4.216s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 20:00:42 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [req-e11c0d0c-7b81-4e6d-8b08-060c43601985 req-57040ecb-a473-4397-8edc-f27981631236 tempest-TestShelveInstance-1204606342 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.080s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 20:00:42 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-915bcf4a-cd87-4ad5-9b0f-1a69d6374daf tempest-VolumesSnapshotListTestJSON-723237481 None] Lock "cinder-quobyte-8c7a7bc3-e4c0-45ef-9778-3a355bcf057b" released by "delete_snapshot" :: held 4.253s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 20:00:42 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1e2accf-0de5-4a5e-a045-ebb2c883433a]: (4, 'raw') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 20:00:42 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [req-e11c0d0c-7b81-4e6d-8b08-060c43601985 req-57040ecb-a473-4397-8edc-f27981631236 tempest-TestShelveInstance-1204606342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-a992da0d-c1f8-4a49-8b48-729e67de065d {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:00:42 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-d443db79-7217-40c9-8958-41395c0f3289 tempest-CreateVolumesFromSnapshotTest-737681603 None] Create snapshot completed successfully
Jul 02 20:00:42 devstack cinder-volume[86639]: DEBUG cinder.quota [None req-915bcf4a-cd87-4ad5-9b0f-1a69d6374daf tempest-VolumesSnapshotListTestJSON-723237481 None] Created reservations ['809b2f34-28ab-4f2e-b038-ba03ca458337', '56640c6e-7e62-409f-ac50-543b5daeca93', 'a87dcd95-d55e-4659-ab6f-bd98e3d3e1e3', '3f498331-7720-4732-8bf0-4cd26d13a1ed'] {{(pid=86639) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 20:00:42 devstack sudo[103754]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-a992da0d-c1f8-4a49-8b48-729e67de065d
Jul 02 20:00:42 devstack sudo[103754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:00:42 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-915bcf4a-cd87-4ad5-9b0f-1a69d6374daf tempest-VolumesSnapshotListTestJSON-723237481 None] Delete snapshot completed successfully.
Jul 02 20:00:42 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-915bcf4a-cd87-4ad5-9b0f-1a69d6374daf tempest-VolumesSnapshotListTestJSON-723237481 None] Lock "cinder-f7b450b1-8a58-4ff3-a7ce-6dbba83cb309-delete_snapshot" released by "delete_snapshot" :: held 4.493s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 20:00:43 devstack sudo[103754]: pam_unix(sudo:session): session closed for user root
Jul 02 20:00:43 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [req-e11c0d0c-7b81-4e6d-8b08-060c43601985 req-57040ecb-a473-4397-8edc-f27981631236 tempest-TestShelveInstance-1204606342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-a992da0d-c1f8-4a49-8b48-729e67de065d" returned: 0 in 0.873s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:00:43 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [req-e11c0d0c-7b81-4e6d-8b08-060c43601985 req-57040ecb-a473-4397-8edc-f27981631236 tempest-TestShelveInstance-1204606342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-a992da0d-c1f8-4a49-8b48-729e67de065d {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:00:43 devstack sudo[103758]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-a992da0d-c1f8-4a49-8b48-729e67de065d
Jul 02 20:00:43 devstack sudo[103758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:00:43 devstack cinder-volume[86639]: DEBUG cinder.volume.flows.manager.create_volume [None req-764bd014-e6a7-44a2-97cb-504eac674dcb tempest-CreateVolumesFromSnapshotTest-737681603 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 20:00:43 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-764bd014-e6a7-44a2-97cb-504eac674dcb tempest-CreateVolumesFromSnapshotTest-737681603 None] Flow 'volume_create_manager' (25be5903-720e-4563-8811-7109ef99bb25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 20:00:43 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-764bd014-e6a7-44a2-97cb-504eac674dcb tempest-CreateVolumesFromSnapshotTest-737681603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d10b43dd-d7c8-4e68-a4ee-1b9f212e36a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:00:43 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-764bd014-e6a7-44a2-97cb-504eac674dcb tempest-CreateVolumesFromSnapshotTest-737681603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d10b43dd-d7c8-4e68-a4ee-1b9f212e36a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T18:00:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1825973127',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d84f2d4b-95f8-4829-8149-514a01b57b43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4cace2b4ecc44e91aa4d67b58026e3a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T18:00:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T18:00:43Z,use_quota=True,user_id='0643d9c6d40a4f9e98ee2b395c98f864',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:00:43 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-764bd014-e6a7-44a2-97cb-504eac674dcb tempest-CreateVolumesFromSnapshotTest-737681603 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (471587c2-f789-4ed7-aad2-507899f24c67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:00:43 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-764bd014-e6a7-44a2-97cb-504eac674dcb tempest-CreateVolumesFromSnapshotTest-737681603 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (471587c2-f789-4ed7-aad2-507899f24c67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:00:43 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-764bd014-e6a7-44a2-97cb-504eac674dcb tempest-CreateVolumesFromSnapshotTest-737681603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9606c7ce-6111-4dfa-8e84-04b8d853272e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:00:43 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-764bd014-e6a7-44a2-97cb-504eac674dcb tempest-CreateVolumesFromSnapshotTest-737681603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9606c7ce-6111-4dfa-8e84-04b8d853272e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd84f2d4b-95f8-4829-8149-514a01b57b43', 'volume_name': 'volume-d84f2d4b-95f8-4829-8149-514a01b57b43', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:00:43 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-764bd014-e6a7-44a2-97cb-504eac674dcb tempest-CreateVolumesFromSnapshotTest-737681603 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (623789ae-93fb-430e-99e4-bac8c469e7eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:00:43 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-764bd014-e6a7-44a2-97cb-504eac674dcb tempest-CreateVolumesFromSnapshotTest-737681603 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (623789ae-93fb-430e-99e4-bac8c469e7eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:00:43 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-764bd014-e6a7-44a2-97cb-504eac674dcb tempest-CreateVolumesFromSnapshotTest-737681603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73e6d3f3-f310-44fb-b1a5-617c05cd56f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:00:43 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-764bd014-e6a7-44a2-97cb-504eac674dcb tempest-CreateVolumesFromSnapshotTest-737681603 None] Volume d84f2d4b-95f8-4829-8149-514a01b57b43: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d84f2d4b-95f8-4829-8149-514a01b57b43', 'volume_size': 1}
Jul 02 20:00:43 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-764bd014-e6a7-44a2-97cb-504eac674dcb tempest-CreateVolumesFromSnapshotTest-737681603 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 20:00:43 devstack cinder-volume[86639]: DEBUG cinder.volume.flows.manager.create_volume [None req-0142569c-b20c-43d5-b0d9-f05f7a62a0a4 tempest-CreateVolumesFromSnapshotTest-737681603 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 20:00:43 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-0142569c-b20c-43d5-b0d9-f05f7a62a0a4 tempest-CreateVolumesFromSnapshotTest-737681603 None] Flow 'volume_create_manager' (68853ffc-8c05-408c-9a50-b8f5f2c584eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 20:00:43 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-0142569c-b20c-43d5-b0d9-f05f7a62a0a4 tempest-CreateVolumesFromSnapshotTest-737681603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac5bb1a3-16d0-4549-aa31-2347391ec1b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:00:43 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-0142569c-b20c-43d5-b0d9-f05f7a62a0a4 tempest-CreateVolumesFromSnapshotTest-737681603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac5bb1a3-16d0-4549-aa31-2347391ec1b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T18:00:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-36729088',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a2f38a8-7ff8-494a-86bf-629e6364271a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4cace2b4ecc44e91aa4d67b58026e3a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T18:00:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T18:00:44Z,use_quota=True,user_id='0643d9c6d40a4f9e98ee2b395c98f864',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:00:43 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-0142569c-b20c-43d5-b0d9-f05f7a62a0a4 tempest-CreateVolumesFromSnapshotTest-737681603 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1521274d-b336-479b-818c-d756e5ff07cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:00:43 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-0142569c-b20c-43d5-b0d9-f05f7a62a0a4 tempest-CreateVolumesFromSnapshotTest-737681603 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1521274d-b336-479b-818c-d756e5ff07cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:00:43 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-0142569c-b20c-43d5-b0d9-f05f7a62a0a4 tempest-CreateVolumesFromSnapshotTest-737681603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5b9b730-588f-417c-8426-04dd028e685d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:00:44 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-0142569c-b20c-43d5-b0d9-f05f7a62a0a4 tempest-CreateVolumesFromSnapshotTest-737681603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5b9b730-588f-417c-8426-04dd028e685d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a2f38a8-7ff8-494a-86bf-629e6364271a', 'volume_name': 'volume-7a2f38a8-7ff8-494a-86bf-629e6364271a', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:00:44 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-0142569c-b20c-43d5-b0d9-f05f7a62a0a4 tempest-CreateVolumesFromSnapshotTest-737681603 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36bac451-aed3-42c1-a9e2-a0925d63bd01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:00:44 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-0142569c-b20c-43d5-b0d9-f05f7a62a0a4 tempest-CreateVolumesFromSnapshotTest-737681603 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36bac451-aed3-42c1-a9e2-a0925d63bd01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:00:44 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-0142569c-b20c-43d5-b0d9-f05f7a62a0a4 tempest-CreateVolumesFromSnapshotTest-737681603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b7a7ff9-85de-47db-a012-cf30dc8db545) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:00:44 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-0142569c-b20c-43d5-b0d9-f05f7a62a0a4 tempest-CreateVolumesFromSnapshotTest-737681603 None] Volume 7a2f38a8-7ff8-494a-86bf-629e6364271a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a2f38a8-7ff8-494a-86bf-629e6364271a', 'volume_size': 1}
Jul 02 20:00:44 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-0142569c-b20c-43d5-b0d9-f05f7a62a0a4 tempest-CreateVolumesFromSnapshotTest-737681603 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 20:00:44 devstack sudo[103758]: pam_unix(sudo:session): session closed for user root
Jul 02 20:00:44 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [req-e11c0d0c-7b81-4e6d-8b08-060c43601985 req-57040ecb-a473-4397-8edc-f27981631236 tempest-TestShelveInstance-1204606342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-a992da0d-c1f8-4a49-8b48-729e67de065d" returned: 1 in 1.206s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:00:44 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [req-e11c0d0c-7b81-4e6d-8b08-060c43601985 req-57040ecb-a473-4397-8edc-f27981631236 tempest-TestShelveInstance-1204606342 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-a992da0d-c1f8-4a49-8b48-729e67de065d' failed. Not Retrying. {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 02 20:00:44 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [req-e11c0d0c-7b81-4e6d-8b08-060c43601985 req-57040ecb-a473-4397-8edc-f27981631236 tempest-TestShelveInstance-1204606342 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.128s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 20:00:44 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-764bd014-e6a7-44a2-97cb-504eac674dcb tempest-CreateVolumesFromSnapshotTest-737681603 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.704s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 20:00:44 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-764bd014-e6a7-44a2-97cb-504eac674dcb tempest-CreateVolumesFromSnapshotTest-737681603 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce906cb830>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T18:00:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1825973127',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d84f2d4b-95f8-4829-8149-514a01b57b43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4cace2b4ecc44e91aa4d67b58026e3a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T18:00:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T18:00:43Z,use_quota=True,user_id='0643d9c6d40a4f9e98ee2b395c98f864',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)}" {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 20:00:44 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-764bd014-e6a7-44a2-97cb-504eac674dcb tempest-CreateVolumesFromSnapshotTest-737681603 None] Creating volume d84f2d4b-95f8-4829-8149-514a01b57b43 {{(pid=86639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 20:00:44 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-764bd014-e6a7-44a2-97cb-504eac674dcb tempest-CreateVolumesFromSnapshotTest-737681603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 20:00:44 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-764bd014-e6a7-44a2-97cb-504eac674dcb tempest-CreateVolumesFromSnapshotTest-737681603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 20:00:44 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-764bd014-e6a7-44a2-97cb-504eac674dcb tempest-CreateVolumesFromSnapshotTest-737681603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 20:00:44 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-764bd014-e6a7-44a2-97cb-504eac674dcb tempest-CreateVolumesFromSnapshotTest-737681603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 20:00:44 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-764bd014-e6a7-44a2-97cb-504eac674dcb tempest-CreateVolumesFromSnapshotTest-737681603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 20:00:44 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-764bd014-e6a7-44a2-97cb-504eac674dcb tempest-CreateVolumesFromSnapshotTest-737681603 None] Selected osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92 as target Quobyte volume. {{(pid=86639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 20:00:44 devstack cinder-volume[86639]: INFO cinder.volume.drivers.remotefs [None req-764bd014-e6a7-44a2-97cb-504eac674dcb tempest-CreateVolumesFromSnapshotTest-737681603 None] casted to osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92
Jul 02 20:00:44 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-764bd014-e6a7-44a2-97cb-504eac674dcb tempest-CreateVolumesFromSnapshotTest-737681603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-d84f2d4b-95f8-4829-8149-514a01b57b43 1073741824 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:00:44 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-e51fa410-bf88-41ef-acf6-7143e439c0d7 tempest-VolumesSnapshotListTestJSON-723237481 None] Acquiring lock "cinder-8c7a7bc3-e4c0-45ef-9778-3a355bcf057b-delete_volume" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 20:00:44 devstack sudo[103764]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-d84f2d4b-95f8-4829-8149-514a01b57b43 1073741824
Jul 02 20:00:44 devstack sudo[103764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:00:44 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-e51fa410-bf88-41ef-acf6-7143e439c0d7 tempest-VolumesSnapshotListTestJSON-723237481 None] Lock "cinder-8c7a7bc3-e4c0-45ef-9778-3a355bcf057b-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 20:00:44 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [req-e11c0d0c-7b81-4e6d-8b08-060c43601985 req-57040ecb-a473-4397-8edc-f27981631236 tempest-TestShelveInstance-1204606342 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92', 'name': 'volume-a992da0d-c1f8-4a49-8b48-729e67de065d', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '518ccb9b-78ed-41c5-8f55-6ac702313ce7', 'enforce_multipath': True} {{(pid=86639) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 02 20:00:44 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-e51fa410-bf88-41ef-acf6-7143e439c0d7 tempest-VolumesSnapshotListTestJSON-723237481 None] Acquiring lock "cinder-quobyte-8c7a7bc3-e4c0-45ef-9778-3a355bcf057b" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 20:00:44 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-e51fa410-bf88-41ef-acf6-7143e439c0d7 tempest-VolumesSnapshotListTestJSON-723237481 None] Lock "cinder-quobyte-8c7a7bc3-e4c0-45ef-9778-3a355bcf057b" acquired by "delete_volume" :: waited 0.045s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 20:00:44 devstack cinder-volume[86639]: DEBUG cinder.volume.flows.manager.create_volume [None req-cac38e4c-a3d4-43a7-badf-b5f394b87a7b tempest-CreateVolumesFromSnapshotTest-737681603 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 20:00:44 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-cac38e4c-a3d4-43a7-badf-b5f394b87a7b tempest-CreateVolumesFromSnapshotTest-737681603 None] Flow 'volume_create_manager' (0c3803a5-1570-426b-88f2-085e74092775) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 20:00:44 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-cac38e4c-a3d4-43a7-badf-b5f394b87a7b tempest-CreateVolumesFromSnapshotTest-737681603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d05f8a74-a9d1-4f73-b4e9-1ba381818e16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:00:44 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa49236e-0751-4d17-bfc1-61292e0cf603]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 20:00:44 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-e51fa410-bf88-41ef-acf6-7143e439c0d7 tempest-VolumesSnapshotListTestJSON-723237481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8c7a7bc3-e4c0-45ef-9778-3a355bcf057b {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:00:44 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-cac38e4c-a3d4-43a7-badf-b5f394b87a7b tempest-CreateVolumesFromSnapshotTest-737681603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d05f8a74-a9d1-4f73-b4e9-1ba381818e16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T18:00:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1169791461',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62432256-2156-4f57-8526-cac3feff5d22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4cace2b4ecc44e91aa4d67b58026e3a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T18:00:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T18:00:44Z,use_quota=True,user_id='0643d9c6d40a4f9e98ee2b395c98f864',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:00:44 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-cac38e4c-a3d4-43a7-badf-b5f394b87a7b tempest-CreateVolumesFromSnapshotTest-737681603 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f79a8c48-dfb3-425e-93fc-c4bb6c8eb431) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:00:44 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-cac38e4c-a3d4-43a7-badf-b5f394b87a7b tempest-CreateVolumesFromSnapshotTest-737681603 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f79a8c48-dfb3-425e-93fc-c4bb6c8eb431) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:00:44 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-cac38e4c-a3d4-43a7-badf-b5f394b87a7b tempest-CreateVolumesFromSnapshotTest-737681603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c380476-359a-4425-9603-cb5c4426cedf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:00:44 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-cac38e4c-a3d4-43a7-badf-b5f394b87a7b tempest-CreateVolumesFromSnapshotTest-737681603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c380476-359a-4425-9603-cb5c4426cedf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '62432256-2156-4f57-8526-cac3feff5d22', 'volume_name': 'volume-62432256-2156-4f57-8526-cac3feff5d22', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:00:44 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-cac38e4c-a3d4-43a7-badf-b5f394b87a7b tempest-CreateVolumesFromSnapshotTest-737681603 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edc2f672-8227-4c2e-92eb-cb41585a77bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:00:44 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-cac38e4c-a3d4-43a7-badf-b5f394b87a7b tempest-CreateVolumesFromSnapshotTest-737681603 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edc2f672-8227-4c2e-92eb-cb41585a77bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:00:44 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-cac38e4c-a3d4-43a7-badf-b5f394b87a7b tempest-CreateVolumesFromSnapshotTest-737681603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc7f96b5-7cd6-41e6-b2ee-b0b5f42a033c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:00:44 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-cac38e4c-a3d4-43a7-badf-b5f394b87a7b tempest-CreateVolumesFromSnapshotTest-737681603 None] Volume 62432256-2156-4f57-8526-cac3feff5d22: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-62432256-2156-4f57-8526-cac3feff5d22', 'volume_size': 1}
Jul 02 20:00:44 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-cac38e4c-a3d4-43a7-badf-b5f394b87a7b tempest-CreateVolumesFromSnapshotTest-737681603 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 20:00:44 devstack cinder-volume[86639]: INFO cinder.volume.manager [req-e11c0d0c-7b81-4e6d-8b08-060c43601985 req-57040ecb-a473-4397-8edc-f27981631236 tempest-TestShelveInstance-1204606342 None] attachment_update completed successfully.
Jul 02 20:00:44 devstack sudo[103766]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8c7a7bc3-e4c0-45ef-9778-3a355bcf057b
Jul 02 20:00:44 devstack sudo[103766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:00:45 devstack cinder-volume[86639]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d0faf36-f860-4b09-a2eb-f3df3d0783c7 tempest-CreateVolumesFromSnapshotTest-737681603 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 20:00:45 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-6d0faf36-f860-4b09-a2eb-f3df3d0783c7 tempest-CreateVolumesFromSnapshotTest-737681603 None] Flow 'volume_create_manager' (d2a93895-4f07-452e-9a52-56f6db98b7b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 20:00:45 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-6d0faf36-f860-4b09-a2eb-f3df3d0783c7 tempest-CreateVolumesFromSnapshotTest-737681603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41e8b742-b255-4060-b332-907398102213) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:00:45 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-6d0faf36-f860-4b09-a2eb-f3df3d0783c7 tempest-CreateVolumesFromSnapshotTest-737681603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41e8b742-b255-4060-b332-907398102213) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T18:00:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1220251063',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8dadf6f6-0669-4930-bb6c-11406996cb24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4cace2b4ecc44e91aa4d67b58026e3a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T18:00:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T18:00:45Z,use_quota=True,user_id='0643d9c6d40a4f9e98ee2b395c98f864',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:00:45 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-6d0faf36-f860-4b09-a2eb-f3df3d0783c7 tempest-CreateVolumesFromSnapshotTest-737681603 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e907ac3e-91bd-4701-bc61-be85a5a6a691) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:00:45 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-6d0faf36-f860-4b09-a2eb-f3df3d0783c7 tempest-CreateVolumesFromSnapshotTest-737681603 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e907ac3e-91bd-4701-bc61-be85a5a6a691) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:00:45 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-6d0faf36-f860-4b09-a2eb-f3df3d0783c7 tempest-CreateVolumesFromSnapshotTest-737681603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64900df5-1963-410f-8e29-aa702ab84516) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:00:45 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-6d0faf36-f860-4b09-a2eb-f3df3d0783c7 tempest-CreateVolumesFromSnapshotTest-737681603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64900df5-1963-410f-8e29-aa702ab84516) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8dadf6f6-0669-4930-bb6c-11406996cb24', 'volume_name': 'volume-8dadf6f6-0669-4930-bb6c-11406996cb24', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:00:45 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-6d0faf36-f860-4b09-a2eb-f3df3d0783c7 tempest-CreateVolumesFromSnapshotTest-737681603 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee5be165-21a7-4fbd-8b99-45521caec597) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:00:45 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-6d0faf36-f860-4b09-a2eb-f3df3d0783c7 tempest-CreateVolumesFromSnapshotTest-737681603 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee5be165-21a7-4fbd-8b99-45521caec597) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:00:45 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-6d0faf36-f860-4b09-a2eb-f3df3d0783c7 tempest-CreateVolumesFromSnapshotTest-737681603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a068f351-0b58-4c43-a0f3-9f68ffe8ab9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:00:45 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-6d0faf36-f860-4b09-a2eb-f3df3d0783c7 tempest-CreateVolumesFromSnapshotTest-737681603 None] Volume 8dadf6f6-0669-4930-bb6c-11406996cb24: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8dadf6f6-0669-4930-bb6c-11406996cb24', 'volume_size': 1}
Jul 02 20:00:45 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-6d0faf36-f860-4b09-a2eb-f3df3d0783c7 tempest-CreateVolumesFromSnapshotTest-737681603 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 20:00:45 devstack sudo[103764]: pam_unix(sudo:session): session closed for user root
Jul 02 20:00:45 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-764bd014-e6a7-44a2-97cb-504eac674dcb tempest-CreateVolumesFromSnapshotTest-737681603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-d84f2d4b-95f8-4829-8149-514a01b57b43 1073741824" returned: 0 in 1.281s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:00:45 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-764bd014-e6a7-44a2-97cb-504eac674dcb tempest-CreateVolumesFromSnapshotTest-737681603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-d84f2d4b-95f8-4829-8149-514a01b57b43 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:00:45 devstack sudo[103775]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-d84f2d4b-95f8-4829-8149-514a01b57b43
Jul 02 20:00:45 devstack sudo[103775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:00:45 devstack sudo[103766]: pam_unix(sudo:session): session closed for user root
Jul 02 20:00:45 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-e51fa410-bf88-41ef-acf6-7143e439c0d7 tempest-VolumesSnapshotListTestJSON-723237481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8c7a7bc3-e4c0-45ef-9778-3a355bcf057b" returned: 0 in 1.267s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:00:45 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-e51fa410-bf88-41ef-acf6-7143e439c0d7 tempest-VolumesSnapshotListTestJSON-723237481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8c7a7bc3-e4c0-45ef-9778-3a355bcf057b {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:00:45 devstack cinder-volume[86639]: DEBUG cinder.volume.flows.manager.create_volume [None req-d1aa2c19-a021-4aea-aa7c-74f31edf3e34 tempest-CreateVolumesFromSnapshotTest-737681603 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 20:00:45 devstack sudo[103777]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8c7a7bc3-e4c0-45ef-9778-3a355bcf057b
Jul 02 20:00:45 devstack sudo[103777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:00:45 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-d1aa2c19-a021-4aea-aa7c-74f31edf3e34 tempest-CreateVolumesFromSnapshotTest-737681603 None] Flow 'volume_create_manager' (9261239a-ff3f-4d66-a221-e00524c410c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 20:00:45 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-d1aa2c19-a021-4aea-aa7c-74f31edf3e34 tempest-CreateVolumesFromSnapshotTest-737681603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb1479de-e3c8-48ef-af2e-b782463a504d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:00:46 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-d1aa2c19-a021-4aea-aa7c-74f31edf3e34 tempest-CreateVolumesFromSnapshotTest-737681603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb1479de-e3c8-48ef-af2e-b782463a504d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T18:00:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1587316821',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b0cdd72-4edc-456e-bc2e-456b3bacb5f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4cace2b4ecc44e91aa4d67b58026e3a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T18:00:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T18:00:46Z,use_quota=True,user_id='0643d9c6d40a4f9e98ee2b395c98f864',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:00:46 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-d1aa2c19-a021-4aea-aa7c-74f31edf3e34 tempest-CreateVolumesFromSnapshotTest-737681603 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4cc50cb-3f5c-4b10-9658-c46c1eb48796) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:00:46 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-d1aa2c19-a021-4aea-aa7c-74f31edf3e34 tempest-CreateVolumesFromSnapshotTest-737681603 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4cc50cb-3f5c-4b10-9658-c46c1eb48796) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:00:46 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-d1aa2c19-a021-4aea-aa7c-74f31edf3e34 tempest-CreateVolumesFromSnapshotTest-737681603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89403978-fa89-4069-a7aa-25e9b6ad618d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:00:46 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-d1aa2c19-a021-4aea-aa7c-74f31edf3e34 tempest-CreateVolumesFromSnapshotTest-737681603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89403978-fa89-4069-a7aa-25e9b6ad618d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b0cdd72-4edc-456e-bc2e-456b3bacb5f9', 'volume_name': 'volume-4b0cdd72-4edc-456e-bc2e-456b3bacb5f9', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:00:46 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-d1aa2c19-a021-4aea-aa7c-74f31edf3e34 tempest-CreateVolumesFromSnapshotTest-737681603 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7019e1ca-c229-4587-b545-7fd01377279c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:00:46 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-d1aa2c19-a021-4aea-aa7c-74f31edf3e34 tempest-CreateVolumesFromSnapshotTest-737681603 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7019e1ca-c229-4587-b545-7fd01377279c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:00:46 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-d1aa2c19-a021-4aea-aa7c-74f31edf3e34 tempest-CreateVolumesFromSnapshotTest-737681603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ddacaf21-d712-408b-ae07-069f6d8f9583) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:00:46 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-d1aa2c19-a021-4aea-aa7c-74f31edf3e34 tempest-CreateVolumesFromSnapshotTest-737681603 None] Volume 4b0cdd72-4edc-456e-bc2e-456b3bacb5f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b0cdd72-4edc-456e-bc2e-456b3bacb5f9', 'volume_size': 1}
Jul 02 20:00:46 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-d1aa2c19-a021-4aea-aa7c-74f31edf3e34 tempest-CreateVolumesFromSnapshotTest-737681603 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 20:00:46 devstack sudo[103775]: pam_unix(sudo:session): session closed for user root
Jul 02 20:00:46 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-764bd014-e6a7-44a2-97cb-504eac674dcb tempest-CreateVolumesFromSnapshotTest-737681603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-d84f2d4b-95f8-4829-8149-514a01b57b43" returned: 0 in 0.935s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:00:46 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-764bd014-e6a7-44a2-97cb-504eac674dcb tempest-CreateVolumesFromSnapshotTest-737681603 None] <== create_volume: return (2292ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'} {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 20:00:46 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-764bd014-e6a7-44a2-97cb-504eac674dcb tempest-CreateVolumesFromSnapshotTest-737681603 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.302s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 20:00:46 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-0142569c-b20c-43d5-b0d9-f05f7a62a0a4 tempest-CreateVolumesFromSnapshotTest-737681603 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.600s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 20:00:46 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-0142569c-b20c-43d5-b0d9-f05f7a62a0a4 tempest-CreateVolumesFromSnapshotTest-737681603 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce906cb830>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T18:00:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-36729088',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a2f38a8-7ff8-494a-86bf-629e6364271a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4cace2b4ecc44e91aa4d67b58026e3a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T18:00:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T18:00:44Z,use_quota=True,user_id='0643d9c6d40a4f9e98ee2b395c98f864',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)}" {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 20:00:46 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-0142569c-b20c-43d5-b0d9-f05f7a62a0a4 tempest-CreateVolumesFromSnapshotTest-737681603 None] Creating volume 7a2f38a8-7ff8-494a-86bf-629e6364271a {{(pid=86639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 20:00:46 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-0142569c-b20c-43d5-b0d9-f05f7a62a0a4 tempest-CreateVolumesFromSnapshotTest-737681603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 20:00:46 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-0142569c-b20c-43d5-b0d9-f05f7a62a0a4 tempest-CreateVolumesFromSnapshotTest-737681603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 20:00:46 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-0142569c-b20c-43d5-b0d9-f05f7a62a0a4 tempest-CreateVolumesFromSnapshotTest-737681603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 20:00:46 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-0142569c-b20c-43d5-b0d9-f05f7a62a0a4 tempest-CreateVolumesFromSnapshotTest-737681603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 20:00:46 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-0142569c-b20c-43d5-b0d9-f05f7a62a0a4 tempest-CreateVolumesFromSnapshotTest-737681603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 20:00:46 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-0142569c-b20c-43d5-b0d9-f05f7a62a0a4 tempest-CreateVolumesFromSnapshotTest-737681603 None] Selected osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92 as target Quobyte volume. {{(pid=86639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 20:00:46 devstack cinder-volume[86639]: INFO cinder.volume.drivers.remotefs [None req-0142569c-b20c-43d5-b0d9-f05f7a62a0a4 tempest-CreateVolumesFromSnapshotTest-737681603 None] casted to osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92
Jul 02 20:00:46 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-0142569c-b20c-43d5-b0d9-f05f7a62a0a4 tempest-CreateVolumesFromSnapshotTest-737681603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-7a2f38a8-7ff8-494a-86bf-629e6364271a 1073741824 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:00:46 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-764bd014-e6a7-44a2-97cb-504eac674dcb tempest-CreateVolumesFromSnapshotTest-737681603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73e6d3f3-f310-44fb-b1a5-617c05cd56f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d84f2d4b-95f8-4829-8149-514a01b57b43', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:00:46 devstack sudo[103781]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-7a2f38a8-7ff8-494a-86bf-629e6364271a 1073741824
Jul 02 20:00:46 devstack sudo[103781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:00:46 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-764bd014-e6a7-44a2-97cb-504eac674dcb tempest-CreateVolumesFromSnapshotTest-737681603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ac384ac-adb3-4e86-a04a-6721fe748b39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:00:46 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-764bd014-e6a7-44a2-97cb-504eac674dcb tempest-CreateVolumesFromSnapshotTest-737681603 None] Volume volume-d84f2d4b-95f8-4829-8149-514a01b57b43 (d84f2d4b-95f8-4829-8149-514a01b57b43): created successfully
Jul 02 20:00:46 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-764bd014-e6a7-44a2-97cb-504eac674dcb tempest-CreateVolumesFromSnapshotTest-737681603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ac384ac-adb3-4e86-a04a-6721fe748b39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:00:46 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-764bd014-e6a7-44a2-97cb-504eac674dcb tempest-CreateVolumesFromSnapshotTest-737681603 None] Flow 'volume_create_manager' (25be5903-720e-4563-8811-7109ef99bb25) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 20:00:46 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-764bd014-e6a7-44a2-97cb-504eac674dcb tempest-CreateVolumesFromSnapshotTest-737681603 None] Created volume successfully.
Jul 02 20:00:46 devstack sudo[103777]: pam_unix(sudo:session): session closed for user root
Jul 02 20:00:46 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-e51fa410-bf88-41ef-acf6-7143e439c0d7 tempest-VolumesSnapshotListTestJSON-723237481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8c7a7bc3-e4c0-45ef-9778-3a355bcf057b" returned: 0 in 0.911s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:00:46 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-e51fa410-bf88-41ef-acf6-7143e439c0d7 tempest-VolumesSnapshotListTestJSON-723237481 None] Lock "cinder-quobyte-8c7a7bc3-e4c0-45ef-9778-3a355bcf057b" released by "delete_volume" :: held 2.326s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 20:00:46 devstack cinder-volume[86639]: DEBUG cinder.quota [None req-e51fa410-bf88-41ef-acf6-7143e439c0d7 tempest-VolumesSnapshotListTestJSON-723237481 None] Created reservations ['c00cf410-7acc-47bc-ae07-c6c5d1ab85b0', '26aa2fda-58fb-4a79-8a76-0afabcb39fe2', 'eea318cb-839e-43e4-8407-69a56ae6095c', 'f574c110-caa5-414f-a709-f0301de87124'] {{(pid=86639) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 20:00:47 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-e51fa410-bf88-41ef-acf6-7143e439c0d7 tempest-VolumesSnapshotListTestJSON-723237481 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 20:00:47 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-e51fa410-bf88-41ef-acf6-7143e439c0d7 tempest-VolumesSnapshotListTestJSON-723237481 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 20:00:47 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-e51fa410-bf88-41ef-acf6-7143e439c0d7 tempest-VolumesSnapshotListTestJSON-723237481 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 20:00:47 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-e51fa410-bf88-41ef-acf6-7143e439c0d7 tempest-VolumesSnapshotListTestJSON-723237481 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 20:00:47 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-e51fa410-bf88-41ef-acf6-7143e439c0d7 tempest-VolumesSnapshotListTestJSON-723237481 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 20:00:47 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-e51fa410-bf88-41ef-acf6-7143e439c0d7 tempest-VolumesSnapshotListTestJSON-723237481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:00:47 devstack sudo[103829]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e
Jul 02 20:00:47 devstack sudo[103829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:00:47 devstack sudo[103781]: pam_unix(sudo:session): session closed for user root
Jul 02 20:00:47 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-0142569c-b20c-43d5-b0d9-f05f7a62a0a4 tempest-CreateVolumesFromSnapshotTest-737681603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-7a2f38a8-7ff8-494a-86bf-629e6364271a 1073741824" returned: 0 in 1.188s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:00:47 devstack sudo[103829]: pam_unix(sudo:session): session closed for user root
Jul 02 20:00:47 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-e51fa410-bf88-41ef-acf6-7143e439c0d7 tempest-VolumesSnapshotListTestJSON-723237481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e" returned: 0 in 0.840s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:00:47 devstack cinder-volume[86639]: DEBUG cinder.manager [None req-e51fa410-bf88-41ef-acf6-7143e439c0d7 tempest-VolumesSnapshotListTestJSON-723237481 None] Notifying Schedulers of capabilities ... {{(pid=86639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 20:00:47 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-e51fa410-bf88-41ef-acf6-7143e439c0d7 tempest-VolumesSnapshotListTestJSON-723237481 None] Deleted volume successfully.
Jul 02 20:00:47 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-0142569c-b20c-43d5-b0d9-f05f7a62a0a4 tempest-CreateVolumesFromSnapshotTest-737681603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-7a2f38a8-7ff8-494a-86bf-629e6364271a {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:00:47 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-e51fa410-bf88-41ef-acf6-7143e439c0d7 tempest-VolumesSnapshotListTestJSON-723237481 None] Lock "cinder-8c7a7bc3-e4c0-45ef-9778-3a355bcf057b-delete_volume" released by "delete_volume" :: held 3.518s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 20:00:47 devstack sudo[103859]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-7a2f38a8-7ff8-494a-86bf-629e6364271a
Jul 02 20:00:47 devstack sudo[103859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:00:48 devstack sudo[103859]: pam_unix(sudo:session): session closed for user root
Jul 02 20:00:48 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-0142569c-b20c-43d5-b0d9-f05f7a62a0a4 tempest-CreateVolumesFromSnapshotTest-737681603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-7a2f38a8-7ff8-494a-86bf-629e6364271a" returned: 0 in 0.859s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:00:48 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-0142569c-b20c-43d5-b0d9-f05f7a62a0a4 tempest-CreateVolumesFromSnapshotTest-737681603 None] <== create_volume: return (2120ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'} {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 20:00:48 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-0142569c-b20c-43d5-b0d9-f05f7a62a0a4 tempest-CreateVolumesFromSnapshotTest-737681603 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.125s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 20:00:48 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-cac38e4c-a3d4-43a7-badf-b5f394b87a7b tempest-CreateVolumesFromSnapshotTest-737681603 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.026s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 20:00:48 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-cac38e4c-a3d4-43a7-badf-b5f394b87a7b tempest-CreateVolumesFromSnapshotTest-737681603 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce906cb830>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T18:00:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1169791461',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62432256-2156-4f57-8526-cac3feff5d22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4cace2b4ecc44e91aa4d67b58026e3a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T18:00:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T18:00:44Z,use_quota=True,user_id='0643d9c6d40a4f9e98ee2b395c98f864',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)}" {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 20:00:48 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-cac38e4c-a3d4-43a7-badf-b5f394b87a7b tempest-CreateVolumesFromSnapshotTest-737681603 None] Creating volume 62432256-2156-4f57-8526-cac3feff5d22 {{(pid=86639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 20:00:48 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-cac38e4c-a3d4-43a7-badf-b5f394b87a7b tempest-CreateVolumesFromSnapshotTest-737681603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 20:00:48 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-cac38e4c-a3d4-43a7-badf-b5f394b87a7b tempest-CreateVolumesFromSnapshotTest-737681603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 20:00:48 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-cac38e4c-a3d4-43a7-badf-b5f394b87a7b tempest-CreateVolumesFromSnapshotTest-737681603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 20:00:48 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-cac38e4c-a3d4-43a7-badf-b5f394b87a7b tempest-CreateVolumesFromSnapshotTest-737681603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 20:00:48 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-cac38e4c-a3d4-43a7-badf-b5f394b87a7b tempest-CreateVolumesFromSnapshotTest-737681603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 20:00:48 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-cac38e4c-a3d4-43a7-badf-b5f394b87a7b tempest-CreateVolumesFromSnapshotTest-737681603 None] Selected osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92 as target Quobyte volume. {{(pid=86639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 20:00:48 devstack cinder-volume[86639]: INFO cinder.volume.drivers.remotefs [None req-cac38e4c-a3d4-43a7-badf-b5f394b87a7b tempest-CreateVolumesFromSnapshotTest-737681603 None] casted to osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92
Jul 02 20:00:48 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-cac38e4c-a3d4-43a7-badf-b5f394b87a7b tempest-CreateVolumesFromSnapshotTest-737681603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-62432256-2156-4f57-8526-cac3feff5d22 1073741824 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:00:48 devstack sudo[103865]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-62432256-2156-4f57-8526-cac3feff5d22 1073741824
Jul 02 20:00:48 devstack sudo[103865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:00:48 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-0142569c-b20c-43d5-b0d9-f05f7a62a0a4 tempest-CreateVolumesFromSnapshotTest-737681603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b7a7ff9-85de-47db-a012-cf30dc8db545) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a2f38a8-7ff8-494a-86bf-629e6364271a', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:00:48 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-0142569c-b20c-43d5-b0d9-f05f7a62a0a4 tempest-CreateVolumesFromSnapshotTest-737681603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b2c2d81-dbb3-4646-92f7-f7f8b643b02f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:00:48 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-0142569c-b20c-43d5-b0d9-f05f7a62a0a4 tempest-CreateVolumesFromSnapshotTest-737681603 None] Volume volume-7a2f38a8-7ff8-494a-86bf-629e6364271a (7a2f38a8-7ff8-494a-86bf-629e6364271a): created successfully
Jul 02 20:00:48 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-0142569c-b20c-43d5-b0d9-f05f7a62a0a4 tempest-CreateVolumesFromSnapshotTest-737681603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b2c2d81-dbb3-4646-92f7-f7f8b643b02f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:00:48 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-0142569c-b20c-43d5-b0d9-f05f7a62a0a4 tempest-CreateVolumesFromSnapshotTest-737681603 None] Flow 'volume_create_manager' (68853ffc-8c05-408c-9a50-b8f5f2c584eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 20:00:48 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-0142569c-b20c-43d5-b0d9-f05f7a62a0a4 tempest-CreateVolumesFromSnapshotTest-737681603 None] Created volume successfully.
Jul 02 20:00:49 devstack sudo[103865]: pam_unix(sudo:session): session closed for user root
Jul 02 20:00:49 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-cac38e4c-a3d4-43a7-badf-b5f394b87a7b tempest-CreateVolumesFromSnapshotTest-737681603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-62432256-2156-4f57-8526-cac3feff5d22 1073741824" returned: 0 in 1.054s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:00:49 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-cac38e4c-a3d4-43a7-badf-b5f394b87a7b tempest-CreateVolumesFromSnapshotTest-737681603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-62432256-2156-4f57-8526-cac3feff5d22 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:00:50 devstack sudo[103882]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-62432256-2156-4f57-8526-cac3feff5d22
Jul 02 20:00:50 devstack sudo[103882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:00:51 devstack sudo[103882]: pam_unix(sudo:session): session closed for user root
Jul 02 20:00:51 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-cac38e4c-a3d4-43a7-badf-b5f394b87a7b tempest-CreateVolumesFromSnapshotTest-737681603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-62432256-2156-4f57-8526-cac3feff5d22" returned: 0 in 1.131s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:00:51 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-cac38e4c-a3d4-43a7-badf-b5f394b87a7b tempest-CreateVolumesFromSnapshotTest-737681603 None] <== create_volume: return (2271ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'} {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 20:00:51 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-cac38e4c-a3d4-43a7-badf-b5f394b87a7b tempest-CreateVolumesFromSnapshotTest-737681603 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.275s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 20:00:51 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-6d0faf36-f860-4b09-a2eb-f3df3d0783c7 tempest-CreateVolumesFromSnapshotTest-737681603 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.695s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 20:00:51 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-6d0faf36-f860-4b09-a2eb-f3df3d0783c7 tempest-CreateVolumesFromSnapshotTest-737681603 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce906cb830>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T18:00:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1220251063',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8dadf6f6-0669-4930-bb6c-11406996cb24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4cace2b4ecc44e91aa4d67b58026e3a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T18:00:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T18:00:45Z,use_quota=True,user_id='0643d9c6d40a4f9e98ee2b395c98f864',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)}" {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 20:00:51 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-6d0faf36-f860-4b09-a2eb-f3df3d0783c7 tempest-CreateVolumesFromSnapshotTest-737681603 None] Creating volume 8dadf6f6-0669-4930-bb6c-11406996cb24 {{(pid=86639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 20:00:51 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-6d0faf36-f860-4b09-a2eb-f3df3d0783c7 tempest-CreateVolumesFromSnapshotTest-737681603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 20:00:51 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-6d0faf36-f860-4b09-a2eb-f3df3d0783c7 tempest-CreateVolumesFromSnapshotTest-737681603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 20:00:51 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-6d0faf36-f860-4b09-a2eb-f3df3d0783c7 tempest-CreateVolumesFromSnapshotTest-737681603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 20:00:51 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-6d0faf36-f860-4b09-a2eb-f3df3d0783c7 tempest-CreateVolumesFromSnapshotTest-737681603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 20:00:51 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-6d0faf36-f860-4b09-a2eb-f3df3d0783c7 tempest-CreateVolumesFromSnapshotTest-737681603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 20:00:51 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-6d0faf36-f860-4b09-a2eb-f3df3d0783c7 tempest-CreateVolumesFromSnapshotTest-737681603 None] Selected osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92 as target Quobyte volume. {{(pid=86639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 20:00:51 devstack cinder-volume[86639]: INFO cinder.volume.drivers.remotefs [None req-6d0faf36-f860-4b09-a2eb-f3df3d0783c7 tempest-CreateVolumesFromSnapshotTest-737681603 None] casted to osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92
Jul 02 20:00:51 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-6d0faf36-f860-4b09-a2eb-f3df3d0783c7 tempest-CreateVolumesFromSnapshotTest-737681603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8dadf6f6-0669-4930-bb6c-11406996cb24 1073741824 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:00:51 devstack sudo[104246]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8dadf6f6-0669-4930-bb6c-11406996cb24 1073741824
Jul 02 20:00:51 devstack sudo[104246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:00:51 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-cac38e4c-a3d4-43a7-badf-b5f394b87a7b tempest-CreateVolumesFromSnapshotTest-737681603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc7f96b5-7cd6-41e6-b2ee-b0b5f42a033c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-62432256-2156-4f57-8526-cac3feff5d22', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:00:51 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-cac38e4c-a3d4-43a7-badf-b5f394b87a7b tempest-CreateVolumesFromSnapshotTest-737681603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ca5e3f8-0c08-42ae-82e2-aa98e18449e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:00:51 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-cac38e4c-a3d4-43a7-badf-b5f394b87a7b tempest-CreateVolumesFromSnapshotTest-737681603 None] Volume volume-62432256-2156-4f57-8526-cac3feff5d22 (62432256-2156-4f57-8526-cac3feff5d22): created successfully
Jul 02 20:00:51 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-cac38e4c-a3d4-43a7-badf-b5f394b87a7b tempest-CreateVolumesFromSnapshotTest-737681603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ca5e3f8-0c08-42ae-82e2-aa98e18449e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:00:51 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-cac38e4c-a3d4-43a7-badf-b5f394b87a7b tempest-CreateVolumesFromSnapshotTest-737681603 None] Flow 'volume_create_manager' (0c3803a5-1570-426b-88f2-085e74092775) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 20:00:51 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-cac38e4c-a3d4-43a7-badf-b5f394b87a7b tempest-CreateVolumesFromSnapshotTest-737681603 None] Created volume successfully.
Jul 02 20:00:52 devstack cinder-volume[86639]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea4b6903-cedd-4049-9bb1-a7b7f27e5025 tempest-VolumesSnapshotNegativeTestJSON-206039503 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 20:00:52 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-ea4b6903-cedd-4049-9bb1-a7b7f27e5025 tempest-VolumesSnapshotNegativeTestJSON-206039503 None] Flow 'volume_create_manager' (715f1184-56e0-42fc-bdb0-fa96cc711fa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 20:00:52 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-ea4b6903-cedd-4049-9bb1-a7b7f27e5025 tempest-VolumesSnapshotNegativeTestJSON-206039503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6a18492-c918-4983-a73b-ca4752114597) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:00:52 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-ea4b6903-cedd-4049-9bb1-a7b7f27e5025 tempest-VolumesSnapshotNegativeTestJSON-206039503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6a18492-c918-4983-a73b-ca4752114597) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T18:00:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1437579112',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5fb37464-bc4b-410d-95e4-e4b3c01e0337,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79a298223c1449269cde04d41857b2e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T18:00:52Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T18:00:52Z,use_quota=True,user_id='0d1609f3eddc4dccafef69aca62ce97c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:00:52 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-ea4b6903-cedd-4049-9bb1-a7b7f27e5025 tempest-VolumesSnapshotNegativeTestJSON-206039503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9c36e01-42f0-4757-8173-4a3de4d001c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:00:52 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-ea4b6903-cedd-4049-9bb1-a7b7f27e5025 tempest-VolumesSnapshotNegativeTestJSON-206039503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9c36e01-42f0-4757-8173-4a3de4d001c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:00:52 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-ea4b6903-cedd-4049-9bb1-a7b7f27e5025 tempest-VolumesSnapshotNegativeTestJSON-206039503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (136f7e99-493a-44ea-a422-a9b14959de82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:00:52 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-ea4b6903-cedd-4049-9bb1-a7b7f27e5025 tempest-VolumesSnapshotNegativeTestJSON-206039503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (136f7e99-493a-44ea-a422-a9b14959de82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5fb37464-bc4b-410d-95e4-e4b3c01e0337', 'volume_name': 'volume-5fb37464-bc4b-410d-95e4-e4b3c01e0337', 'volume_size': 2}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:00:52 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-ea4b6903-cedd-4049-9bb1-a7b7f27e5025 tempest-VolumesSnapshotNegativeTestJSON-206039503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38f95ade-3feb-48f4-9765-26890ff094a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:00:52 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-ea4b6903-cedd-4049-9bb1-a7b7f27e5025 tempest-VolumesSnapshotNegativeTestJSON-206039503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38f95ade-3feb-48f4-9765-26890ff094a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:00:52 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-ea4b6903-cedd-4049-9bb1-a7b7f27e5025 tempest-VolumesSnapshotNegativeTestJSON-206039503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6908e4ac-990d-46b6-9b45-8abb1402e3d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:00:52 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-ea4b6903-cedd-4049-9bb1-a7b7f27e5025 tempest-VolumesSnapshotNegativeTestJSON-206039503 None] Volume 5fb37464-bc4b-410d-95e4-e4b3c01e0337: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5fb37464-bc4b-410d-95e4-e4b3c01e0337', 'volume_size': 2}
Jul 02 20:00:52 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-ea4b6903-cedd-4049-9bb1-a7b7f27e5025 tempest-VolumesSnapshotNegativeTestJSON-206039503 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 20:00:52 devstack sudo[104246]: pam_unix(sudo:session): session closed for user root
Jul 02 20:00:52 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-6d0faf36-f860-4b09-a2eb-f3df3d0783c7 tempest-CreateVolumesFromSnapshotTest-737681603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8dadf6f6-0669-4930-bb6c-11406996cb24 1073741824" returned: 0 in 1.284s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:00:52 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-6d0faf36-f860-4b09-a2eb-f3df3d0783c7 tempest-CreateVolumesFromSnapshotTest-737681603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8dadf6f6-0669-4930-bb6c-11406996cb24 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:00:52 devstack sudo[104262]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8dadf6f6-0669-4930-bb6c-11406996cb24
Jul 02 20:00:52 devstack sudo[104262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:00:53 devstack sudo[104262]: pam_unix(sudo:session): session closed for user root
Jul 02 20:00:53 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-6d0faf36-f860-4b09-a2eb-f3df3d0783c7 tempest-CreateVolumesFromSnapshotTest-737681603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8dadf6f6-0669-4930-bb6c-11406996cb24" returned: 0 in 1.369s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:00:53 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-6d0faf36-f860-4b09-a2eb-f3df3d0783c7 tempest-CreateVolumesFromSnapshotTest-737681603 None] <== create_volume: return (2725ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'} {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 20:00:53 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-6d0faf36-f860-4b09-a2eb-f3df3d0783c7 tempest-CreateVolumesFromSnapshotTest-737681603 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.734s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 20:00:53 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-d1aa2c19-a021-4aea-aa7c-74f31edf3e34 tempest-CreateVolumesFromSnapshotTest-737681603 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.711s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 20:00:53 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-d1aa2c19-a021-4aea-aa7c-74f31edf3e34 tempest-CreateVolumesFromSnapshotTest-737681603 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce906cb830>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T18:00:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1587316821',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b0cdd72-4edc-456e-bc2e-456b3bacb5f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4cace2b4ecc44e91aa4d67b58026e3a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T18:00:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T18:00:46Z,use_quota=True,user_id='0643d9c6d40a4f9e98ee2b395c98f864',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)}" {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 20:00:53 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-d1aa2c19-a021-4aea-aa7c-74f31edf3e34 tempest-CreateVolumesFromSnapshotTest-737681603 None] Creating volume 4b0cdd72-4edc-456e-bc2e-456b3bacb5f9 {{(pid=86639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 20:00:53 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-d1aa2c19-a021-4aea-aa7c-74f31edf3e34 tempest-CreateVolumesFromSnapshotTest-737681603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 20:00:53 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-d1aa2c19-a021-4aea-aa7c-74f31edf3e34 tempest-CreateVolumesFromSnapshotTest-737681603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 20:00:53 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-d1aa2c19-a021-4aea-aa7c-74f31edf3e34 tempest-CreateVolumesFromSnapshotTest-737681603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 20:00:53 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-d1aa2c19-a021-4aea-aa7c-74f31edf3e34 tempest-CreateVolumesFromSnapshotTest-737681603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 20:00:53 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-d1aa2c19-a021-4aea-aa7c-74f31edf3e34 tempest-CreateVolumesFromSnapshotTest-737681603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 20:00:53 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-d1aa2c19-a021-4aea-aa7c-74f31edf3e34 tempest-CreateVolumesFromSnapshotTest-737681603 None] Selected osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92 as target Quobyte volume. {{(pid=86639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 20:00:53 devstack cinder-volume[86639]: INFO cinder.volume.drivers.remotefs [None req-d1aa2c19-a021-4aea-aa7c-74f31edf3e34 tempest-CreateVolumesFromSnapshotTest-737681603 None] casted to osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92
Jul 02 20:00:53 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-d1aa2c19-a021-4aea-aa7c-74f31edf3e34 tempest-CreateVolumesFromSnapshotTest-737681603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-4b0cdd72-4edc-456e-bc2e-456b3bacb5f9 1073741824 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:00:53 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-6d0faf36-f860-4b09-a2eb-f3df3d0783c7 tempest-CreateVolumesFromSnapshotTest-737681603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a068f351-0b58-4c43-a0f3-9f68ffe8ab9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8dadf6f6-0669-4930-bb6c-11406996cb24', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:00:53 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-6d0faf36-f860-4b09-a2eb-f3df3d0783c7 tempest-CreateVolumesFromSnapshotTest-737681603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57241dc8-599b-4816-a2ef-140f9cff7d04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:00:53 devstack sudo[104265]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-4b0cdd72-4edc-456e-bc2e-456b3bacb5f9 1073741824
Jul 02 20:00:53 devstack sudo[104265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:00:53 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-6d0faf36-f860-4b09-a2eb-f3df3d0783c7 tempest-CreateVolumesFromSnapshotTest-737681603 None] Volume volume-8dadf6f6-0669-4930-bb6c-11406996cb24 (8dadf6f6-0669-4930-bb6c-11406996cb24): created successfully
Jul 02 20:00:53 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-6d0faf36-f860-4b09-a2eb-f3df3d0783c7 tempest-CreateVolumesFromSnapshotTest-737681603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57241dc8-599b-4816-a2ef-140f9cff7d04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:00:53 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-6d0faf36-f860-4b09-a2eb-f3df3d0783c7 tempest-CreateVolumesFromSnapshotTest-737681603 None] Flow 'volume_create_manager' (d2a93895-4f07-452e-9a52-56f6db98b7b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 20:00:53 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-6d0faf36-f860-4b09-a2eb-f3df3d0783c7 tempest-CreateVolumesFromSnapshotTest-737681603 None] Created volume successfully.
Jul 02 20:00:55 devstack sudo[104265]: pam_unix(sudo:session): session closed for user root
Jul 02 20:00:55 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-d1aa2c19-a021-4aea-aa7c-74f31edf3e34 tempest-CreateVolumesFromSnapshotTest-737681603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-4b0cdd72-4edc-456e-bc2e-456b3bacb5f9 1073741824" returned: 0 in 1.269s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:00:55 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-d1aa2c19-a021-4aea-aa7c-74f31edf3e34 tempest-CreateVolumesFromSnapshotTest-737681603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-4b0cdd72-4edc-456e-bc2e-456b3bacb5f9 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:00:55 devstack sudo[104274]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-4b0cdd72-4edc-456e-bc2e-456b3bacb5f9
Jul 02 20:00:55 devstack sudo[104274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:00:55 devstack sudo[104274]: pam_unix(sudo:session): session closed for user root
Jul 02 20:00:55 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-d1aa2c19-a021-4aea-aa7c-74f31edf3e34 tempest-CreateVolumesFromSnapshotTest-737681603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-4b0cdd72-4edc-456e-bc2e-456b3bacb5f9" returned: 0 in 0.863s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:00:55 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-d1aa2c19-a021-4aea-aa7c-74f31edf3e34 tempest-CreateVolumesFromSnapshotTest-737681603 None] <== create_volume: return (2193ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'} {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 20:00:55 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-d1aa2c19-a021-4aea-aa7c-74f31edf3e34 tempest-CreateVolumesFromSnapshotTest-737681603 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.197s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 20:00:55 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-ea4b6903-cedd-4049-9bb1-a7b7f27e5025 tempest-VolumesSnapshotNegativeTestJSON-206039503 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.806s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 20:00:55 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-ea4b6903-cedd-4049-9bb1-a7b7f27e5025 tempest-VolumesSnapshotNegativeTestJSON-206039503 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce906cb830>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T18:00:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1437579112',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5fb37464-bc4b-410d-95e4-e4b3c01e0337,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79a298223c1449269cde04d41857b2e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T18:00:52Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T18:00:52Z,use_quota=True,user_id='0d1609f3eddc4dccafef69aca62ce97c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)}" {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 20:00:55 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-ea4b6903-cedd-4049-9bb1-a7b7f27e5025 tempest-VolumesSnapshotNegativeTestJSON-206039503 None] Creating volume 5fb37464-bc4b-410d-95e4-e4b3c01e0337 {{(pid=86639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 20:00:55 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-ea4b6903-cedd-4049-9bb1-a7b7f27e5025 tempest-VolumesSnapshotNegativeTestJSON-206039503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 20:00:55 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-ea4b6903-cedd-4049-9bb1-a7b7f27e5025 tempest-VolumesSnapshotNegativeTestJSON-206039503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 20:00:55 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-ea4b6903-cedd-4049-9bb1-a7b7f27e5025 tempest-VolumesSnapshotNegativeTestJSON-206039503 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 20:00:55 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-ea4b6903-cedd-4049-9bb1-a7b7f27e5025 tempest-VolumesSnapshotNegativeTestJSON-206039503 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 20:00:55 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-ea4b6903-cedd-4049-9bb1-a7b7f27e5025 tempest-VolumesSnapshotNegativeTestJSON-206039503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 20:00:55 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-ea4b6903-cedd-4049-9bb1-a7b7f27e5025 tempest-VolumesSnapshotNegativeTestJSON-206039503 None] Selected osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92 as target Quobyte volume. {{(pid=86639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 20:00:55 devstack cinder-volume[86639]: INFO cinder.volume.drivers.remotefs [None req-ea4b6903-cedd-4049-9bb1-a7b7f27e5025 tempest-VolumesSnapshotNegativeTestJSON-206039503 None] casted to osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92
Jul 02 20:00:55 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-ea4b6903-cedd-4049-9bb1-a7b7f27e5025 tempest-VolumesSnapshotNegativeTestJSON-206039503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-5fb37464-bc4b-410d-95e4-e4b3c01e0337 2147483648 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:00:56 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-d1aa2c19-a021-4aea-aa7c-74f31edf3e34 tempest-CreateVolumesFromSnapshotTest-737681603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ddacaf21-d712-408b-ae07-069f6d8f9583) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b0cdd72-4edc-456e-bc2e-456b3bacb5f9', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:00:56 devstack sudo[104277]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-5fb37464-bc4b-410d-95e4-e4b3c01e0337 2147483648
Jul 02 20:00:56 devstack sudo[104277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:00:56 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-d1aa2c19-a021-4aea-aa7c-74f31edf3e34 tempest-CreateVolumesFromSnapshotTest-737681603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5272b8ed-5a0f-4642-a7c4-3d15ba1add5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:00:56 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-d1aa2c19-a021-4aea-aa7c-74f31edf3e34 tempest-CreateVolumesFromSnapshotTest-737681603 None] Volume volume-4b0cdd72-4edc-456e-bc2e-456b3bacb5f9 (4b0cdd72-4edc-456e-bc2e-456b3bacb5f9): created successfully
Jul 02 20:00:56 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-d1aa2c19-a021-4aea-aa7c-74f31edf3e34 tempest-CreateVolumesFromSnapshotTest-737681603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5272b8ed-5a0f-4642-a7c4-3d15ba1add5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:00:56 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-d1aa2c19-a021-4aea-aa7c-74f31edf3e34 tempest-CreateVolumesFromSnapshotTest-737681603 None] Flow 'volume_create_manager' (9261239a-ff3f-4d66-a221-e00524c410c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 20:00:56 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-d1aa2c19-a021-4aea-aa7c-74f31edf3e34 tempest-CreateVolumesFromSnapshotTest-737681603 None] Created volume successfully.
Jul 02 20:00:57 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-8e425b77-a338-4ab9-ae01-f961d2acb0c4 tempest-CreateVolumesFromSnapshotTest-737681603 None] Acquiring lock "cinder-4b0cdd72-4edc-456e-bc2e-456b3bacb5f9-delete_volume" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 20:00:57 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-8e425b77-a338-4ab9-ae01-f961d2acb0c4 tempest-CreateVolumesFromSnapshotTest-737681603 None] Lock "cinder-4b0cdd72-4edc-456e-bc2e-456b3bacb5f9-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 20:00:57 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-8e425b77-a338-4ab9-ae01-f961d2acb0c4 tempest-CreateVolumesFromSnapshotTest-737681603 None] Acquiring lock "cinder-quobyte-4b0cdd72-4edc-456e-bc2e-456b3bacb5f9" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 20:00:57 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-8e425b77-a338-4ab9-ae01-f961d2acb0c4 tempest-CreateVolumesFromSnapshotTest-737681603 None] Lock "cinder-quobyte-4b0cdd72-4edc-456e-bc2e-456b3bacb5f9" acquired by "delete_volume" :: waited 0.042s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 20:00:57 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[34c3390f-5663-4e56-bf11-00b820d7dede]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 20:00:57 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-8e425b77-a338-4ab9-ae01-f961d2acb0c4 tempest-CreateVolumesFromSnapshotTest-737681603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-4b0cdd72-4edc-456e-bc2e-456b3bacb5f9 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:00:57 devstack sudo[104277]: pam_unix(sudo:session): session closed for user root
Jul 02 20:00:57 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-ea4b6903-cedd-4049-9bb1-a7b7f27e5025 tempest-VolumesSnapshotNegativeTestJSON-206039503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-5fb37464-bc4b-410d-95e4-e4b3c01e0337 2147483648" returned: 0 in 1.306s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:00:57 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-ea4b6903-cedd-4049-9bb1-a7b7f27e5025 tempest-VolumesSnapshotNegativeTestJSON-206039503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-5fb37464-bc4b-410d-95e4-e4b3c01e0337 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:00:57 devstack sudo[104286]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-5fb37464-bc4b-410d-95e4-e4b3c01e0337
Jul 02 20:00:57 devstack sudo[104286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:00:57 devstack sudo[104285]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-4b0cdd72-4edc-456e-bc2e-456b3bacb5f9
Jul 02 20:00:57 devstack sudo[104285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:00:58 devstack sudo[104286]: pam_unix(sudo:session): session closed for user root
Jul 02 20:00:58 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-ea4b6903-cedd-4049-9bb1-a7b7f27e5025 tempest-VolumesSnapshotNegativeTestJSON-206039503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-5fb37464-bc4b-410d-95e4-e4b3c01e0337" returned: 0 in 0.781s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:00:58 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-ea4b6903-cedd-4049-9bb1-a7b7f27e5025 tempest-VolumesSnapshotNegativeTestJSON-206039503 None] <== create_volume: return (2188ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'} {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 20:00:58 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-ea4b6903-cedd-4049-9bb1-a7b7f27e5025 tempest-VolumesSnapshotNegativeTestJSON-206039503 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.191s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 20:00:58 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-ea4b6903-cedd-4049-9bb1-a7b7f27e5025 tempest-VolumesSnapshotNegativeTestJSON-206039503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6908e4ac-990d-46b6-9b45-8abb1402e3d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5fb37464-bc4b-410d-95e4-e4b3c01e0337', 'volume_size': 2}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:00:58 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-ea4b6903-cedd-4049-9bb1-a7b7f27e5025 tempest-VolumesSnapshotNegativeTestJSON-206039503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10c0e217-a956-4053-a8ea-6f3aad3e07fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:00:58 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-ea4b6903-cedd-4049-9bb1-a7b7f27e5025 tempest-VolumesSnapshotNegativeTestJSON-206039503 None] Volume volume-5fb37464-bc4b-410d-95e4-e4b3c01e0337 (5fb37464-bc4b-410d-95e4-e4b3c01e0337): created successfully
Jul 02 20:00:58 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-ea4b6903-cedd-4049-9bb1-a7b7f27e5025 tempest-VolumesSnapshotNegativeTestJSON-206039503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10c0e217-a956-4053-a8ea-6f3aad3e07fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:00:58 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-ea4b6903-cedd-4049-9bb1-a7b7f27e5025 tempest-VolumesSnapshotNegativeTestJSON-206039503 None] Flow 'volume_create_manager' (715f1184-56e0-42fc-bdb0-fa96cc711fa6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 20:00:58 devstack sudo[104285]: pam_unix(sudo:session): session closed for user root
Jul 02 20:00:58 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-8e425b77-a338-4ab9-ae01-f961d2acb0c4 tempest-CreateVolumesFromSnapshotTest-737681603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-4b0cdd72-4edc-456e-bc2e-456b3bacb5f9" returned: 0 in 0.979s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:00:58 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-8e425b77-a338-4ab9-ae01-f961d2acb0c4 tempest-CreateVolumesFromSnapshotTest-737681603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-4b0cdd72-4edc-456e-bc2e-456b3bacb5f9 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:00:58 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-ea4b6903-cedd-4049-9bb1-a7b7f27e5025 tempest-VolumesSnapshotNegativeTestJSON-206039503 None] Created volume successfully.
Jul 02 20:00:58 devstack sudo[104293]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-4b0cdd72-4edc-456e-bc2e-456b3bacb5f9
Jul 02 20:00:58 devstack sudo[104293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:00:58 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-901f255a-8a51-40cd-b7b3-3f14d1542f06 tempest-VolumesSnapshotNegativeTestJSON-206039503 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 20:00:58 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-901f255a-8a51-40cd-b7b3-3f14d1542f06 tempest-VolumesSnapshotNegativeTestJSON-206039503 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 20:00:58 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-901f255a-8a51-40cd-b7b3-3f14d1542f06 tempest-VolumesSnapshotNegativeTestJSON-206039503 None] Creating offline snapshot ab1dbf01-62b3-45b3-a908-b796f7ce8615 of volume 5fb37464-bc4b-410d-95e4-e4b3c01e0337 {{(pid=86639) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 02 20:00:58 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[2465387c-a3ea-4153-ad40-f31088128aa5]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 20:00:58 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-901f255a-8a51-40cd-b7b3-3f14d1542f06 tempest-VolumesSnapshotNegativeTestJSON-206039503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-5fb37464-bc4b-410d-95e4-e4b3c01e0337 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:00:58 devstack sudo[104295]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-5fb37464-bc4b-410d-95e4-e4b3c01e0337
Jul 02 20:00:58 devstack sudo[104295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:00:58 devstack sudo[104293]: pam_unix(sudo:session): session closed for user root
Jul 02 20:00:58 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-8e425b77-a338-4ab9-ae01-f961d2acb0c4 tempest-CreateVolumesFromSnapshotTest-737681603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-4b0cdd72-4edc-456e-bc2e-456b3bacb5f9" returned: 0 in 0.706s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:00:58 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-8e425b77-a338-4ab9-ae01-f961d2acb0c4 tempest-CreateVolumesFromSnapshotTest-737681603 None] Lock "cinder-quobyte-4b0cdd72-4edc-456e-bc2e-456b3bacb5f9" released by "delete_volume" :: held 1.743s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 20:00:59 devstack cinder-volume[86639]: DEBUG cinder.quota [None req-8e425b77-a338-4ab9-ae01-f961d2acb0c4 tempest-CreateVolumesFromSnapshotTest-737681603 None] Created reservations ['93eb3d42-e234-4ca2-b7cb-d5d9fe1d9988', 'ccff054a-b015-4754-b30e-c2e862300f43', '0be76e62-8c49-488f-b482-b409e5f31d6b', 'f06e93cd-03f3-4632-91dc-f2c74c948284'] {{(pid=86639) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 20:00:59 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-8e425b77-a338-4ab9-ae01-f961d2acb0c4 tempest-CreateVolumesFromSnapshotTest-737681603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 20:00:59 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-8e425b77-a338-4ab9-ae01-f961d2acb0c4 tempest-CreateVolumesFromSnapshotTest-737681603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 20:00:59 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-8e425b77-a338-4ab9-ae01-f961d2acb0c4 tempest-CreateVolumesFromSnapshotTest-737681603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 20:00:59 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-8e425b77-a338-4ab9-ae01-f961d2acb0c4 tempest-CreateVolumesFromSnapshotTest-737681603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 20:00:59 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-8e425b77-a338-4ab9-ae01-f961d2acb0c4 tempest-CreateVolumesFromSnapshotTest-737681603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 20:00:59 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-8e425b77-a338-4ab9-ae01-f961d2acb0c4 tempest-CreateVolumesFromSnapshotTest-737681603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:00:59 devstack sudo[104298]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e
Jul 02 20:00:59 devstack sudo[104298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:00:59 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-eb2f177e-b572-478c-ac3b-8ea1cd3c858e tempest-CreateVolumesFromSnapshotTest-737681603 None] Acquiring lock "cinder-8dadf6f6-0669-4930-bb6c-11406996cb24-delete_volume" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 20:00:59 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-eb2f177e-b572-478c-ac3b-8ea1cd3c858e tempest-CreateVolumesFromSnapshotTest-737681603 None] Lock "cinder-8dadf6f6-0669-4930-bb6c-11406996cb24-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 20:00:59 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-eb2f177e-b572-478c-ac3b-8ea1cd3c858e tempest-CreateVolumesFromSnapshotTest-737681603 None] Acquiring lock "cinder-quobyte-8dadf6f6-0669-4930-bb6c-11406996cb24" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 20:00:59 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-eb2f177e-b572-478c-ac3b-8ea1cd3c858e tempest-CreateVolumesFromSnapshotTest-737681603 None] Lock "cinder-quobyte-8dadf6f6-0669-4930-bb6c-11406996cb24" acquired by "delete_volume" :: waited 0.025s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 20:00:59 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[200895a9-b795-4f63-b491-8a9b1267111c]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 20:00:59 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-eb2f177e-b572-478c-ac3b-8ea1cd3c858e tempest-CreateVolumesFromSnapshotTest-737681603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8dadf6f6-0669-4930-bb6c-11406996cb24 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:00:59 devstack sudo[104295]: pam_unix(sudo:session): session closed for user root
Jul 02 20:00:59 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-901f255a-8a51-40cd-b7b3-3f14d1542f06 tempest-VolumesSnapshotNegativeTestJSON-206039503 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-5fb37464-bc4b-410d-95e4-e4b3c01e0337" returned: 0 in 0.918s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:00:59 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-901f255a-8a51-40cd-b7b3-3f14d1542f06 tempest-VolumesSnapshotNegativeTestJSON-206039503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-5fb37464-bc4b-410d-95e4-e4b3c01e0337,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-5fb37464-bc4b-410d-95e4-e4b3c01e0337.ab1dbf01-62b3-45b3-a908-b796f7ce8615 2G {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:00:59 devstack sudo[104303]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8dadf6f6-0669-4930-bb6c-11406996cb24
Jul 02 20:00:59 devstack sudo[104303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:00:59 devstack sudo[104305]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-5fb37464-bc4b-410d-95e4-e4b3c01e0337,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-5fb37464-bc4b-410d-95e4-e4b3c01e0337.ab1dbf01-62b3-45b3-a908-b796f7ce8615 2G
Jul 02 20:00:59 devstack sudo[104305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:00:59 devstack sudo[104298]: pam_unix(sudo:session): session closed for user root
Jul 02 20:00:59 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-8e425b77-a338-4ab9-ae01-f961d2acb0c4 tempest-CreateVolumesFromSnapshotTest-737681603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e" returned: 0 in 0.882s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:00:59 devstack cinder-volume[86639]: DEBUG cinder.manager [None req-8e425b77-a338-4ab9-ae01-f961d2acb0c4 tempest-CreateVolumesFromSnapshotTest-737681603 None] Notifying Schedulers of capabilities ... {{(pid=86639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 20:01:00 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-8e425b77-a338-4ab9-ae01-f961d2acb0c4 tempest-CreateVolumesFromSnapshotTest-737681603 None] Deleted volume successfully.
Jul 02 20:01:00 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-8e425b77-a338-4ab9-ae01-f961d2acb0c4 tempest-CreateVolumesFromSnapshotTest-737681603 None] Lock "cinder-4b0cdd72-4edc-456e-bc2e-456b3bacb5f9-delete_volume" released by "delete_volume" :: held 2.890s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 20:01:00 devstack sudo[104303]: pam_unix(sudo:session): session closed for user root
Jul 02 20:01:00 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-eb2f177e-b572-478c-ac3b-8ea1cd3c858e tempest-CreateVolumesFromSnapshotTest-737681603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8dadf6f6-0669-4930-bb6c-11406996cb24" returned: 0 in 0.930s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:01:00 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-eb2f177e-b572-478c-ac3b-8ea1cd3c858e tempest-CreateVolumesFromSnapshotTest-737681603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8dadf6f6-0669-4930-bb6c-11406996cb24 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:01:00 devstack sudo[104317]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8dadf6f6-0669-4930-bb6c-11406996cb24
Jul 02 20:01:00 devstack sudo[104317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:01:00 devstack sudo[104305]: pam_unix(sudo:session): session closed for user root
Jul 02 20:01:00 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-901f255a-8a51-40cd-b7b3-3f14d1542f06 tempest-VolumesSnapshotNegativeTestJSON-206039503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-5fb37464-bc4b-410d-95e4-e4b3c01e0337,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-5fb37464-bc4b-410d-95e4-e4b3c01e0337.ab1dbf01-62b3-45b3-a908-b796f7ce8615 2G" returned: 0 in 1.138s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:01:00 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-901f255a-8a51-40cd-b7b3-3f14d1542f06 tempest-VolumesSnapshotNegativeTestJSON-206039503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5fb37464-bc4b-410d-95e4-e4b3c01e0337 -F qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-5fb37464-bc4b-410d-95e4-e4b3c01e0337.ab1dbf01-62b3-45b3-a908-b796f7ce8615 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:01:00 devstack sudo[104319]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5fb37464-bc4b-410d-95e4-e4b3c01e0337 -F qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-5fb37464-bc4b-410d-95e4-e4b3c01e0337.ab1dbf01-62b3-45b3-a908-b796f7ce8615
Jul 02 20:01:00 devstack sudo[104319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:01:01 devstack sudo[104317]: pam_unix(sudo:session): session closed for user root
Jul 02 20:01:01 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-eb2f177e-b572-478c-ac3b-8ea1cd3c858e tempest-CreateVolumesFromSnapshotTest-737681603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-8dadf6f6-0669-4930-bb6c-11406996cb24" returned: 0 in 0.715s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:01:01 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-eb2f177e-b572-478c-ac3b-8ea1cd3c858e tempest-CreateVolumesFromSnapshotTest-737681603 None] Lock "cinder-quobyte-8dadf6f6-0669-4930-bb6c-11406996cb24" released by "delete_volume" :: held 1.699s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 20:01:01 devstack cinder-volume[86639]: DEBUG cinder.quota [None req-eb2f177e-b572-478c-ac3b-8ea1cd3c858e tempest-CreateVolumesFromSnapshotTest-737681603 None] Created reservations ['29864649-2f79-4b75-af25-9f5cf6530826', '99d970f4-12a9-4a6c-a966-f47ec5593201', 'ba5529d8-d449-4a82-9d2d-412dcb3c4e09', '8f5fc0b1-f14c-4539-971d-7c453e68e9f7'] {{(pid=86639) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 20:01:01 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-eb2f177e-b572-478c-ac3b-8ea1cd3c858e tempest-CreateVolumesFromSnapshotTest-737681603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 20:01:01 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-eb2f177e-b572-478c-ac3b-8ea1cd3c858e tempest-CreateVolumesFromSnapshotTest-737681603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 20:01:01 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-eb2f177e-b572-478c-ac3b-8ea1cd3c858e tempest-CreateVolumesFromSnapshotTest-737681603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 20:01:01 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-eb2f177e-b572-478c-ac3b-8ea1cd3c858e tempest-CreateVolumesFromSnapshotTest-737681603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 20:01:01 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-eb2f177e-b572-478c-ac3b-8ea1cd3c858e tempest-CreateVolumesFromSnapshotTest-737681603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 20:01:01 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-eb2f177e-b572-478c-ac3b-8ea1cd3c858e tempest-CreateVolumesFromSnapshotTest-737681603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:01:01 devstack sudo[104322]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e
Jul 02 20:01:01 devstack sudo[104322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:01:01 devstack sudo[104319]: pam_unix(sudo:session): session closed for user root
Jul 02 20:01:01 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-901f255a-8a51-40cd-b7b3-3f14d1542f06 tempest-VolumesSnapshotNegativeTestJSON-206039503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5fb37464-bc4b-410d-95e4-e4b3c01e0337 -F qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-5fb37464-bc4b-410d-95e4-e4b3c01e0337.ab1dbf01-62b3-45b3-a908-b796f7ce8615" returned: 0 in 0.844s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:01:01 devstack cinder-volume[86639]: WARNING cinder.volume.drivers.remotefs [None req-901f255a-8a51-40cd-b7b3-3f14d1542f06 tempest-VolumesSnapshotNegativeTestJSON-206039503 None] /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-5fb37464-bc4b-410d-95e4-e4b3c01e0337.ab1dbf01-62b3-45b3-a908-b796f7ce8615 is being set with open permissions: ugo+rw
Jul 02 20:01:01 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-901f255a-8a51-40cd-b7b3-3f14d1542f06 tempest-VolumesSnapshotNegativeTestJSON-206039503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-5fb37464-bc4b-410d-95e4-e4b3c01e0337.ab1dbf01-62b3-45b3-a908-b796f7ce8615 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:01:01 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-1c48a97d-f54a-42b4-a253-2233f1ab409f tempest-CreateVolumesFromSnapshotTest-737681603 None] Acquiring lock "cinder-62432256-2156-4f57-8526-cac3feff5d22-delete_volume" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 20:01:01 devstack sudo[104328]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-5fb37464-bc4b-410d-95e4-e4b3c01e0337.ab1dbf01-62b3-45b3-a908-b796f7ce8615
Jul 02 20:01:01 devstack sudo[104328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:01:01 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-1c48a97d-f54a-42b4-a253-2233f1ab409f tempest-CreateVolumesFromSnapshotTest-737681603 None] Lock "cinder-62432256-2156-4f57-8526-cac3feff5d22-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 20:01:01 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-1c48a97d-f54a-42b4-a253-2233f1ab409f tempest-CreateVolumesFromSnapshotTest-737681603 None] Acquiring lock "cinder-quobyte-62432256-2156-4f57-8526-cac3feff5d22" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 20:01:01 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-1c48a97d-f54a-42b4-a253-2233f1ab409f tempest-CreateVolumesFromSnapshotTest-737681603 None] Lock "cinder-quobyte-62432256-2156-4f57-8526-cac3feff5d22" acquired by "delete_volume" :: waited 0.031s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 20:01:01 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[0af00479-2a6d-413f-87f0-5382ab1f1ebf]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 20:01:01 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-1c48a97d-f54a-42b4-a253-2233f1ab409f tempest-CreateVolumesFromSnapshotTest-737681603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-62432256-2156-4f57-8526-cac3feff5d22 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:01:02 devstack sudo[104330]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-62432256-2156-4f57-8526-cac3feff5d22
Jul 02 20:01:02 devstack sudo[104330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:01:02 devstack sudo[104322]: pam_unix(sudo:session): session closed for user root
Jul 02 20:01:02 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-eb2f177e-b572-478c-ac3b-8ea1cd3c858e tempest-CreateVolumesFromSnapshotTest-737681603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e" returned: 0 in 0.857s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:01:02 devstack cinder-volume[86639]: DEBUG cinder.manager [None req-eb2f177e-b572-478c-ac3b-8ea1cd3c858e tempest-CreateVolumesFromSnapshotTest-737681603 None] Notifying Schedulers of capabilities ... {{(pid=86639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 20:01:02 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-eb2f177e-b572-478c-ac3b-8ea1cd3c858e tempest-CreateVolumesFromSnapshotTest-737681603 None] Deleted volume successfully.
Jul 02 20:01:02 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-eb2f177e-b572-478c-ac3b-8ea1cd3c858e tempest-CreateVolumesFromSnapshotTest-737681603 None] Lock "cinder-8dadf6f6-0669-4930-bb6c-11406996cb24-delete_volume" released by "delete_volume" :: held 2.847s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 20:01:02 devstack sudo[104328]: pam_unix(sudo:session): session closed for user root
Jul 02 20:01:02 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-901f255a-8a51-40cd-b7b3-3f14d1542f06 tempest-VolumesSnapshotNegativeTestJSON-206039503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-5fb37464-bc4b-410d-95e4-e4b3c01e0337.ab1dbf01-62b3-45b3-a908-b796f7ce8615" returned: 0 in 0.843s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:01:02 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-901f255a-8a51-40cd-b7b3-3f14d1542f06 tempest-VolumesSnapshotNegativeTestJSON-206039503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-5fb37464-bc4b-410d-95e4-e4b3c01e0337.info {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:01:02 devstack sudo[104334]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-5fb37464-bc4b-410d-95e4-e4b3c01e0337.info
Jul 02 20:01:02 devstack sudo[104334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:01:02 devstack sudo[104330]: pam_unix(sudo:session): session closed for user root
Jul 02 20:01:02 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-1c48a97d-f54a-42b4-a253-2233f1ab409f tempest-CreateVolumesFromSnapshotTest-737681603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-62432256-2156-4f57-8526-cac3feff5d22" returned: 0 in 1.031s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:01:02 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-1c48a97d-f54a-42b4-a253-2233f1ab409f tempest-CreateVolumesFromSnapshotTest-737681603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-62432256-2156-4f57-8526-cac3feff5d22 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:01:02 devstack sudo[104339]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-62432256-2156-4f57-8526-cac3feff5d22
Jul 02 20:01:02 devstack sudo[104339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:01:03 devstack sudo[104334]: pam_unix(sudo:session): session closed for user root
Jul 02 20:01:03 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-901f255a-8a51-40cd-b7b3-3f14d1542f06 tempest-VolumesSnapshotNegativeTestJSON-206039503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-5fb37464-bc4b-410d-95e4-e4b3c01e0337.info" returned: 0 in 0.659s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:01:03 devstack cinder-volume[86639]: WARNING cinder.volume.drivers.remotefs [None req-901f255a-8a51-40cd-b7b3-3f14d1542f06 tempest-VolumesSnapshotNegativeTestJSON-206039503 None] /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-5fb37464-bc4b-410d-95e4-e4b3c01e0337.info is being set with open permissions: ugo+rw
Jul 02 20:01:03 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-901f255a-8a51-40cd-b7b3-3f14d1542f06 tempest-VolumesSnapshotNegativeTestJSON-206039503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-5fb37464-bc4b-410d-95e4-e4b3c01e0337.info {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:01:03 devstack sudo[104342]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-5fb37464-bc4b-410d-95e4-e4b3c01e0337.info
Jul 02 20:01:03 devstack sudo[104342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:01:03 devstack sudo[104339]: pam_unix(sudo:session): session closed for user root
Jul 02 20:01:03 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-1c48a97d-f54a-42b4-a253-2233f1ab409f tempest-CreateVolumesFromSnapshotTest-737681603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-62432256-2156-4f57-8526-cac3feff5d22" returned: 0 in 0.789s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:01:03 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-1c48a97d-f54a-42b4-a253-2233f1ab409f tempest-CreateVolumesFromSnapshotTest-737681603 None] Lock "cinder-quobyte-62432256-2156-4f57-8526-cac3feff5d22" released by "delete_volume" :: held 1.877s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 20:01:03 devstack cinder-volume[86639]: DEBUG cinder.quota [None req-1c48a97d-f54a-42b4-a253-2233f1ab409f tempest-CreateVolumesFromSnapshotTest-737681603 None] Created reservations ['bfe7c7f9-afd8-4d30-81cf-81761b498997', 'e3fcd56a-e62c-4422-a12e-299b0b70545a', 'f65ceee1-986b-4273-9e3b-cea33aec32d9', '600674c3-066f-4275-8508-93e7b524b161'] {{(pid=86639) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 20:01:03 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-1c48a97d-f54a-42b4-a253-2233f1ab409f tempest-CreateVolumesFromSnapshotTest-737681603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 20:01:03 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-1c48a97d-f54a-42b4-a253-2233f1ab409f tempest-CreateVolumesFromSnapshotTest-737681603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 20:01:03 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-1c48a97d-f54a-42b4-a253-2233f1ab409f tempest-CreateVolumesFromSnapshotTest-737681603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 20:01:03 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-1c48a97d-f54a-42b4-a253-2233f1ab409f tempest-CreateVolumesFromSnapshotTest-737681603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 20:01:03 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-1c48a97d-f54a-42b4-a253-2233f1ab409f tempest-CreateVolumesFromSnapshotTest-737681603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 20:01:03 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-1c48a97d-f54a-42b4-a253-2233f1ab409f tempest-CreateVolumesFromSnapshotTest-737681603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:01:03 devstack sudo[104342]: pam_unix(sudo:session): session closed for user root
Jul 02 20:01:03 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-901f255a-8a51-40cd-b7b3-3f14d1542f06 tempest-VolumesSnapshotNegativeTestJSON-206039503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-5fb37464-bc4b-410d-95e4-e4b3c01e0337.info" returned: 0 in 0.660s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:01:03 devstack sudo[104346]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e
Jul 02 20:01:03 devstack sudo[104346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:01:03 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-901f255a-8a51-40cd-b7b3-3f14d1542f06 tempest-VolumesSnapshotNegativeTestJSON-206039503 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.181s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 20:01:04 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-901f255a-8a51-40cd-b7b3-3f14d1542f06 tempest-VolumesSnapshotNegativeTestJSON-206039503 None] Create snapshot completed successfully
Jul 02 20:01:04 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-976c8192-102b-4cba-beba-bff3487cfa2b tempest-CreateVolumesFromSnapshotTest-737681603 None] Acquiring lock "cinder-7a2f38a8-7ff8-494a-86bf-629e6364271a-delete_volume" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 20:01:04 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-976c8192-102b-4cba-beba-bff3487cfa2b tempest-CreateVolumesFromSnapshotTest-737681603 None] Lock "cinder-7a2f38a8-7ff8-494a-86bf-629e6364271a-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 20:01:04 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-976c8192-102b-4cba-beba-bff3487cfa2b tempest-CreateVolumesFromSnapshotTest-737681603 None] Acquiring lock "cinder-quobyte-7a2f38a8-7ff8-494a-86bf-629e6364271a" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 20:01:04 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-976c8192-102b-4cba-beba-bff3487cfa2b tempest-CreateVolumesFromSnapshotTest-737681603 None] Lock "cinder-quobyte-7a2f38a8-7ff8-494a-86bf-629e6364271a" acquired by "delete_volume" :: waited 0.018s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 20:01:04 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[0463af1d-62d3-4279-8a90-5ef6ba5b3e6d]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 20:01:04 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-976c8192-102b-4cba-beba-bff3487cfa2b tempest-CreateVolumesFromSnapshotTest-737681603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-7a2f38a8-7ff8-494a-86bf-629e6364271a {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:01:04 devstack sudo[104349]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-7a2f38a8-7ff8-494a-86bf-629e6364271a
Jul 02 20:01:04 devstack sudo[104349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:01:04 devstack sudo[104346]: pam_unix(sudo:session): session closed for user root
Jul 02 20:01:04 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-1c48a97d-f54a-42b4-a253-2233f1ab409f tempest-CreateVolumesFromSnapshotTest-737681603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e" returned: 0 in 0.712s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:01:04 devstack cinder-volume[86639]: DEBUG cinder.manager [None req-1c48a97d-f54a-42b4-a253-2233f1ab409f tempest-CreateVolumesFromSnapshotTest-737681603 None] Notifying Schedulers of capabilities ... {{(pid=86639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 20:01:04 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-1c48a97d-f54a-42b4-a253-2233f1ab409f tempest-CreateVolumesFromSnapshotTest-737681603 None] Deleted volume successfully.
Jul 02 20:01:04 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-1c48a97d-f54a-42b4-a253-2233f1ab409f tempest-CreateVolumesFromSnapshotTest-737681603 None] Lock "cinder-62432256-2156-4f57-8526-cac3feff5d22-delete_volume" released by "delete_volume" :: held 2.897s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 20:01:04 devstack sudo[104349]: pam_unix(sudo:session): session closed for user root
Jul 02 20:01:04 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-976c8192-102b-4cba-beba-bff3487cfa2b tempest-CreateVolumesFromSnapshotTest-737681603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-7a2f38a8-7ff8-494a-86bf-629e6364271a" returned: 0 in 0.780s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:01:04 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-976c8192-102b-4cba-beba-bff3487cfa2b tempest-CreateVolumesFromSnapshotTest-737681603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-7a2f38a8-7ff8-494a-86bf-629e6364271a {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:01:05 devstack sudo[104355]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-7a2f38a8-7ff8-494a-86bf-629e6364271a
Jul 02 20:01:05 devstack sudo[104355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:01:05 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-34046c77-7312-4f17-bb9f-76e1a278542e tempest-VolumesSnapshotNegativeTestJSON-206039503 None] Acquiring lock "cinder-ab1dbf01-62b3-45b3-a908-b796f7ce8615-delete_snapshot" by "delete_snapshot" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 20:01:05 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-34046c77-7312-4f17-bb9f-76e1a278542e tempest-VolumesSnapshotNegativeTestJSON-206039503 None] Lock "cinder-ab1dbf01-62b3-45b3-a908-b796f7ce8615-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 20:01:05 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-34046c77-7312-4f17-bb9f-76e1a278542e tempest-VolumesSnapshotNegativeTestJSON-206039503 None] Acquiring lock "cinder-quobyte-5fb37464-bc4b-410d-95e4-e4b3c01e0337" by "delete_snapshot" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 20:01:05 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-34046c77-7312-4f17-bb9f-76e1a278542e tempest-VolumesSnapshotNegativeTestJSON-206039503 None] Lock "cinder-quobyte-5fb37464-bc4b-410d-95e4-e4b3c01e0337" acquired by "delete_snapshot" :: waited 0.038s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 20:01:05 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-34046c77-7312-4f17-bb9f-76e1a278542e tempest-VolumesSnapshotNegativeTestJSON-206039503 None] Acquiring lock "cinder-quobyte-ab1dbf01-62b3-45b3-a908-b796f7ce8615" by "_delete_snapshot" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 20:01:05 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-34046c77-7312-4f17-bb9f-76e1a278542e tempest-VolumesSnapshotNegativeTestJSON-206039503 None] Lock "cinder-quobyte-ab1dbf01-62b3-45b3-a908-b796f7ce8615" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 20:01:05 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-34046c77-7312-4f17-bb9f-76e1a278542e tempest-VolumesSnapshotNegativeTestJSON-206039503 None] Deleting offline snapshot ab1dbf01-62b3-45b3-a908-b796f7ce8615 of volume 5fb37464-bc4b-410d-95e4-e4b3c01e0337 {{(pid=86639) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 02 20:01:05 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-34046c77-7312-4f17-bb9f-76e1a278542e tempest-VolumesSnapshotNegativeTestJSON-206039503 None] snapshot_file for this snap is: volume-5fb37464-bc4b-410d-95e4-e4b3c01e0337.ab1dbf01-62b3-45b3-a908-b796f7ce8615 {{(pid=86639) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 02 20:01:05 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[799e420c-37ac-450e-8ad9-b129c2b5aa00]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 20:01:05 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-34046c77-7312-4f17-bb9f-76e1a278542e tempest-VolumesSnapshotNegativeTestJSON-206039503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-5fb37464-bc4b-410d-95e4-e4b3c01e0337.ab1dbf01-62b3-45b3-a908-b796f7ce8615 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:01:05 devstack sudo[104357]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-5fb37464-bc4b-410d-95e4-e4b3c01e0337.ab1dbf01-62b3-45b3-a908-b796f7ce8615
Jul 02 20:01:05 devstack sudo[104357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:01:05 devstack sudo[104355]: pam_unix(sudo:session): session closed for user root
Jul 02 20:01:05 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-976c8192-102b-4cba-beba-bff3487cfa2b tempest-CreateVolumesFromSnapshotTest-737681603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-7a2f38a8-7ff8-494a-86bf-629e6364271a" returned: 0 in 0.670s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:01:05 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-976c8192-102b-4cba-beba-bff3487cfa2b tempest-CreateVolumesFromSnapshotTest-737681603 None] Lock "cinder-quobyte-7a2f38a8-7ff8-494a-86bf-629e6364271a" released by "delete_volume" :: held 1.506s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 20:01:05 devstack cinder-volume[86639]: DEBUG cinder.quota [None req-976c8192-102b-4cba-beba-bff3487cfa2b tempest-CreateVolumesFromSnapshotTest-737681603 None] Created reservations ['1c02ad34-344e-4736-8255-8995db138d86', '2364a20f-2c91-4028-a225-584229ca82c7', '61306329-7c24-4b0f-abc0-5454c4c970d7', 'e2a8ff54-e990-4288-bccc-69107c3b68d8'] {{(pid=86639) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 20:01:05 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-976c8192-102b-4cba-beba-bff3487cfa2b tempest-CreateVolumesFromSnapshotTest-737681603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 20:01:05 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-976c8192-102b-4cba-beba-bff3487cfa2b tempest-CreateVolumesFromSnapshotTest-737681603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 20:01:05 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-976c8192-102b-4cba-beba-bff3487cfa2b tempest-CreateVolumesFromSnapshotTest-737681603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 20:01:05 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-976c8192-102b-4cba-beba-bff3487cfa2b tempest-CreateVolumesFromSnapshotTest-737681603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 20:01:05 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-976c8192-102b-4cba-beba-bff3487cfa2b tempest-CreateVolumesFromSnapshotTest-737681603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 20:01:05 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-976c8192-102b-4cba-beba-bff3487cfa2b tempest-CreateVolumesFromSnapshotTest-737681603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:01:05 devstack sudo[104360]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e
Jul 02 20:01:05 devstack sudo[104360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:01:06 devstack sudo[104357]: pam_unix(sudo:session): session closed for user root
Jul 02 20:01:06 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-34046c77-7312-4f17-bb9f-76e1a278542e tempest-VolumesSnapshotNegativeTestJSON-206039503 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-5fb37464-bc4b-410d-95e4-e4b3c01e0337.ab1dbf01-62b3-45b3-a908-b796f7ce8615" returned: 0 in 0.974s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:01:06 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-34046c77-7312-4f17-bb9f-76e1a278542e tempest-VolumesSnapshotNegativeTestJSON-206039503 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5fb37464-bc4b-410d-95e4-e4b3c01e0337(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86639) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 02 20:01:06 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-98946428-5b16-428c-9f86-906337ba6bdb tempest-CreateVolumesFromSnapshotTest-737681603 None] Acquiring lock "cinder-d84f2d4b-95f8-4829-8149-514a01b57b43-delete_volume" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 20:01:06 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[8622b9a6-794e-49a4-86b8-7eac2d5c2816]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 20:01:06 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-98946428-5b16-428c-9f86-906337ba6bdb tempest-CreateVolumesFromSnapshotTest-737681603 None] Lock "cinder-d84f2d4b-95f8-4829-8149-514a01b57b43-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 20:01:06 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-34046c77-7312-4f17-bb9f-76e1a278542e tempest-VolumesSnapshotNegativeTestJSON-206039503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-5fb37464-bc4b-410d-95e4-e4b3c01e0337 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:01:06 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-98946428-5b16-428c-9f86-906337ba6bdb tempest-CreateVolumesFromSnapshotTest-737681603 None] Acquiring lock "cinder-quobyte-d84f2d4b-95f8-4829-8149-514a01b57b43" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 20:01:06 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-98946428-5b16-428c-9f86-906337ba6bdb tempest-CreateVolumesFromSnapshotTest-737681603 None] Lock "cinder-quobyte-d84f2d4b-95f8-4829-8149-514a01b57b43" acquired by "delete_volume" :: waited 0.030s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 20:01:06 devstack sudo[104360]: pam_unix(sudo:session): session closed for user root
Jul 02 20:01:06 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-976c8192-102b-4cba-beba-bff3487cfa2b tempest-CreateVolumesFromSnapshotTest-737681603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e" returned: 0 in 0.758s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:01:06 devstack cinder-volume[86639]: DEBUG cinder.manager [None req-976c8192-102b-4cba-beba-bff3487cfa2b tempest-CreateVolumesFromSnapshotTest-737681603 None] Notifying Schedulers of capabilities ... {{(pid=86639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 20:01:06 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-976c8192-102b-4cba-beba-bff3487cfa2b tempest-CreateVolumesFromSnapshotTest-737681603 None] Deleted volume successfully.
Jul 02 20:01:06 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[243a7060-8225-46ad-88c0-e6f1ad5f1c12]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 20:01:06 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-98946428-5b16-428c-9f86-906337ba6bdb tempest-CreateVolumesFromSnapshotTest-737681603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-d84f2d4b-95f8-4829-8149-514a01b57b43 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:01:06 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-976c8192-102b-4cba-beba-bff3487cfa2b tempest-CreateVolumesFromSnapshotTest-737681603 None] Lock "cinder-7a2f38a8-7ff8-494a-86bf-629e6364271a-delete_volume" released by "delete_volume" :: held 2.509s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 20:01:06 devstack sudo[104366]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-5fb37464-bc4b-410d-95e4-e4b3c01e0337
Jul 02 20:01:06 devstack sudo[104366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:01:06 devstack sudo[104367]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-d84f2d4b-95f8-4829-8149-514a01b57b43
Jul 02 20:01:06 devstack sudo[104367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:01:07 devstack sudo[104367]: pam_unix(sudo:session): session closed for user root
Jul 02 20:01:07 devstack sudo[104366]: pam_unix(sudo:session): session closed for user root
Jul 02 20:01:07 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-98946428-5b16-428c-9f86-906337ba6bdb tempest-CreateVolumesFromSnapshotTest-737681603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-d84f2d4b-95f8-4829-8149-514a01b57b43" returned: 0 in 0.965s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:01:07 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-98946428-5b16-428c-9f86-906337ba6bdb tempest-CreateVolumesFromSnapshotTest-737681603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-d84f2d4b-95f8-4829-8149-514a01b57b43 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:01:07 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-34046c77-7312-4f17-bb9f-76e1a278542e tempest-VolumesSnapshotNegativeTestJSON-206039503 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-5fb37464-bc4b-410d-95e4-e4b3c01e0337" returned: 0 in 1.102s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:01:07 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-34046c77-7312-4f17-bb9f-76e1a278542e tempest-VolumesSnapshotNegativeTestJSON-206039503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-5fb37464-bc4b-410d-95e4-e4b3c01e0337.ab1dbf01-62b3-45b3-a908-b796f7ce8615 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:01:07 devstack sudo[104476]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-d84f2d4b-95f8-4829-8149-514a01b57b43
Jul 02 20:01:07 devstack sudo[104476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:01:07 devstack sudo[104477]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-5fb37464-bc4b-410d-95e4-e4b3c01e0337.ab1dbf01-62b3-45b3-a908-b796f7ce8615
Jul 02 20:01:07 devstack sudo[104477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:01:08 devstack sudo[104476]: pam_unix(sudo:session): session closed for user root
Jul 02 20:01:08 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-98946428-5b16-428c-9f86-906337ba6bdb tempest-CreateVolumesFromSnapshotTest-737681603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-d84f2d4b-95f8-4829-8149-514a01b57b43" returned: 0 in 0.728s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:01:08 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-98946428-5b16-428c-9f86-906337ba6bdb tempest-CreateVolumesFromSnapshotTest-737681603 None] Lock "cinder-quobyte-d84f2d4b-95f8-4829-8149-514a01b57b43" released by "delete_volume" :: held 1.744s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 20:01:08 devstack cinder-volume[86639]: DEBUG cinder.quota [None req-98946428-5b16-428c-9f86-906337ba6bdb tempest-CreateVolumesFromSnapshotTest-737681603 None] Created reservations ['38aa479a-3b38-4ae2-b270-85409d0ec335', '45d065b0-5109-4d03-be36-089bf75576c3', 'dc083b2e-5357-4fe8-a672-5a557f37a631', '6ea3b36f-a7ec-46d8-875d-f79f597b8f13'] {{(pid=86639) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 20:01:08 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-98946428-5b16-428c-9f86-906337ba6bdb tempest-CreateVolumesFromSnapshotTest-737681603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 20:01:08 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-98946428-5b16-428c-9f86-906337ba6bdb tempest-CreateVolumesFromSnapshotTest-737681603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 20:01:08 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-98946428-5b16-428c-9f86-906337ba6bdb tempest-CreateVolumesFromSnapshotTest-737681603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 20:01:08 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-98946428-5b16-428c-9f86-906337ba6bdb tempest-CreateVolumesFromSnapshotTest-737681603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 20:01:08 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-98946428-5b16-428c-9f86-906337ba6bdb tempest-CreateVolumesFromSnapshotTest-737681603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 20:01:08 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-98946428-5b16-428c-9f86-906337ba6bdb tempest-CreateVolumesFromSnapshotTest-737681603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:01:08 devstack sudo[104477]: pam_unix(sudo:session): session closed for user root
Jul 02 20:01:08 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-34046c77-7312-4f17-bb9f-76e1a278542e tempest-VolumesSnapshotNegativeTestJSON-206039503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-5fb37464-bc4b-410d-95e4-e4b3c01e0337.ab1dbf01-62b3-45b3-a908-b796f7ce8615" returned: 0 in 0.894s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:01:08 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-34046c77-7312-4f17-bb9f-76e1a278542e tempest-VolumesSnapshotNegativeTestJSON-206039503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-5fb37464-bc4b-410d-95e4-e4b3c01e0337.ab1dbf01-62b3-45b3-a908-b796f7ce8615 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:01:08 devstack sudo[104485]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e
Jul 02 20:01:08 devstack sudo[104485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:01:08 devstack sudo[104486]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-5fb37464-bc4b-410d-95e4-e4b3c01e0337.ab1dbf01-62b3-45b3-a908-b796f7ce8615
Jul 02 20:01:08 devstack sudo[104486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:01:08 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-5264be06-e164-40be-8a6f-4b58c5554ec4 tempest-CreateVolumesFromSnapshotTest-737681603 None] Acquiring lock "cinder-acc694d1-c6de-4ce3-b648-4dddaa601536-delete_snapshot" by "delete_snapshot" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 20:01:08 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-5264be06-e164-40be-8a6f-4b58c5554ec4 tempest-CreateVolumesFromSnapshotTest-737681603 None] Lock "cinder-acc694d1-c6de-4ce3-b648-4dddaa601536-delete_snapshot" acquired by "delete_snapshot" :: waited 0.043s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 20:01:08 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-5264be06-e164-40be-8a6f-4b58c5554ec4 tempest-CreateVolumesFromSnapshotTest-737681603 None] Acquiring lock "cinder-quobyte-cf3a8616-b2fc-4a08-9427-5a2f10e84383" by "delete_snapshot" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 20:01:08 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-5264be06-e164-40be-8a6f-4b58c5554ec4 tempest-CreateVolumesFromSnapshotTest-737681603 None] Lock "cinder-quobyte-cf3a8616-b2fc-4a08-9427-5a2f10e84383" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 20:01:08 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-5264be06-e164-40be-8a6f-4b58c5554ec4 tempest-CreateVolumesFromSnapshotTest-737681603 None] Acquiring lock "cinder-quobyte-acc694d1-c6de-4ce3-b648-4dddaa601536" by "_delete_snapshot" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 20:01:08 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-5264be06-e164-40be-8a6f-4b58c5554ec4 tempest-CreateVolumesFromSnapshotTest-737681603 None] Lock "cinder-quobyte-acc694d1-c6de-4ce3-b648-4dddaa601536" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 20:01:08 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-5264be06-e164-40be-8a6f-4b58c5554ec4 tempest-CreateVolumesFromSnapshotTest-737681603 None] Deleting offline snapshot acc694d1-c6de-4ce3-b648-4dddaa601536 of volume cf3a8616-b2fc-4a08-9427-5a2f10e84383 {{(pid=86639) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 02 20:01:08 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-5264be06-e164-40be-8a6f-4b58c5554ec4 tempest-CreateVolumesFromSnapshotTest-737681603 None] snapshot_file for this snap is: volume-cf3a8616-b2fc-4a08-9427-5a2f10e84383.acc694d1-c6de-4ce3-b648-4dddaa601536 {{(pid=86639) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 02 20:01:08 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee463e0d-4e98-492b-b869-a3b5ae4be9c0]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 20:01:08 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-5264be06-e164-40be-8a6f-4b58c5554ec4 tempest-CreateVolumesFromSnapshotTest-737681603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-cf3a8616-b2fc-4a08-9427-5a2f10e84383.acc694d1-c6de-4ce3-b648-4dddaa601536 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:01:08 devstack sudo[104489]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-cf3a8616-b2fc-4a08-9427-5a2f10e84383.acc694d1-c6de-4ce3-b648-4dddaa601536
Jul 02 20:01:08 devstack sudo[104489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:01:09 devstack sudo[104485]: pam_unix(sudo:session): session closed for user root
Jul 02 20:01:09 devstack sudo[104486]: pam_unix(sudo:session): session closed for user root
Jul 02 20:01:09 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-98946428-5b16-428c-9f86-906337ba6bdb tempest-CreateVolumesFromSnapshotTest-737681603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e" returned: 0 in 0.703s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:01:09 devstack cinder-volume[86639]: DEBUG cinder.manager [None req-98946428-5b16-428c-9f86-906337ba6bdb tempest-CreateVolumesFromSnapshotTest-737681603 None] Notifying Schedulers of capabilities ... {{(pid=86639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 20:01:09 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-34046c77-7312-4f17-bb9f-76e1a278542e tempest-VolumesSnapshotNegativeTestJSON-206039503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-5fb37464-bc4b-410d-95e4-e4b3c01e0337.ab1dbf01-62b3-45b3-a908-b796f7ce8615" returned: 0 in 0.690s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:01:09 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-98946428-5b16-428c-9f86-906337ba6bdb tempest-CreateVolumesFromSnapshotTest-737681603 None] Deleted volume successfully.
Jul 02 20:01:09 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-34046c77-7312-4f17-bb9f-76e1a278542e tempest-VolumesSnapshotNegativeTestJSON-206039503 None] Lock "cinder-quobyte-ab1dbf01-62b3-45b3-a908-b796f7ce8615" released by "_delete_snapshot" :: held 3.832s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 20:01:09 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-34046c77-7312-4f17-bb9f-76e1a278542e tempest-VolumesSnapshotNegativeTestJSON-206039503 None] Lock "cinder-quobyte-5fb37464-bc4b-410d-95e4-e4b3c01e0337" released by "delete_snapshot" :: held 3.860s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 20:01:09 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-98946428-5b16-428c-9f86-906337ba6bdb tempest-CreateVolumesFromSnapshotTest-737681603 None] Lock "cinder-d84f2d4b-95f8-4829-8149-514a01b57b43-delete_volume" released by "delete_volume" :: held 2.765s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 20:01:09 devstack cinder-volume[86639]: DEBUG cinder.quota [None req-34046c77-7312-4f17-bb9f-76e1a278542e tempest-VolumesSnapshotNegativeTestJSON-206039503 None] Created reservations ['b1cad158-e9f3-45e1-bc68-700bcebff35b', '45316115-6b04-4a65-9455-33b3879460ae', 'ee283f61-9ff5-4358-847c-90c585b327a7', '6d8a6763-086a-4048-b493-085ac13558f0'] {{(pid=86639) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 20:01:09 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-34046c77-7312-4f17-bb9f-76e1a278542e tempest-VolumesSnapshotNegativeTestJSON-206039503 None] Delete snapshot completed successfully.
Jul 02 20:01:09 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-34046c77-7312-4f17-bb9f-76e1a278542e tempest-VolumesSnapshotNegativeTestJSON-206039503 None] Lock "cinder-ab1dbf01-62b3-45b3-a908-b796f7ce8615-delete_snapshot" released by "delete_snapshot" :: held 4.041s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 20:01:09 devstack sudo[104489]: pam_unix(sudo:session): session closed for user root
Jul 02 20:01:09 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-5264be06-e164-40be-8a6f-4b58c5554ec4 tempest-CreateVolumesFromSnapshotTest-737681603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-cf3a8616-b2fc-4a08-9427-5a2f10e84383.acc694d1-c6de-4ce3-b648-4dddaa601536" returned: 0 in 0.806s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:01:09 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-5264be06-e164-40be-8a6f-4b58c5554ec4 tempest-CreateVolumesFromSnapshotTest-737681603 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cf3a8616-b2fc-4a08-9427-5a2f10e84383(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86639) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 02 20:01:09 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-71647021-735a-4ac7-ad72-3ea90a3a2add tempest-VolumesSnapshotNegativeTestJSON-206039503 None] Acquiring lock "cinder-5fb37464-bc4b-410d-95e4-e4b3c01e0337-delete_volume" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 20:01:09 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[280e0f61-f1a7-436e-ba4c-c1435272a2b5]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 20:01:09 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-5264be06-e164-40be-8a6f-4b58c5554ec4 tempest-CreateVolumesFromSnapshotTest-737681603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-cf3a8616-b2fc-4a08-9427-5a2f10e84383 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:01:09 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-71647021-735a-4ac7-ad72-3ea90a3a2add tempest-VolumesSnapshotNegativeTestJSON-206039503 None] Lock "cinder-5fb37464-bc4b-410d-95e4-e4b3c01e0337-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 20:01:09 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-71647021-735a-4ac7-ad72-3ea90a3a2add tempest-VolumesSnapshotNegativeTestJSON-206039503 None] Acquiring lock "cinder-quobyte-5fb37464-bc4b-410d-95e4-e4b3c01e0337" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 20:01:09 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-71647021-735a-4ac7-ad72-3ea90a3a2add tempest-VolumesSnapshotNegativeTestJSON-206039503 None] Lock "cinder-quobyte-5fb37464-bc4b-410d-95e4-e4b3c01e0337" acquired by "delete_volume" :: waited 0.019s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 20:01:09 devstack sudo[104496]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-cf3a8616-b2fc-4a08-9427-5a2f10e84383
Jul 02 20:01:09 devstack sudo[104496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:01:09 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[2881d18e-ea74-4c52-aee3-b8976591bbc3]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 20:01:09 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-71647021-735a-4ac7-ad72-3ea90a3a2add tempest-VolumesSnapshotNegativeTestJSON-206039503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-5fb37464-bc4b-410d-95e4-e4b3c01e0337 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:01:09 devstack sudo[104498]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-5fb37464-bc4b-410d-95e4-e4b3c01e0337
Jul 02 20:01:09 devstack sudo[104498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:01:10 devstack sudo[104496]: pam_unix(sudo:session): session closed for user root
Jul 02 20:01:10 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-5264be06-e164-40be-8a6f-4b58c5554ec4 tempest-CreateVolumesFromSnapshotTest-737681603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-cf3a8616-b2fc-4a08-9427-5a2f10e84383" returned: 0 in 0.892s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:01:10 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-5264be06-e164-40be-8a6f-4b58c5554ec4 tempest-CreateVolumesFromSnapshotTest-737681603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-cf3a8616-b2fc-4a08-9427-5a2f10e84383.acc694d1-c6de-4ce3-b648-4dddaa601536 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:01:10 devstack sudo[104506]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-cf3a8616-b2fc-4a08-9427-5a2f10e84383.acc694d1-c6de-4ce3-b648-4dddaa601536
Jul 02 20:01:10 devstack sudo[104506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:01:10 devstack sudo[104498]: pam_unix(sudo:session): session closed for user root
Jul 02 20:01:10 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-71647021-735a-4ac7-ad72-3ea90a3a2add tempest-VolumesSnapshotNegativeTestJSON-206039503 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-5fb37464-bc4b-410d-95e4-e4b3c01e0337" returned: 0 in 0.804s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:01:10 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-71647021-735a-4ac7-ad72-3ea90a3a2add tempest-VolumesSnapshotNegativeTestJSON-206039503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-5fb37464-bc4b-410d-95e4-e4b3c01e0337 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:01:10 devstack sudo[104508]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-5fb37464-bc4b-410d-95e4-e4b3c01e0337
Jul 02 20:01:10 devstack sudo[104508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:01:11 devstack sudo[104508]: pam_unix(sudo:session): session closed for user root
Jul 02 20:01:11 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-71647021-735a-4ac7-ad72-3ea90a3a2add tempest-VolumesSnapshotNegativeTestJSON-206039503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-5fb37464-bc4b-410d-95e4-e4b3c01e0337" returned: 0 in 0.723s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:01:11 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-71647021-735a-4ac7-ad72-3ea90a3a2add tempest-VolumesSnapshotNegativeTestJSON-206039503 None] Lock "cinder-quobyte-5fb37464-bc4b-410d-95e4-e4b3c01e0337" released by "delete_volume" :: held 1.621s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 20:01:11 devstack sudo[104506]: pam_unix(sudo:session): session closed for user root
Jul 02 20:01:11 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-5264be06-e164-40be-8a6f-4b58c5554ec4 tempest-CreateVolumesFromSnapshotTest-737681603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-cf3a8616-b2fc-4a08-9427-5a2f10e84383.acc694d1-c6de-4ce3-b648-4dddaa601536" returned: 0 in 0.808s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:01:11 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-5264be06-e164-40be-8a6f-4b58c5554ec4 tempest-CreateVolumesFromSnapshotTest-737681603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-cf3a8616-b2fc-4a08-9427-5a2f10e84383.acc694d1-c6de-4ce3-b648-4dddaa601536 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:01:11 devstack sudo[104514]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-cf3a8616-b2fc-4a08-9427-5a2f10e84383.acc694d1-c6de-4ce3-b648-4dddaa601536
Jul 02 20:01:11 devstack sudo[104514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:01:11 devstack cinder-volume[86639]: DEBUG cinder.quota [None req-71647021-735a-4ac7-ad72-3ea90a3a2add tempest-VolumesSnapshotNegativeTestJSON-206039503 None] Created reservations ['68772280-c22c-4101-9d72-144780679e2b', 'ca8e9bdc-2497-4bbe-bf29-8de11330c1f5', '4df14e3a-5dba-4ae4-bc30-5f3e435c5ead', '42d116ec-186b-4844-9eca-1d8a98570ca4'] {{(pid=86639) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 20:01:11 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-71647021-735a-4ac7-ad72-3ea90a3a2add tempest-VolumesSnapshotNegativeTestJSON-206039503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 20:01:11 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-71647021-735a-4ac7-ad72-3ea90a3a2add tempest-VolumesSnapshotNegativeTestJSON-206039503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 20:01:11 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-71647021-735a-4ac7-ad72-3ea90a3a2add tempest-VolumesSnapshotNegativeTestJSON-206039503 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 20:01:11 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-71647021-735a-4ac7-ad72-3ea90a3a2add tempest-VolumesSnapshotNegativeTestJSON-206039503 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 20:01:11 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-71647021-735a-4ac7-ad72-3ea90a3a2add tempest-VolumesSnapshotNegativeTestJSON-206039503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 20:01:11 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-71647021-735a-4ac7-ad72-3ea90a3a2add tempest-VolumesSnapshotNegativeTestJSON-206039503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:01:11 devstack sudo[104516]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e
Jul 02 20:01:11 devstack sudo[104516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:01:12 devstack sudo[104514]: pam_unix(sudo:session): session closed for user root
Jul 02 20:01:12 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-5264be06-e164-40be-8a6f-4b58c5554ec4 tempest-CreateVolumesFromSnapshotTest-737681603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-cf3a8616-b2fc-4a08-9427-5a2f10e84383.acc694d1-c6de-4ce3-b648-4dddaa601536" returned: 0 in 0.735s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:01:12 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-5264be06-e164-40be-8a6f-4b58c5554ec4 tempest-CreateVolumesFromSnapshotTest-737681603 None] Lock "cinder-quobyte-acc694d1-c6de-4ce3-b648-4dddaa601536" released by "_delete_snapshot" :: held 3.387s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 20:01:12 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-5264be06-e164-40be-8a6f-4b58c5554ec4 tempest-CreateVolumesFromSnapshotTest-737681603 None] Lock "cinder-quobyte-cf3a8616-b2fc-4a08-9427-5a2f10e84383" released by "delete_snapshot" :: held 3.422s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 20:01:12 devstack cinder-volume[86639]: DEBUG cinder.quota [None req-5264be06-e164-40be-8a6f-4b58c5554ec4 tempest-CreateVolumesFromSnapshotTest-737681603 None] Created reservations ['16468399-53b9-4464-bfd6-fbceb2b54032', '5aa7a288-e20b-4718-9ed7-8766c0b04650', 'b0c6e7b5-2677-4fda-9745-dbc1f5f7507d', '89660c26-c2ae-47d0-8e42-f9b3a9cd0301'] {{(pid=86639) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 20:01:12 devstack sudo[104516]: pam_unix(sudo:session): session closed for user root
Jul 02 20:01:12 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-71647021-735a-4ac7-ad72-3ea90a3a2add tempest-VolumesSnapshotNegativeTestJSON-206039503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e" returned: 0 in 0.745s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:01:12 devstack cinder-volume[86639]: DEBUG cinder.manager [None req-71647021-735a-4ac7-ad72-3ea90a3a2add tempest-VolumesSnapshotNegativeTestJSON-206039503 None] Notifying Schedulers of capabilities ... {{(pid=86639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 20:01:12 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-71647021-735a-4ac7-ad72-3ea90a3a2add tempest-VolumesSnapshotNegativeTestJSON-206039503 None] Deleted volume successfully.
Jul 02 20:01:12 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-71647021-735a-4ac7-ad72-3ea90a3a2add tempest-VolumesSnapshotNegativeTestJSON-206039503 None] Lock "cinder-5fb37464-bc4b-410d-95e4-e4b3c01e0337-delete_volume" released by "delete_volume" :: held 2.638s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 20:01:12 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-5264be06-e164-40be-8a6f-4b58c5554ec4 tempest-CreateVolumesFromSnapshotTest-737681603 None] Delete snapshot completed successfully.
Jul 02 20:01:12 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-5264be06-e164-40be-8a6f-4b58c5554ec4 tempest-CreateVolumesFromSnapshotTest-737681603 None] Lock "cinder-acc694d1-c6de-4ce3-b648-4dddaa601536-delete_snapshot" released by "delete_snapshot" :: held 3.605s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 20:01:12 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-58143797-ebe2-45c4-910f-86c6721b244f tempest-CreateVolumesFromSnapshotTest-737681603 None] Acquiring lock "cinder-cf3a8616-b2fc-4a08-9427-5a2f10e84383-delete_volume" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 20:01:12 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-58143797-ebe2-45c4-910f-86c6721b244f tempest-CreateVolumesFromSnapshotTest-737681603 None] Lock "cinder-cf3a8616-b2fc-4a08-9427-5a2f10e84383-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 20:01:12 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-58143797-ebe2-45c4-910f-86c6721b244f tempest-CreateVolumesFromSnapshotTest-737681603 None] Acquiring lock "cinder-quobyte-cf3a8616-b2fc-4a08-9427-5a2f10e84383" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 20:01:13 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-58143797-ebe2-45c4-910f-86c6721b244f tempest-CreateVolumesFromSnapshotTest-737681603 None] Lock "cinder-quobyte-cf3a8616-b2fc-4a08-9427-5a2f10e84383" acquired by "delete_volume" :: waited 0.020s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 20:01:13 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[3672e2f8-7d1f-4e7a-9463-854c35583dd8]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 20:01:13 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-58143797-ebe2-45c4-910f-86c6721b244f tempest-CreateVolumesFromSnapshotTest-737681603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-cf3a8616-b2fc-4a08-9427-5a2f10e84383 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:01:13 devstack sudo[104520]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-cf3a8616-b2fc-4a08-9427-5a2f10e84383
Jul 02 20:01:13 devstack sudo[104520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:01:13 devstack sudo[104520]: pam_unix(sudo:session): session closed for user root
Jul 02 20:01:13 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-58143797-ebe2-45c4-910f-86c6721b244f tempest-CreateVolumesFromSnapshotTest-737681603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-cf3a8616-b2fc-4a08-9427-5a2f10e84383" returned: 0 in 0.879s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:01:13 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-58143797-ebe2-45c4-910f-86c6721b244f tempest-CreateVolumesFromSnapshotTest-737681603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-cf3a8616-b2fc-4a08-9427-5a2f10e84383 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:01:13 devstack sudo[104525]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-cf3a8616-b2fc-4a08-9427-5a2f10e84383
Jul 02 20:01:13 devstack sudo[104525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:01:14 devstack sudo[104525]: pam_unix(sudo:session): session closed for user root
Jul 02 20:01:14 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-58143797-ebe2-45c4-910f-86c6721b244f tempest-CreateVolumesFromSnapshotTest-737681603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-cf3a8616-b2fc-4a08-9427-5a2f10e84383" returned: 0 in 0.785s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:01:14 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-58143797-ebe2-45c4-910f-86c6721b244f tempest-CreateVolumesFromSnapshotTest-737681603 None] Lock "cinder-quobyte-cf3a8616-b2fc-4a08-9427-5a2f10e84383" released by "delete_volume" :: held 1.749s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 20:01:14 devstack cinder-volume[86639]: DEBUG cinder.quota [None req-58143797-ebe2-45c4-910f-86c6721b244f tempest-CreateVolumesFromSnapshotTest-737681603 None] Created reservations ['fad709df-a6c6-42aa-bd08-629cc46b96b8', 'fd86f672-b9fb-42a8-8c80-13c1c020cfc2', 'eef6519b-269b-40eb-879d-2f1f24770c25', '0d0fc4b5-346a-476d-9487-3c0bf7f551ea'] {{(pid=86639) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 20:01:14 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-58143797-ebe2-45c4-910f-86c6721b244f tempest-CreateVolumesFromSnapshotTest-737681603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 20:01:14 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-58143797-ebe2-45c4-910f-86c6721b244f tempest-CreateVolumesFromSnapshotTest-737681603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 20:01:14 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-58143797-ebe2-45c4-910f-86c6721b244f tempest-CreateVolumesFromSnapshotTest-737681603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 20:01:14 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-58143797-ebe2-45c4-910f-86c6721b244f tempest-CreateVolumesFromSnapshotTest-737681603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 20:01:14 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-58143797-ebe2-45c4-910f-86c6721b244f tempest-CreateVolumesFromSnapshotTest-737681603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 20:01:14 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-58143797-ebe2-45c4-910f-86c6721b244f tempest-CreateVolumesFromSnapshotTest-737681603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:01:15 devstack sudo[104529]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e
Jul 02 20:01:15 devstack sudo[104529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:01:16 devstack sudo[104529]: pam_unix(sudo:session): session closed for user root
Jul 02 20:01:16 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-58143797-ebe2-45c4-910f-86c6721b244f tempest-CreateVolumesFromSnapshotTest-737681603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e" returned: 0 in 1.108s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:01:16 devstack cinder-volume[86639]: DEBUG cinder.manager [None req-58143797-ebe2-45c4-910f-86c6721b244f tempest-CreateVolumesFromSnapshotTest-737681603 None] Notifying Schedulers of capabilities ... {{(pid=86639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 20:01:16 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-58143797-ebe2-45c4-910f-86c6721b244f tempest-CreateVolumesFromSnapshotTest-737681603 None] Deleted volume successfully.
Jul 02 20:01:16 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-58143797-ebe2-45c4-910f-86c6721b244f tempest-CreateVolumesFromSnapshotTest-737681603 None] Lock "cinder-cf3a8616-b2fc-4a08-9427-5a2f10e84383-delete_volume" released by "delete_volume" :: held 3.151s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 20:01:19 devstack cinder-volume[86639]: DEBUG cinder.volume.flows.manager.create_volume [None req-59b7c96a-5df2-4eb7-8590-1a2f12d2327a tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 20:01:19 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-59b7c96a-5df2-4eb7-8590-1a2f12d2327a tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Flow 'volume_create_manager' (beccbdd1-5920-4756-a4d3-8d19e951837e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 20:01:19 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-59b7c96a-5df2-4eb7-8590-1a2f12d2327a tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd61c146-0911-455e-ab17-9b65b04e2cdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:01:19 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-59b7c96a-5df2-4eb7-8590-1a2f12d2327a tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd61c146-0911-455e-ab17-9b65b04e2cdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T18:01:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1862770347',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec7ba515-7a9d-4193-ae2c-e20241eb559a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ffda0cbbee44cfa94003e122bf584a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T18:01:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T18:01:19Z,use_quota=True,user_id='fcb6101e036c4c5995df5ecae4bc51db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:01:19 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-59b7c96a-5df2-4eb7-8590-1a2f12d2327a tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e363bde6-df63-461d-800f-3383fe9c4fff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:01:19 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-59b7c96a-5df2-4eb7-8590-1a2f12d2327a tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e363bde6-df63-461d-800f-3383fe9c4fff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:01:19 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-59b7c96a-5df2-4eb7-8590-1a2f12d2327a tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f114c08a-c937-4c65-bb78-d70a714035c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:01:19 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-59b7c96a-5df2-4eb7-8590-1a2f12d2327a tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f114c08a-c937-4c65-bb78-d70a714035c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ec7ba515-7a9d-4193-ae2c-e20241eb559a', 'volume_name': 'volume-ec7ba515-7a9d-4193-ae2c-e20241eb559a', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:01:19 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-59b7c96a-5df2-4eb7-8590-1a2f12d2327a tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (107176e4-c390-4d32-80cb-c8e8e08988e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:01:19 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-59b7c96a-5df2-4eb7-8590-1a2f12d2327a tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (107176e4-c390-4d32-80cb-c8e8e08988e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:01:19 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-59b7c96a-5df2-4eb7-8590-1a2f12d2327a tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc6dd283-6937-4518-9a09-92e5c119a0d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:01:19 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-59b7c96a-5df2-4eb7-8590-1a2f12d2327a tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Volume ec7ba515-7a9d-4193-ae2c-e20241eb559a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ec7ba515-7a9d-4193-ae2c-e20241eb559a', 'volume_size': 1}
Jul 02 20:01:19 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-59b7c96a-5df2-4eb7-8590-1a2f12d2327a tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 20:01:19 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-59b7c96a-5df2-4eb7-8590-1a2f12d2327a tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 20:01:19 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-59b7c96a-5df2-4eb7-8590-1a2f12d2327a tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce906cb830>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T18:01:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1862770347',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec7ba515-7a9d-4193-ae2c-e20241eb559a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ffda0cbbee44cfa94003e122bf584a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T18:01:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T18:01:19Z,use_quota=True,user_id='fcb6101e036c4c5995df5ecae4bc51db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)}" {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 20:01:19 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-59b7c96a-5df2-4eb7-8590-1a2f12d2327a tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Creating volume ec7ba515-7a9d-4193-ae2c-e20241eb559a {{(pid=86639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 20:01:19 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-59b7c96a-5df2-4eb7-8590-1a2f12d2327a tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 20:01:19 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-59b7c96a-5df2-4eb7-8590-1a2f12d2327a tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 20:01:19 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-59b7c96a-5df2-4eb7-8590-1a2f12d2327a tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 20:01:19 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-59b7c96a-5df2-4eb7-8590-1a2f12d2327a tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 20:01:19 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-59b7c96a-5df2-4eb7-8590-1a2f12d2327a tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 20:01:19 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-59b7c96a-5df2-4eb7-8590-1a2f12d2327a tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Selected osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92 as target Quobyte volume. {{(pid=86639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 20:01:19 devstack cinder-volume[86639]: INFO cinder.volume.drivers.remotefs [None req-59b7c96a-5df2-4eb7-8590-1a2f12d2327a tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] casted to osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92
Jul 02 20:01:19 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-59b7c96a-5df2-4eb7-8590-1a2f12d2327a tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-ec7ba515-7a9d-4193-ae2c-e20241eb559a 1073741824 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:01:19 devstack sudo[104573]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-ec7ba515-7a9d-4193-ae2c-e20241eb559a 1073741824
Jul 02 20:01:19 devstack sudo[104573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:01:20 devstack sudo[104573]: pam_unix(sudo:session): session closed for user root
Jul 02 20:01:20 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-59b7c96a-5df2-4eb7-8590-1a2f12d2327a tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-ec7ba515-7a9d-4193-ae2c-e20241eb559a 1073741824" returned: 0 in 1.036s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:01:20 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-59b7c96a-5df2-4eb7-8590-1a2f12d2327a tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-ec7ba515-7a9d-4193-ae2c-e20241eb559a {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:01:20 devstack sudo[104585]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-ec7ba515-7a9d-4193-ae2c-e20241eb559a
Jul 02 20:01:20 devstack sudo[104585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:01:21 devstack sudo[104585]: pam_unix(sudo:session): session closed for user root
Jul 02 20:01:21 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-59b7c96a-5df2-4eb7-8590-1a2f12d2327a tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-ec7ba515-7a9d-4193-ae2c-e20241eb559a" returned: 0 in 0.676s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:01:21 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-59b7c96a-5df2-4eb7-8590-1a2f12d2327a tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] <== create_volume: return (1797ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'} {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 20:01:21 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-59b7c96a-5df2-4eb7-8590-1a2f12d2327a tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.800s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 20:01:21 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-59b7c96a-5df2-4eb7-8590-1a2f12d2327a tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc6dd283-6937-4518-9a09-92e5c119a0d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec7ba515-7a9d-4193-ae2c-e20241eb559a', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:01:21 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-59b7c96a-5df2-4eb7-8590-1a2f12d2327a tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd77e3cc-3093-4eb3-8d57-c9b35ac14465) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:01:21 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-59b7c96a-5df2-4eb7-8590-1a2f12d2327a tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Volume volume-ec7ba515-7a9d-4193-ae2c-e20241eb559a (ec7ba515-7a9d-4193-ae2c-e20241eb559a): created successfully
Jul 02 20:01:21 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-59b7c96a-5df2-4eb7-8590-1a2f12d2327a tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd77e3cc-3093-4eb3-8d57-c9b35ac14465) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:01:21 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-59b7c96a-5df2-4eb7-8590-1a2f12d2327a tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Flow 'volume_create_manager' (beccbdd1-5920-4756-a4d3-8d19e951837e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 20:01:21 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-59b7c96a-5df2-4eb7-8590-1a2f12d2327a tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Created volume successfully.
Jul 02 20:01:23 devstack cinder-volume[86639]: DEBUG cinder.volume.flows.manager.create_volume [None req-e45ba6ff-becf-40a8-8e16-f21188ac9f40 tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 20:01:23 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-e45ba6ff-becf-40a8-8e16-f21188ac9f40 tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Flow 'volume_create_manager' (2e19a5d4-1125-4e99-8844-dfa53b7b6935) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 20:01:23 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-e45ba6ff-becf-40a8-8e16-f21188ac9f40 tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (509f2d75-8845-4635-86f2-0fc06588b07d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:01:23 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-e45ba6ff-becf-40a8-8e16-f21188ac9f40 tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (509f2d75-8845-4635-86f2-0fc06588b07d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T18:01:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1455636527',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ac6a9a6-07cb-408a-82e7-8258f3c089bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ffda0cbbee44cfa94003e122bf584a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T18:01:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T18:01:23Z,use_quota=True,user_id='fcb6101e036c4c5995df5ecae4bc51db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:01:23 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-e45ba6ff-becf-40a8-8e16-f21188ac9f40 tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (245a4668-1bcb-4ab1-a74e-b8e39233041b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:01:23 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-e45ba6ff-becf-40a8-8e16-f21188ac9f40 tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (245a4668-1bcb-4ab1-a74e-b8e39233041b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:01:23 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-e45ba6ff-becf-40a8-8e16-f21188ac9f40 tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1905428-2aa7-4c88-bfb1-e96632442357) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:01:23 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-e45ba6ff-becf-40a8-8e16-f21188ac9f40 tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1905428-2aa7-4c88-bfb1-e96632442357) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4ac6a9a6-07cb-408a-82e7-8258f3c089bf', 'volume_name': 'volume-4ac6a9a6-07cb-408a-82e7-8258f3c089bf', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:01:23 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-e45ba6ff-becf-40a8-8e16-f21188ac9f40 tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a79e2caf-acee-4b6c-9319-77c58ccdeea6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:01:23 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-e45ba6ff-becf-40a8-8e16-f21188ac9f40 tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a79e2caf-acee-4b6c-9319-77c58ccdeea6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:01:23 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-e45ba6ff-becf-40a8-8e16-f21188ac9f40 tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab879744-7dd0-43c8-9726-20189101f9c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:01:23 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-e45ba6ff-becf-40a8-8e16-f21188ac9f40 tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Volume 4ac6a9a6-07cb-408a-82e7-8258f3c089bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4ac6a9a6-07cb-408a-82e7-8258f3c089bf', 'volume_size': 1}
Jul 02 20:01:23 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-e45ba6ff-becf-40a8-8e16-f21188ac9f40 tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 20:01:23 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-e45ba6ff-becf-40a8-8e16-f21188ac9f40 tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 20:01:23 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-e45ba6ff-becf-40a8-8e16-f21188ac9f40 tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce906cb830>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T18:01:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1455636527',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ac6a9a6-07cb-408a-82e7-8258f3c089bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ffda0cbbee44cfa94003e122bf584a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T18:01:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T18:01:23Z,use_quota=True,user_id='fcb6101e036c4c5995df5ecae4bc51db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)}" {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 20:01:23 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-e45ba6ff-becf-40a8-8e16-f21188ac9f40 tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Creating volume 4ac6a9a6-07cb-408a-82e7-8258f3c089bf {{(pid=86639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 20:01:23 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-e45ba6ff-becf-40a8-8e16-f21188ac9f40 tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 20:01:23 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-e45ba6ff-becf-40a8-8e16-f21188ac9f40 tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 20:01:23 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-e45ba6ff-becf-40a8-8e16-f21188ac9f40 tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 20:01:23 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-e45ba6ff-becf-40a8-8e16-f21188ac9f40 tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 20:01:23 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-e45ba6ff-becf-40a8-8e16-f21188ac9f40 tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 20:01:23 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-e45ba6ff-becf-40a8-8e16-f21188ac9f40 tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Selected osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92 as target Quobyte volume. {{(pid=86639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 20:01:23 devstack cinder-volume[86639]: INFO cinder.volume.drivers.remotefs [None req-e45ba6ff-becf-40a8-8e16-f21188ac9f40 tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] casted to osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92
Jul 02 20:01:23 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-e45ba6ff-becf-40a8-8e16-f21188ac9f40 tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-4ac6a9a6-07cb-408a-82e7-8258f3c089bf 1073741824 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:01:23 devstack sudo[104592]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-4ac6a9a6-07cb-408a-82e7-8258f3c089bf 1073741824
Jul 02 20:01:23 devstack sudo[104592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:01:23 devstack cinder-volume[86639]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ee2e01a-2439-4dbe-977e-cb6e3e4219cc tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 20:01:23 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-2ee2e01a-2439-4dbe-977e-cb6e3e4219cc tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Flow 'volume_create_manager' (2690aedb-a52a-4b1e-ac78-8b9aab291ed1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 20:01:24 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-2ee2e01a-2439-4dbe-977e-cb6e3e4219cc tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94dd73f3-fe44-4b3e-a20e-b64b83f00413) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:01:24 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-2ee2e01a-2439-4dbe-977e-cb6e3e4219cc tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94dd73f3-fe44-4b3e-a20e-b64b83f00413) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T18:01:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-85865378',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e47c5f34-b71b-4a0e-8696-604ea92d203a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ffda0cbbee44cfa94003e122bf584a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T18:01:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T18:01:24Z,use_quota=True,user_id='fcb6101e036c4c5995df5ecae4bc51db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:01:24 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-2ee2e01a-2439-4dbe-977e-cb6e3e4219cc tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef3c2f9b-0ea8-4bb8-8009-d7c874e7adaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:01:24 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-2ee2e01a-2439-4dbe-977e-cb6e3e4219cc tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef3c2f9b-0ea8-4bb8-8009-d7c874e7adaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:01:24 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-2ee2e01a-2439-4dbe-977e-cb6e3e4219cc tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06fe7bb4-dd81-4a64-b6a4-e8dfee394263) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:01:24 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-2ee2e01a-2439-4dbe-977e-cb6e3e4219cc tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06fe7bb4-dd81-4a64-b6a4-e8dfee394263) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e47c5f34-b71b-4a0e-8696-604ea92d203a', 'volume_name': 'volume-e47c5f34-b71b-4a0e-8696-604ea92d203a', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:01:24 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-2ee2e01a-2439-4dbe-977e-cb6e3e4219cc tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8182a2ca-d239-4378-b20b-b5110f85f1c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:01:24 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-2ee2e01a-2439-4dbe-977e-cb6e3e4219cc tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8182a2ca-d239-4378-b20b-b5110f85f1c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:01:24 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-2ee2e01a-2439-4dbe-977e-cb6e3e4219cc tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a74de1c-348b-4dc6-8c3a-08f0e3afaad8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:01:24 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-2ee2e01a-2439-4dbe-977e-cb6e3e4219cc tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Volume e47c5f34-b71b-4a0e-8696-604ea92d203a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e47c5f34-b71b-4a0e-8696-604ea92d203a', 'volume_size': 1}
Jul 02 20:01:24 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-2ee2e01a-2439-4dbe-977e-cb6e3e4219cc tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 20:01:24 devstack cinder-volume[86639]: INFO cinder.volume.manager [req-31e685a2-45f1-4cde-91a3-0fc74b7d1589 req-1dc570c3-51bf-47c1-8132-08a47cffc0fd tempest-TestShelveInstance-1204606342 None] Terminate volume connection completed successfully.
Jul 02 20:01:24 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [req-31e685a2-45f1-4cde-91a3-0fc74b7d1589 req-1dc570c3-51bf-47c1-8132-08a47cffc0fd tempest-TestShelveInstance-1204606342 None] Deleting attachment 518ccb9b-78ed-41c5-8f55-6ac702313ce7. {{(pid=86639) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 02 20:01:24 devstack cinder-volume[86639]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7327d54-12ef-462c-b26c-140eb21e1ec1 tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 20:01:24 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-c7327d54-12ef-462c-b26c-140eb21e1ec1 tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Flow 'volume_create_manager' (bcec0ad8-e770-468d-b04f-02bf8a599eb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 20:01:24 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-c7327d54-12ef-462c-b26c-140eb21e1ec1 tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b42c07b3-9a6b-44f2-8af0-502166e508f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:01:24 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-c7327d54-12ef-462c-b26c-140eb21e1ec1 tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b42c07b3-9a6b-44f2-8af0-502166e508f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T18:01:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1038616056',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=378fac18-afb5-4c3e-913c-8601d33393a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ffda0cbbee44cfa94003e122bf584a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T18:01:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T18:01:24Z,use_quota=True,user_id='fcb6101e036c4c5995df5ecae4bc51db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:01:24 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-c7327d54-12ef-462c-b26c-140eb21e1ec1 tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (370e10a4-9450-41b8-9cba-73587332527e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:01:24 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-c7327d54-12ef-462c-b26c-140eb21e1ec1 tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (370e10a4-9450-41b8-9cba-73587332527e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:01:24 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-c7327d54-12ef-462c-b26c-140eb21e1ec1 tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8acab238-08b9-433a-9e88-a6b62cf3ca87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:01:24 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-c7327d54-12ef-462c-b26c-140eb21e1ec1 tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8acab238-08b9-433a-9e88-a6b62cf3ca87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '378fac18-afb5-4c3e-913c-8601d33393a1', 'volume_name': 'volume-378fac18-afb5-4c3e-913c-8601d33393a1', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:01:24 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-c7327d54-12ef-462c-b26c-140eb21e1ec1 tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecd738b7-213d-40b4-8a78-d23ce58a98d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:01:24 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-c7327d54-12ef-462c-b26c-140eb21e1ec1 tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecd738b7-213d-40b4-8a78-d23ce58a98d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:01:24 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-c7327d54-12ef-462c-b26c-140eb21e1ec1 tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (646ba76e-8b67-462b-aa31-f5da1b11e6ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:01:24 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-c7327d54-12ef-462c-b26c-140eb21e1ec1 tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Volume 378fac18-afb5-4c3e-913c-8601d33393a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-378fac18-afb5-4c3e-913c-8601d33393a1', 'volume_size': 1}
Jul 02 20:01:24 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-c7327d54-12ef-462c-b26c-140eb21e1ec1 tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 20:01:24 devstack sudo[104592]: pam_unix(sudo:session): session closed for user root
Jul 02 20:01:24 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-e45ba6ff-becf-40a8-8e16-f21188ac9f40 tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-4ac6a9a6-07cb-408a-82e7-8258f3c089bf 1073741824" returned: 0 in 1.411s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:01:24 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-e45ba6ff-becf-40a8-8e16-f21188ac9f40 tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-4ac6a9a6-07cb-408a-82e7-8258f3c089bf {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:01:24 devstack sudo[104598]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-4ac6a9a6-07cb-408a-82e7-8258f3c089bf
Jul 02 20:01:24 devstack sudo[104598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:01:25 devstack cinder-volume[86639]: DEBUG cinder.volume.flows.manager.create_volume [None req-42a0bb10-2ba0-4827-94f0-03cdb7f040af tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 20:01:25 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-42a0bb10-2ba0-4827-94f0-03cdb7f040af tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Flow 'volume_create_manager' (dfaf1b02-5b5d-4b79-8646-25d37f5e2fd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 20:01:25 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-42a0bb10-2ba0-4827-94f0-03cdb7f040af tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e4e26d3-2456-42fd-8f02-a70b32caf9e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:01:25 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-42a0bb10-2ba0-4827-94f0-03cdb7f040af tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e4e26d3-2456-42fd-8f02-a70b32caf9e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T18:01:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1997053680',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2bbde7d0-3c47-4070-a7c6-1536c059e84a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ffda0cbbee44cfa94003e122bf584a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T18:01:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T18:01:25Z,use_quota=True,user_id='fcb6101e036c4c5995df5ecae4bc51db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:01:25 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-42a0bb10-2ba0-4827-94f0-03cdb7f040af tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b65270c-bb50-4107-bc58-f9e97303271b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:01:25 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-42a0bb10-2ba0-4827-94f0-03cdb7f040af tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b65270c-bb50-4107-bc58-f9e97303271b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:01:25 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-42a0bb10-2ba0-4827-94f0-03cdb7f040af tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a81ee694-b310-4eff-8596-96e9e91a4d1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:01:25 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-42a0bb10-2ba0-4827-94f0-03cdb7f040af tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a81ee694-b310-4eff-8596-96e9e91a4d1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2bbde7d0-3c47-4070-a7c6-1536c059e84a', 'volume_name': 'volume-2bbde7d0-3c47-4070-a7c6-1536c059e84a', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:01:25 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-42a0bb10-2ba0-4827-94f0-03cdb7f040af tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8383f37d-bc05-49a3-a6ef-739836c0893e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:01:25 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-42a0bb10-2ba0-4827-94f0-03cdb7f040af tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8383f37d-bc05-49a3-a6ef-739836c0893e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:01:25 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-42a0bb10-2ba0-4827-94f0-03cdb7f040af tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3abfa24c-c307-4c3d-9002-b2f6413b75a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:01:25 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-42a0bb10-2ba0-4827-94f0-03cdb7f040af tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Volume 2bbde7d0-3c47-4070-a7c6-1536c059e84a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2bbde7d0-3c47-4070-a7c6-1536c059e84a', 'volume_size': 1}
Jul 02 20:01:25 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-42a0bb10-2ba0-4827-94f0-03cdb7f040af tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 20:01:25 devstack sudo[104598]: pam_unix(sudo:session): session closed for user root
Jul 02 20:01:25 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-e45ba6ff-becf-40a8-8e16-f21188ac9f40 tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-4ac6a9a6-07cb-408a-82e7-8258f3c089bf" returned: 0 in 0.876s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:01:25 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-e45ba6ff-becf-40a8-8e16-f21188ac9f40 tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] <== create_volume: return (2410ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'} {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 20:01:25 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-e45ba6ff-becf-40a8-8e16-f21188ac9f40 tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.413s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 20:01:25 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-2ee2e01a-2439-4dbe-977e-cb6e3e4219cc tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.474s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 20:01:25 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-2ee2e01a-2439-4dbe-977e-cb6e3e4219cc tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce906cb830>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T18:01:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-85865378',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e47c5f34-b71b-4a0e-8696-604ea92d203a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ffda0cbbee44cfa94003e122bf584a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T18:01:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T18:01:24Z,use_quota=True,user_id='fcb6101e036c4c5995df5ecae4bc51db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)}" {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 20:01:25 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-2ee2e01a-2439-4dbe-977e-cb6e3e4219cc tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Creating volume e47c5f34-b71b-4a0e-8696-604ea92d203a {{(pid=86639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 20:01:25 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-2ee2e01a-2439-4dbe-977e-cb6e3e4219cc tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 20:01:25 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-2ee2e01a-2439-4dbe-977e-cb6e3e4219cc tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 20:01:25 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-2ee2e01a-2439-4dbe-977e-cb6e3e4219cc tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 20:01:25 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-2ee2e01a-2439-4dbe-977e-cb6e3e4219cc tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 20:01:25 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-2ee2e01a-2439-4dbe-977e-cb6e3e4219cc tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 20:01:25 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-2ee2e01a-2439-4dbe-977e-cb6e3e4219cc tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Selected osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92 as target Quobyte volume. {{(pid=86639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 20:01:25 devstack cinder-volume[86639]: INFO cinder.volume.drivers.remotefs [None req-2ee2e01a-2439-4dbe-977e-cb6e3e4219cc tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] casted to osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92
Jul 02 20:01:25 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-2ee2e01a-2439-4dbe-977e-cb6e3e4219cc tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-e47c5f34-b71b-4a0e-8696-604ea92d203a 1073741824 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:01:25 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-e45ba6ff-becf-40a8-8e16-f21188ac9f40 tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab879744-7dd0-43c8-9726-20189101f9c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ac6a9a6-07cb-408a-82e7-8258f3c089bf', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:01:25 devstack sudo[104604]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-e47c5f34-b71b-4a0e-8696-604ea92d203a 1073741824
Jul 02 20:01:25 devstack sudo[104604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:01:25 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-e45ba6ff-becf-40a8-8e16-f21188ac9f40 tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94a3a690-4a21-4b50-b72e-6b767213fb12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:01:25 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-e45ba6ff-becf-40a8-8e16-f21188ac9f40 tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Volume volume-4ac6a9a6-07cb-408a-82e7-8258f3c089bf (4ac6a9a6-07cb-408a-82e7-8258f3c089bf): created successfully
Jul 02 20:01:25 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-e45ba6ff-becf-40a8-8e16-f21188ac9f40 tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94a3a690-4a21-4b50-b72e-6b767213fb12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:01:25 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-e45ba6ff-becf-40a8-8e16-f21188ac9f40 tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Flow 'volume_create_manager' (2e19a5d4-1125-4e99-8844-dfa53b7b6935) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 20:01:25 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-e45ba6ff-becf-40a8-8e16-f21188ac9f40 tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Created volume successfully.
Jul 02 20:01:25 devstack cinder-volume[86639]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc480788-3ccf-4503-bb13-48f9fd85963c tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 20:01:25 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-cc480788-3ccf-4503-bb13-48f9fd85963c tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Flow 'volume_create_manager' (88bf6662-befa-4ef5-8c99-a35aa5a2ce4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 20:01:25 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-cc480788-3ccf-4503-bb13-48f9fd85963c tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4ba3402-1f4c-4a25-a1ca-5d684ae1920a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:01:25 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-cc480788-3ccf-4503-bb13-48f9fd85963c tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4ba3402-1f4c-4a25-a1ca-5d684ae1920a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T18:01:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-55776234',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab33f606-954e-4415-9150-5aa067453885,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ffda0cbbee44cfa94003e122bf584a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T18:01:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T18:01:26Z,use_quota=True,user_id='fcb6101e036c4c5995df5ecae4bc51db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:01:25 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-cc480788-3ccf-4503-bb13-48f9fd85963c tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4378d219-1e7a-459f-90f4-feb469701ed4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:01:25 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-cc480788-3ccf-4503-bb13-48f9fd85963c tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4378d219-1e7a-459f-90f4-feb469701ed4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:01:25 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-cc480788-3ccf-4503-bb13-48f9fd85963c tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18e731a1-80a8-4e27-9838-d2073a169315) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:01:25 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-cc480788-3ccf-4503-bb13-48f9fd85963c tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18e731a1-80a8-4e27-9838-d2073a169315) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab33f606-954e-4415-9150-5aa067453885', 'volume_name': 'volume-ab33f606-954e-4415-9150-5aa067453885', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:01:25 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-cc480788-3ccf-4503-bb13-48f9fd85963c tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc6d8659-563a-47e0-9da5-8a50db038af9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:01:25 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-cc480788-3ccf-4503-bb13-48f9fd85963c tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc6d8659-563a-47e0-9da5-8a50db038af9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:01:25 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-cc480788-3ccf-4503-bb13-48f9fd85963c tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4757419d-53fb-4ab3-995b-034138cd3181) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:01:25 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-cc480788-3ccf-4503-bb13-48f9fd85963c tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Volume ab33f606-954e-4415-9150-5aa067453885: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab33f606-954e-4415-9150-5aa067453885', 'volume_size': 1}
Jul 02 20:01:25 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-cc480788-3ccf-4503-bb13-48f9fd85963c tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 20:01:26 devstack sudo[104604]: pam_unix(sudo:session): session closed for user root
Jul 02 20:01:26 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-2ee2e01a-2439-4dbe-977e-cb6e3e4219cc tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-e47c5f34-b71b-4a0e-8696-604ea92d203a 1073741824" returned: 0 in 1.147s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:01:26 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-2ee2e01a-2439-4dbe-977e-cb6e3e4219cc tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-e47c5f34-b71b-4a0e-8696-604ea92d203a {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:01:26 devstack sudo[104611]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-e47c5f34-b71b-4a0e-8696-604ea92d203a
Jul 02 20:01:26 devstack sudo[104611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:01:27 devstack sudo[104611]: pam_unix(sudo:session): session closed for user root
Jul 02 20:01:27 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-2ee2e01a-2439-4dbe-977e-cb6e3e4219cc tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-e47c5f34-b71b-4a0e-8696-604ea92d203a" returned: 0 in 0.772s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:01:27 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-2ee2e01a-2439-4dbe-977e-cb6e3e4219cc tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] <== create_volume: return (1968ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'} {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 20:01:27 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-2ee2e01a-2439-4dbe-977e-cb6e3e4219cc tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.973s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 20:01:27 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-c7327d54-12ef-462c-b26c-140eb21e1ec1 tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.012s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 20:01:27 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-c7327d54-12ef-462c-b26c-140eb21e1ec1 tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce906cb830>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T18:01:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1038616056',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=378fac18-afb5-4c3e-913c-8601d33393a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ffda0cbbee44cfa94003e122bf584a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T18:01:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T18:01:24Z,use_quota=True,user_id='fcb6101e036c4c5995df5ecae4bc51db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)}" {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 20:01:27 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-c7327d54-12ef-462c-b26c-140eb21e1ec1 tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Creating volume 378fac18-afb5-4c3e-913c-8601d33393a1 {{(pid=86639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 20:01:27 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-c7327d54-12ef-462c-b26c-140eb21e1ec1 tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 20:01:27 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-c7327d54-12ef-462c-b26c-140eb21e1ec1 tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 20:01:27 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-c7327d54-12ef-462c-b26c-140eb21e1ec1 tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 20:01:27 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-c7327d54-12ef-462c-b26c-140eb21e1ec1 tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 20:01:27 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-c7327d54-12ef-462c-b26c-140eb21e1ec1 tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 20:01:27 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-c7327d54-12ef-462c-b26c-140eb21e1ec1 tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Selected osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92 as target Quobyte volume. {{(pid=86639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 20:01:27 devstack cinder-volume[86639]: INFO cinder.volume.drivers.remotefs [None req-c7327d54-12ef-462c-b26c-140eb21e1ec1 tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] casted to osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92
Jul 02 20:01:27 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-c7327d54-12ef-462c-b26c-140eb21e1ec1 tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-378fac18-afb5-4c3e-913c-8601d33393a1 1073741824 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:01:27 devstack sudo[104615]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-378fac18-afb5-4c3e-913c-8601d33393a1 1073741824
Jul 02 20:01:27 devstack sudo[104615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:01:27 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-2ee2e01a-2439-4dbe-977e-cb6e3e4219cc tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a74de1c-348b-4dc6-8c3a-08f0e3afaad8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e47c5f34-b71b-4a0e-8696-604ea92d203a', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:01:27 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-2ee2e01a-2439-4dbe-977e-cb6e3e4219cc tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37477951-0ab9-46da-9146-12c54c5c1bf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:01:27 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-2ee2e01a-2439-4dbe-977e-cb6e3e4219cc tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Volume volume-e47c5f34-b71b-4a0e-8696-604ea92d203a (e47c5f34-b71b-4a0e-8696-604ea92d203a): created successfully
Jul 02 20:01:27 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-2ee2e01a-2439-4dbe-977e-cb6e3e4219cc tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37477951-0ab9-46da-9146-12c54c5c1bf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:01:27 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-2ee2e01a-2439-4dbe-977e-cb6e3e4219cc tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Flow 'volume_create_manager' (2690aedb-a52a-4b1e-ac78-8b9aab291ed1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 20:01:27 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-2ee2e01a-2439-4dbe-977e-cb6e3e4219cc tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Created volume successfully.
Jul 02 20:01:28 devstack sudo[104615]: pam_unix(sudo:session): session closed for user root
Jul 02 20:01:28 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-c7327d54-12ef-462c-b26c-140eb21e1ec1 tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-378fac18-afb5-4c3e-913c-8601d33393a1 1073741824" returned: 0 in 1.233s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:01:28 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-c7327d54-12ef-462c-b26c-140eb21e1ec1 tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-378fac18-afb5-4c3e-913c-8601d33393a1 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:01:28 devstack sudo[104623]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-378fac18-afb5-4c3e-913c-8601d33393a1
Jul 02 20:01:28 devstack sudo[104623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:01:29 devstack sudo[104623]: pam_unix(sudo:session): session closed for user root
Jul 02 20:01:29 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-c7327d54-12ef-462c-b26c-140eb21e1ec1 tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-378fac18-afb5-4c3e-913c-8601d33393a1" returned: 0 in 0.755s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:01:29 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-c7327d54-12ef-462c-b26c-140eb21e1ec1 tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] <== create_volume: return (2054ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'} {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 20:01:29 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-c7327d54-12ef-462c-b26c-140eb21e1ec1 tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.060s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 20:01:29 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-42a0bb10-2ba0-4827-94f0-03cdb7f040af tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.456s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 20:01:29 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-42a0bb10-2ba0-4827-94f0-03cdb7f040af tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce906cb830>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T18:01:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1997053680',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2bbde7d0-3c47-4070-a7c6-1536c059e84a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ffda0cbbee44cfa94003e122bf584a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T18:01:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T18:01:25Z,use_quota=True,user_id='fcb6101e036c4c5995df5ecae4bc51db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)}" {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 20:01:29 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-42a0bb10-2ba0-4827-94f0-03cdb7f040af tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Creating volume 2bbde7d0-3c47-4070-a7c6-1536c059e84a {{(pid=86639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 20:01:29 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-42a0bb10-2ba0-4827-94f0-03cdb7f040af tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 20:01:29 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-42a0bb10-2ba0-4827-94f0-03cdb7f040af tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 20:01:29 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-42a0bb10-2ba0-4827-94f0-03cdb7f040af tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 20:01:29 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-42a0bb10-2ba0-4827-94f0-03cdb7f040af tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 20:01:29 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-42a0bb10-2ba0-4827-94f0-03cdb7f040af tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 20:01:29 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-42a0bb10-2ba0-4827-94f0-03cdb7f040af tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Selected osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92 as target Quobyte volume. {{(pid=86639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 20:01:29 devstack cinder-volume[86639]: INFO cinder.volume.drivers.remotefs [None req-42a0bb10-2ba0-4827-94f0-03cdb7f040af tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] casted to osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92
Jul 02 20:01:29 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-42a0bb10-2ba0-4827-94f0-03cdb7f040af tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-2bbde7d0-3c47-4070-a7c6-1536c059e84a 1073741824 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:01:29 devstack sudo[104626]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-2bbde7d0-3c47-4070-a7c6-1536c059e84a 1073741824
Jul 02 20:01:29 devstack sudo[104626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:01:29 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-c7327d54-12ef-462c-b26c-140eb21e1ec1 tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (646ba76e-8b67-462b-aa31-f5da1b11e6ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-378fac18-afb5-4c3e-913c-8601d33393a1', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:01:29 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-c7327d54-12ef-462c-b26c-140eb21e1ec1 tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8e839bd-cb52-498b-81eb-b9c31c8915d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:01:29 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-c7327d54-12ef-462c-b26c-140eb21e1ec1 tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Volume volume-378fac18-afb5-4c3e-913c-8601d33393a1 (378fac18-afb5-4c3e-913c-8601d33393a1): created successfully
Jul 02 20:01:29 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-c7327d54-12ef-462c-b26c-140eb21e1ec1 tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8e839bd-cb52-498b-81eb-b9c31c8915d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:01:29 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-c7327d54-12ef-462c-b26c-140eb21e1ec1 tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Flow 'volume_create_manager' (bcec0ad8-e770-468d-b04f-02bf8a599eb3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 20:01:29 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-c7327d54-12ef-462c-b26c-140eb21e1ec1 tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Created volume successfully.
Jul 02 20:01:30 devstack sudo[104626]: pam_unix(sudo:session): session closed for user root
Jul 02 20:01:30 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-42a0bb10-2ba0-4827-94f0-03cdb7f040af tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-2bbde7d0-3c47-4070-a7c6-1536c059e84a 1073741824" returned: 0 in 0.995s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:01:30 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-42a0bb10-2ba0-4827-94f0-03cdb7f040af tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-2bbde7d0-3c47-4070-a7c6-1536c059e84a {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:01:30 devstack sudo[104632]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-2bbde7d0-3c47-4070-a7c6-1536c059e84a
Jul 02 20:01:30 devstack sudo[104632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:01:31 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [req-216fab3d-b1d6-4663-9a2d-2e6673cefc2f req-2cdb7f7d-9706-41de-a91f-5e2871a7f1ff tempest-TestShelveInstance-1204606342 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 20:01:31 devstack sudo[104632]: pam_unix(sudo:session): session closed for user root
Jul 02 20:01:31 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-42a0bb10-2ba0-4827-94f0-03cdb7f040af tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-2bbde7d0-3c47-4070-a7c6-1536c059e84a" returned: 0 in 0.737s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:01:31 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-42a0bb10-2ba0-4827-94f0-03cdb7f040af tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] <== create_volume: return (1794ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'} {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 20:01:31 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-42a0bb10-2ba0-4827-94f0-03cdb7f040af tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.797s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 20:01:31 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-cc480788-3ccf-4503-bb13-48f9fd85963c tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.524s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 20:01:31 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-cc480788-3ccf-4503-bb13-48f9fd85963c tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce906cb830>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T18:01:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-55776234',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab33f606-954e-4415-9150-5aa067453885,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ffda0cbbee44cfa94003e122bf584a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T18:01:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T18:01:26Z,use_quota=True,user_id='fcb6101e036c4c5995df5ecae4bc51db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)}" {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 20:01:31 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-cc480788-3ccf-4503-bb13-48f9fd85963c tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Creating volume ab33f606-954e-4415-9150-5aa067453885 {{(pid=86639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 20:01:31 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-cc480788-3ccf-4503-bb13-48f9fd85963c tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 20:01:31 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-cc480788-3ccf-4503-bb13-48f9fd85963c tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 20:01:31 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-cc480788-3ccf-4503-bb13-48f9fd85963c tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 20:01:31 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-cc480788-3ccf-4503-bb13-48f9fd85963c tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 20:01:31 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-cc480788-3ccf-4503-bb13-48f9fd85963c tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 20:01:31 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-cc480788-3ccf-4503-bb13-48f9fd85963c tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Selected osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92 as target Quobyte volume. {{(pid=86639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 20:01:31 devstack cinder-volume[86639]: INFO cinder.volume.drivers.remotefs [None req-cc480788-3ccf-4503-bb13-48f9fd85963c tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] casted to osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92
Jul 02 20:01:31 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-cc480788-3ccf-4503-bb13-48f9fd85963c tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-ab33f606-954e-4415-9150-5aa067453885 1073741824 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:01:31 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-42a0bb10-2ba0-4827-94f0-03cdb7f040af tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3abfa24c-c307-4c3d-9002-b2f6413b75a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2bbde7d0-3c47-4070-a7c6-1536c059e84a', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:01:31 devstack sudo[104643]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-ab33f606-954e-4415-9150-5aa067453885 1073741824
Jul 02 20:01:31 devstack sudo[104643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:01:31 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-42a0bb10-2ba0-4827-94f0-03cdb7f040af tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07293eaa-7bff-4932-9192-b0b21c676057) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:01:31 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-42a0bb10-2ba0-4827-94f0-03cdb7f040af tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Volume volume-2bbde7d0-3c47-4070-a7c6-1536c059e84a (2bbde7d0-3c47-4070-a7c6-1536c059e84a): created successfully
Jul 02 20:01:31 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-42a0bb10-2ba0-4827-94f0-03cdb7f040af tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07293eaa-7bff-4932-9192-b0b21c676057) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:01:31 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-42a0bb10-2ba0-4827-94f0-03cdb7f040af tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Flow 'volume_create_manager' (dfaf1b02-5b5d-4b79-8646-25d37f5e2fd6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 20:01:31 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-42a0bb10-2ba0-4827-94f0-03cdb7f040af tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Created volume successfully.
Jul 02 20:01:32 devstack sudo[104643]: pam_unix(sudo:session): session closed for user root
Jul 02 20:01:32 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-cc480788-3ccf-4503-bb13-48f9fd85963c tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-ab33f606-954e-4415-9150-5aa067453885 1073741824" returned: 0 in 0.933s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:01:32 devstack cinder-volume[86639]: DEBUG dbcounter [-] [86639] Writing DB stats cinder:SELECT=103,cinder:INSERT=33,cinder:UPDATE=141,cinder:DELETE=6 {{(pid=86639) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 02 20:01:32 devstack cinder-volume[86639]: DEBUG dbcounter [-] [86639] Writing DB stats cinder:INSERT=34,cinder:UPDATE=126,cinder:SELECT=107,cinder:DELETE=16 {{(pid=86639) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 02 20:01:32 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-cc480788-3ccf-4503-bb13-48f9fd85963c tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-ab33f606-954e-4415-9150-5aa067453885 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:01:32 devstack sudo[104650]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-ab33f606-954e-4415-9150-5aa067453885
Jul 02 20:01:32 devstack sudo[104650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:01:33 devstack sudo[104650]: pam_unix(sudo:session): session closed for user root
Jul 02 20:01:33 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-cc480788-3ccf-4503-bb13-48f9fd85963c tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-ab33f606-954e-4415-9150-5aa067453885" returned: 0 in 0.687s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:01:33 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-cc480788-3ccf-4503-bb13-48f9fd85963c tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] <== create_volume: return (1664ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'} {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 20:01:33 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-cc480788-3ccf-4503-bb13-48f9fd85963c tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.667s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 20:01:33 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [req-216fab3d-b1d6-4663-9a2d-2e6673cefc2f req-2cdb7f7d-9706-41de-a91f-5e2871a7f1ff tempest-TestShelveInstance-1204606342 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.948s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 20:01:33 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-cc480788-3ccf-4503-bb13-48f9fd85963c tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4757419d-53fb-4ab3-995b-034138cd3181) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab33f606-954e-4415-9150-5aa067453885', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:01:33 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-cc480788-3ccf-4503-bb13-48f9fd85963c tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a21b213-fcfd-4ede-9c7b-ee94babfcb1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:01:33 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[6da5e20e-56f5-40cf-a40d-75218d49d9d6]: (4, 'raw') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 20:01:33 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [req-216fab3d-b1d6-4663-9a2d-2e6673cefc2f req-2cdb7f7d-9706-41de-a91f-5e2871a7f1ff tempest-TestShelveInstance-1204606342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-a992da0d-c1f8-4a49-8b48-729e67de065d {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:01:33 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-cc480788-3ccf-4503-bb13-48f9fd85963c tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Volume volume-ab33f606-954e-4415-9150-5aa067453885 (ab33f606-954e-4415-9150-5aa067453885): created successfully
Jul 02 20:01:33 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-cc480788-3ccf-4503-bb13-48f9fd85963c tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a21b213-fcfd-4ede-9c7b-ee94babfcb1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:01:33 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-cc480788-3ccf-4503-bb13-48f9fd85963c tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Flow 'volume_create_manager' (88bf6662-befa-4ef5-8c99-a35aa5a2ce4b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 20:01:33 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-cc480788-3ccf-4503-bb13-48f9fd85963c tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Created volume successfully.
Jul 02 20:01:33 devstack sudo[104653]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-a992da0d-c1f8-4a49-8b48-729e67de065d
Jul 02 20:01:33 devstack sudo[104653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:01:33 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-459e44fd-961b-4eb8-9014-2cec6e5fe073 tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Acquiring lock "cinder-ab33f606-954e-4415-9150-5aa067453885-delete_volume" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 20:01:33 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-459e44fd-961b-4eb8-9014-2cec6e5fe073 tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Lock "cinder-ab33f606-954e-4415-9150-5aa067453885-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 20:01:33 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-459e44fd-961b-4eb8-9014-2cec6e5fe073 tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Acquiring lock "cinder-quobyte-ab33f606-954e-4415-9150-5aa067453885" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 20:01:33 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-459e44fd-961b-4eb8-9014-2cec6e5fe073 tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Lock "cinder-quobyte-ab33f606-954e-4415-9150-5aa067453885" acquired by "delete_volume" :: waited 0.021s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 20:01:33 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[a94e0adc-453b-4998-86a4-66ec6a70dac3]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 20:01:33 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-459e44fd-961b-4eb8-9014-2cec6e5fe073 tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-ab33f606-954e-4415-9150-5aa067453885 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:01:33 devstack sudo[104689]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-ab33f606-954e-4415-9150-5aa067453885
Jul 02 20:01:33 devstack sudo[104689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:01:34 devstack sudo[104653]: pam_unix(sudo:session): session closed for user root
Jul 02 20:01:34 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [req-216fab3d-b1d6-4663-9a2d-2e6673cefc2f req-2cdb7f7d-9706-41de-a91f-5e2871a7f1ff tempest-TestShelveInstance-1204606342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-a992da0d-c1f8-4a49-8b48-729e67de065d" returned: 0 in 1.092s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:01:34 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [req-216fab3d-b1d6-4663-9a2d-2e6673cefc2f req-2cdb7f7d-9706-41de-a91f-5e2871a7f1ff tempest-TestShelveInstance-1204606342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-a992da0d-c1f8-4a49-8b48-729e67de065d {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:01:34 devstack sudo[104702]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-a992da0d-c1f8-4a49-8b48-729e67de065d
Jul 02 20:01:34 devstack sudo[104702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:01:34 devstack sudo[104689]: pam_unix(sudo:session): session closed for user root
Jul 02 20:01:34 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-459e44fd-961b-4eb8-9014-2cec6e5fe073 tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-ab33f606-954e-4415-9150-5aa067453885" returned: 0 in 1.058s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:01:34 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-459e44fd-961b-4eb8-9014-2cec6e5fe073 tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-ab33f606-954e-4415-9150-5aa067453885 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:01:34 devstack sudo[104707]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-ab33f606-954e-4415-9150-5aa067453885
Jul 02 20:01:34 devstack sudo[104707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:01:35 devstack sudo[104702]: pam_unix(sudo:session): session closed for user root
Jul 02 20:01:35 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [req-216fab3d-b1d6-4663-9a2d-2e6673cefc2f req-2cdb7f7d-9706-41de-a91f-5e2871a7f1ff tempest-TestShelveInstance-1204606342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-a992da0d-c1f8-4a49-8b48-729e67de065d" returned: 1 in 0.941s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:01:35 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [req-216fab3d-b1d6-4663-9a2d-2e6673cefc2f req-2cdb7f7d-9706-41de-a91f-5e2871a7f1ff tempest-TestShelveInstance-1204606342 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-a992da0d-c1f8-4a49-8b48-729e67de065d' failed. Not Retrying. {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 02 20:01:35 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [req-216fab3d-b1d6-4663-9a2d-2e6673cefc2f req-2cdb7f7d-9706-41de-a91f-5e2871a7f1ff tempest-TestShelveInstance-1204606342 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.094s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 20:01:35 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [req-216fab3d-b1d6-4663-9a2d-2e6673cefc2f req-2cdb7f7d-9706-41de-a91f-5e2871a7f1ff tempest-TestShelveInstance-1204606342 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92', 'name': 'volume-a992da0d-c1f8-4a49-8b48-729e67de065d', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '56c1095d-042d-4130-9df6-1db1402455e1', 'enforce_multipath': True} {{(pid=86639) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 02 20:01:35 devstack cinder-volume[86639]: INFO cinder.volume.manager [req-216fab3d-b1d6-4663-9a2d-2e6673cefc2f req-2cdb7f7d-9706-41de-a91f-5e2871a7f1ff tempest-TestShelveInstance-1204606342 None] attachment_update completed successfully.
Jul 02 20:01:35 devstack sudo[104707]: pam_unix(sudo:session): session closed for user root
Jul 02 20:01:35 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-459e44fd-961b-4eb8-9014-2cec6e5fe073 tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-ab33f606-954e-4415-9150-5aa067453885" returned: 0 in 0.845s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:01:35 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-459e44fd-961b-4eb8-9014-2cec6e5fe073 tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Lock "cinder-quobyte-ab33f606-954e-4415-9150-5aa067453885" released by "delete_volume" :: held 1.978s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 20:01:35 devstack cinder-volume[86639]: DEBUG cinder.quota [None req-459e44fd-961b-4eb8-9014-2cec6e5fe073 tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Created reservations ['8c84464e-caac-4f83-9d5e-f704690dab55', '62788ae8-2980-4d0d-b57a-155fc407144f', '8e175611-7f27-4942-beff-d5cde1d1420a', '4bdaa17e-32c3-49f4-9d49-342a627410ed'] {{(pid=86639) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 20:01:35 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-459e44fd-961b-4eb8-9014-2cec6e5fe073 tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 20:01:35 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-459e44fd-961b-4eb8-9014-2cec6e5fe073 tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 20:01:35 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-459e44fd-961b-4eb8-9014-2cec6e5fe073 tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 20:01:35 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-459e44fd-961b-4eb8-9014-2cec6e5fe073 tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 20:01:35 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-459e44fd-961b-4eb8-9014-2cec6e5fe073 tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 20:01:35 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-459e44fd-961b-4eb8-9014-2cec6e5fe073 tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:01:35 devstack sudo[104713]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e
Jul 02 20:01:35 devstack sudo[104713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:01:36 devstack sudo[104713]: pam_unix(sudo:session): session closed for user root
Jul 02 20:01:36 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-459e44fd-961b-4eb8-9014-2cec6e5fe073 tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e" returned: 0 in 0.770s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:01:36 devstack cinder-volume[86639]: DEBUG cinder.manager [None req-459e44fd-961b-4eb8-9014-2cec6e5fe073 tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Notifying Schedulers of capabilities ... {{(pid=86639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 20:01:36 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-459e44fd-961b-4eb8-9014-2cec6e5fe073 tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Deleted volume successfully.
Jul 02 20:01:36 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-459e44fd-961b-4eb8-9014-2cec6e5fe073 tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Lock "cinder-ab33f606-954e-4415-9150-5aa067453885-delete_volume" released by "delete_volume" :: held 3.100s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 20:01:36 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-b21e149e-59eb-43bb-b691-0d6f1ca87e34 tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Acquiring lock "cinder-2bbde7d0-3c47-4070-a7c6-1536c059e84a-delete_volume" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 20:01:36 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-b21e149e-59eb-43bb-b691-0d6f1ca87e34 tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Lock "cinder-2bbde7d0-3c47-4070-a7c6-1536c059e84a-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 20:01:36 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-b21e149e-59eb-43bb-b691-0d6f1ca87e34 tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Acquiring lock "cinder-quobyte-2bbde7d0-3c47-4070-a7c6-1536c059e84a" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 20:01:37 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-b21e149e-59eb-43bb-b691-0d6f1ca87e34 tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Lock "cinder-quobyte-2bbde7d0-3c47-4070-a7c6-1536c059e84a" acquired by "delete_volume" :: waited 0.031s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 20:01:37 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d55dc14-8484-4fcf-b8e0-bbdde88cdbc7]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 20:01:37 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-b21e149e-59eb-43bb-b691-0d6f1ca87e34 tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-2bbde7d0-3c47-4070-a7c6-1536c059e84a {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:01:37 devstack sudo[104716]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-2bbde7d0-3c47-4070-a7c6-1536c059e84a
Jul 02 20:01:37 devstack sudo[104716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:01:37 devstack sudo[104716]: pam_unix(sudo:session): session closed for user root
Jul 02 20:01:37 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-b21e149e-59eb-43bb-b691-0d6f1ca87e34 tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-2bbde7d0-3c47-4070-a7c6-1536c059e84a" returned: 0 in 0.892s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:01:37 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-b21e149e-59eb-43bb-b691-0d6f1ca87e34 tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-2bbde7d0-3c47-4070-a7c6-1536c059e84a {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:01:37 devstack sudo[104721]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-2bbde7d0-3c47-4070-a7c6-1536c059e84a
Jul 02 20:01:37 devstack sudo[104721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:01:38 devstack sudo[104721]: pam_unix(sudo:session): session closed for user root
Jul 02 20:01:38 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-b21e149e-59eb-43bb-b691-0d6f1ca87e34 tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-2bbde7d0-3c47-4070-a7c6-1536c059e84a" returned: 0 in 0.833s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:01:38 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-b21e149e-59eb-43bb-b691-0d6f1ca87e34 tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Lock "cinder-quobyte-2bbde7d0-3c47-4070-a7c6-1536c059e84a" released by "delete_volume" :: held 1.787s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 20:01:38 devstack cinder-volume[86639]: DEBUG cinder.quota [None req-b21e149e-59eb-43bb-b691-0d6f1ca87e34 tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Created reservations ['4e8a8457-f281-4e70-89a4-9cae60f01e44', 'b561832a-7020-4cfa-98eb-b11b755022a1', '13139970-eb12-43eb-bc48-b802d7a473ba', 'e0c6368d-bd09-4e9f-ad75-14fa8a0ef45d'] {{(pid=86639) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 20:01:38 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-b21e149e-59eb-43bb-b691-0d6f1ca87e34 tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 20:01:38 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-b21e149e-59eb-43bb-b691-0d6f1ca87e34 tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 20:01:38 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-b21e149e-59eb-43bb-b691-0d6f1ca87e34 tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 20:01:38 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-b21e149e-59eb-43bb-b691-0d6f1ca87e34 tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 20:01:38 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-b21e149e-59eb-43bb-b691-0d6f1ca87e34 tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 20:01:38 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-b21e149e-59eb-43bb-b691-0d6f1ca87e34 tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:01:38 devstack sudo[104724]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e
Jul 02 20:01:38 devstack sudo[104724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:01:39 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-fa1f38ce-7288-493d-aa01-942ac9173520 tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Acquiring lock "cinder-378fac18-afb5-4c3e-913c-8601d33393a1-delete_volume" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 20:01:39 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-fa1f38ce-7288-493d-aa01-942ac9173520 tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Lock "cinder-378fac18-afb5-4c3e-913c-8601d33393a1-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 20:01:39 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-fa1f38ce-7288-493d-aa01-942ac9173520 tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Acquiring lock "cinder-quobyte-378fac18-afb5-4c3e-913c-8601d33393a1" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 20:01:39 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-fa1f38ce-7288-493d-aa01-942ac9173520 tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Lock "cinder-quobyte-378fac18-afb5-4c3e-913c-8601d33393a1" acquired by "delete_volume" :: waited 0.047s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 20:01:39 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f509059-c01b-4c50-a758-0da975414320]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 20:01:39 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-fa1f38ce-7288-493d-aa01-942ac9173520 tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-378fac18-afb5-4c3e-913c-8601d33393a1 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:01:39 devstack sudo[104726]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-378fac18-afb5-4c3e-913c-8601d33393a1
Jul 02 20:01:39 devstack sudo[104726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:01:39 devstack sudo[104724]: pam_unix(sudo:session): session closed for user root
Jul 02 20:01:39 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-b21e149e-59eb-43bb-b691-0d6f1ca87e34 tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e" returned: 0 in 1.012s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:01:39 devstack cinder-volume[86639]: DEBUG cinder.manager [None req-b21e149e-59eb-43bb-b691-0d6f1ca87e34 tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Notifying Schedulers of capabilities ... {{(pid=86639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 20:01:39 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-b21e149e-59eb-43bb-b691-0d6f1ca87e34 tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Deleted volume successfully.
Jul 02 20:01:40 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-b21e149e-59eb-43bb-b691-0d6f1ca87e34 tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Lock "cinder-2bbde7d0-3c47-4070-a7c6-1536c059e84a-delete_volume" released by "delete_volume" :: held 3.082s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 20:01:40 devstack sudo[104726]: pam_unix(sudo:session): session closed for user root
Jul 02 20:01:40 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-fa1f38ce-7288-493d-aa01-942ac9173520 tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-378fac18-afb5-4c3e-913c-8601d33393a1" returned: 0 in 1.055s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:01:40 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-fa1f38ce-7288-493d-aa01-942ac9173520 tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-378fac18-afb5-4c3e-913c-8601d33393a1 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:01:40 devstack sudo[104734]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-378fac18-afb5-4c3e-913c-8601d33393a1
Jul 02 20:01:40 devstack sudo[104734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:01:41 devstack cinder-volume[86639]: DEBUG cinder.volume.flows.manager.create_volume [None req-01bac917-2cb8-4dab-8fb4-774aebf265f1 tempest-TestServerVolumeAttachmentScenario-1761887952 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 20:01:41 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-01bac917-2cb8-4dab-8fb4-774aebf265f1 tempest-TestServerVolumeAttachmentScenario-1761887952 None] Flow 'volume_create_manager' (07d540f2-db5a-4d0d-85d2-236149210bc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 20:01:41 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-01bac917-2cb8-4dab-8fb4-774aebf265f1 tempest-TestServerVolumeAttachmentScenario-1761887952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5009e19-3293-40fe-a7a5-836f38f421d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:01:41 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-01bac917-2cb8-4dab-8fb4-774aebf265f1 tempest-TestServerVolumeAttachmentScenario-1761887952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5009e19-3293-40fe-a7a5-836f38f421d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T18:01:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1858506318',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3176f4d1-2a0d-4e63-8a99-e0118b014efd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0555b9344dd4c03ae1c7b844bfb7cda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T18:01:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T18:01:41Z,use_quota=True,user_id='8057200c3b8d4686a2ada4b82b516d1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:01:41 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-01bac917-2cb8-4dab-8fb4-774aebf265f1 tempest-TestServerVolumeAttachmentScenario-1761887952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5490589b-6edf-45b5-9409-0001dbb1ba56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:01:41 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-01bac917-2cb8-4dab-8fb4-774aebf265f1 tempest-TestServerVolumeAttachmentScenario-1761887952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5490589b-6edf-45b5-9409-0001dbb1ba56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:01:41 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-01bac917-2cb8-4dab-8fb4-774aebf265f1 tempest-TestServerVolumeAttachmentScenario-1761887952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d990eb53-6c4c-4405-a43a-1e885a61d32d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:01:41 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-01bac917-2cb8-4dab-8fb4-774aebf265f1 tempest-TestServerVolumeAttachmentScenario-1761887952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d990eb53-6c4c-4405-a43a-1e885a61d32d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3176f4d1-2a0d-4e63-8a99-e0118b014efd', 'volume_name': 'volume-3176f4d1-2a0d-4e63-8a99-e0118b014efd', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:01:41 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-01bac917-2cb8-4dab-8fb4-774aebf265f1 tempest-TestServerVolumeAttachmentScenario-1761887952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f88f905-8e1c-4bcf-8936-76cbf8714b64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:01:41 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-01bac917-2cb8-4dab-8fb4-774aebf265f1 tempest-TestServerVolumeAttachmentScenario-1761887952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f88f905-8e1c-4bcf-8936-76cbf8714b64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:01:41 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-01bac917-2cb8-4dab-8fb4-774aebf265f1 tempest-TestServerVolumeAttachmentScenario-1761887952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8f509d7-483c-44d8-b045-bf4600fed327) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:01:41 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-01bac917-2cb8-4dab-8fb4-774aebf265f1 tempest-TestServerVolumeAttachmentScenario-1761887952 None] Volume 3176f4d1-2a0d-4e63-8a99-e0118b014efd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3176f4d1-2a0d-4e63-8a99-e0118b014efd', 'volume_size': 1}
Jul 02 20:01:41 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-01bac917-2cb8-4dab-8fb4-774aebf265f1 tempest-TestServerVolumeAttachmentScenario-1761887952 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 20:01:41 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-01bac917-2cb8-4dab-8fb4-774aebf265f1 tempest-TestServerVolumeAttachmentScenario-1761887952 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 20:01:41 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-01bac917-2cb8-4dab-8fb4-774aebf265f1 tempest-TestServerVolumeAttachmentScenario-1761887952 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce906cb830>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T18:01:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1858506318',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3176f4d1-2a0d-4e63-8a99-e0118b014efd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0555b9344dd4c03ae1c7b844bfb7cda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T18:01:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T18:01:41Z,use_quota=True,user_id='8057200c3b8d4686a2ada4b82b516d1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)}" {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 20:01:41 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-01bac917-2cb8-4dab-8fb4-774aebf265f1 tempest-TestServerVolumeAttachmentScenario-1761887952 None] Creating volume 3176f4d1-2a0d-4e63-8a99-e0118b014efd {{(pid=86639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 20:01:41 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-01bac917-2cb8-4dab-8fb4-774aebf265f1 tempest-TestServerVolumeAttachmentScenario-1761887952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 20:01:41 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-01bac917-2cb8-4dab-8fb4-774aebf265f1 tempest-TestServerVolumeAttachmentScenario-1761887952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.017s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 20:01:41 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-01bac917-2cb8-4dab-8fb4-774aebf265f1 tempest-TestServerVolumeAttachmentScenario-1761887952 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 20:01:41 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-01bac917-2cb8-4dab-8fb4-774aebf265f1 tempest-TestServerVolumeAttachmentScenario-1761887952 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 20:01:41 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-01bac917-2cb8-4dab-8fb4-774aebf265f1 tempest-TestServerVolumeAttachmentScenario-1761887952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 20:01:41 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-01bac917-2cb8-4dab-8fb4-774aebf265f1 tempest-TestServerVolumeAttachmentScenario-1761887952 None] Selected osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92 as target Quobyte volume. {{(pid=86639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 20:01:41 devstack cinder-volume[86639]: INFO cinder.volume.drivers.remotefs [None req-01bac917-2cb8-4dab-8fb4-774aebf265f1 tempest-TestServerVolumeAttachmentScenario-1761887952 None] casted to osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92
Jul 02 20:01:41 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-01bac917-2cb8-4dab-8fb4-774aebf265f1 tempest-TestServerVolumeAttachmentScenario-1761887952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-3176f4d1-2a0d-4e63-8a99-e0118b014efd 1073741824 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:01:41 devstack sudo[104737]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-3176f4d1-2a0d-4e63-8a99-e0118b014efd 1073741824
Jul 02 20:01:41 devstack sudo[104737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:01:41 devstack cinder-volume[86639]: DEBUG oslo_service.periodic_task [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86639) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 02 20:01:41 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 20:01:41 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 20:01:41 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 20:01:41 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 20:01:41 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 20:01:41 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:01:41 devstack sudo[104740]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e
Jul 02 20:01:41 devstack sudo[104740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:01:41 devstack sudo[104734]: pam_unix(sudo:session): session closed for user root
Jul 02 20:01:41 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-fa1f38ce-7288-493d-aa01-942ac9173520 tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-378fac18-afb5-4c3e-913c-8601d33393a1" returned: 0 in 1.121s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:01:41 devstack cinder-volume[86639]: DEBUG cinder.volume.flows.manager.create_volume [None req-f67f17e8-cfa3-444d-b34e-700110a685e7 tempest-TestServerVolumeAttachmentScenario-1761887952 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 20:01:41 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-f67f17e8-cfa3-444d-b34e-700110a685e7 tempest-TestServerVolumeAttachmentScenario-1761887952 None] Flow 'volume_create_manager' (21de2906-114a-4798-9971-6f9aea914cf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 20:01:41 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-f67f17e8-cfa3-444d-b34e-700110a685e7 tempest-TestServerVolumeAttachmentScenario-1761887952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c296a776-7814-4b97-8d89-9dfa0c81ec67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:01:41 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-fa1f38ce-7288-493d-aa01-942ac9173520 tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Lock "cinder-quobyte-378fac18-afb5-4c3e-913c-8601d33393a1" released by "delete_volume" :: held 2.300s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 20:01:41 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-f67f17e8-cfa3-444d-b34e-700110a685e7 tempest-TestServerVolumeAttachmentScenario-1761887952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c296a776-7814-4b97-8d89-9dfa0c81ec67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T18:01:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1732890856',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f0c28ce-9fcf-43b4-8606-c979fe33f49e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0555b9344dd4c03ae1c7b844bfb7cda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T18:01:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T18:01:42Z,use_quota=True,user_id='8057200c3b8d4686a2ada4b82b516d1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:01:41 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-f67f17e8-cfa3-444d-b34e-700110a685e7 tempest-TestServerVolumeAttachmentScenario-1761887952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (844f0b78-1b9f-470a-9d40-1694235421a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:01:41 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-f67f17e8-cfa3-444d-b34e-700110a685e7 tempest-TestServerVolumeAttachmentScenario-1761887952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (844f0b78-1b9f-470a-9d40-1694235421a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:01:41 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-f67f17e8-cfa3-444d-b34e-700110a685e7 tempest-TestServerVolumeAttachmentScenario-1761887952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10969d90-1074-42c3-b327-a14cc9578863) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:01:41 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-f67f17e8-cfa3-444d-b34e-700110a685e7 tempest-TestServerVolumeAttachmentScenario-1761887952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10969d90-1074-42c3-b327-a14cc9578863) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f0c28ce-9fcf-43b4-8606-c979fe33f49e', 'volume_name': 'volume-3f0c28ce-9fcf-43b4-8606-c979fe33f49e', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:01:41 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-f67f17e8-cfa3-444d-b34e-700110a685e7 tempest-TestServerVolumeAttachmentScenario-1761887952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (296f90b8-5ebd-43a8-8c5b-c7e48bc5bc81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:01:41 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-f67f17e8-cfa3-444d-b34e-700110a685e7 tempest-TestServerVolumeAttachmentScenario-1761887952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (296f90b8-5ebd-43a8-8c5b-c7e48bc5bc81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:01:41 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-f67f17e8-cfa3-444d-b34e-700110a685e7 tempest-TestServerVolumeAttachmentScenario-1761887952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1719445a-c046-4c32-b379-f9e426098c23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:01:41 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-f67f17e8-cfa3-444d-b34e-700110a685e7 tempest-TestServerVolumeAttachmentScenario-1761887952 None] Volume 3f0c28ce-9fcf-43b4-8606-c979fe33f49e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f0c28ce-9fcf-43b4-8606-c979fe33f49e', 'volume_size': 1}
Jul 02 20:01:41 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-f67f17e8-cfa3-444d-b34e-700110a685e7 tempest-TestServerVolumeAttachmentScenario-1761887952 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 20:01:41 devstack cinder-volume[86639]: DEBUG cinder.quota [None req-fa1f38ce-7288-493d-aa01-942ac9173520 tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Created reservations ['a9e1fe21-4dbc-4bda-ab46-a6705cec1e10', '95052a92-0723-4724-871b-93d99ab3c984', 'f9b8aab0-eeeb-4fd1-bcaa-8e97439aa67e', '57c5bccb-9b69-4a5a-86e3-f113463daf69'] {{(pid=86639) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 20:01:41 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-fa1f38ce-7288-493d-aa01-942ac9173520 tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 20:01:41 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-fa1f38ce-7288-493d-aa01-942ac9173520 tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 20:01:41 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-fa1f38ce-7288-493d-aa01-942ac9173520 tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 20:01:41 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-fa1f38ce-7288-493d-aa01-942ac9173520 tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 20:01:41 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-fa1f38ce-7288-493d-aa01-942ac9173520 tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 20:01:42 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-fa1f38ce-7288-493d-aa01-942ac9173520 tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:01:42 devstack sudo[104742]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e
Jul 02 20:01:42 devstack sudo[104742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:01:42 devstack sudo[104740]: pam_unix(sudo:session): session closed for user root
Jul 02 20:01:42 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e" returned: 0 in 1.204s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:01:42 devstack cinder-volume[86639]: DEBUG cinder.manager [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] Notifying Schedulers of capabilities ... {{(pid=86639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 20:01:42 devstack cinder-volume[86639]: DEBUG oslo_service.periodic_task [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] Running periodic task VolumeManager._thread_info {{(pid=86639) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 02 20:01:42 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] thread count: 28 {{(pid=86639) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 02 20:01:42 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] thread info: [<_MainThread(MainThread, started 140525261275264)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 140525150678016)>, <Thread(Thread-3 (stat_writer), started daemon 140525150025920)>, <Thread(Rabbit-heartbeat, started daemon 140525150500864)>, <Thread(Thread-5 (_runner), started daemon 140525149847296)>, <Thread(Thread-7 (_runner), started daemon 140525149863424)>, <Thread(fd_logger, started daemon 140525146589376)>, <Thread(privsep_reader, started daemon 140525144562432)>, <Thread(tpool_thread_0, started daemon 140525137151680)>, <Thread(tpool_thread_1, started daemon 140525128758976)>, <Thread(tpool_thread_2, started daemon 140525120349888)>, <Thread(tpool_thread_3, started daemon 140525111940800)>, <Thread(tpool_thread_4, started daemon 140525103531712)>, <Thread(tpool_thread_5, started daemon 140525095122624)>, <Thread(tpool_thread_6, started daemon 140525086713536)>, <Thread(tpool_thread_7, started daemon 140525078304448)>, <Thread(tpool_thread_8, started daemon 140525069895360)>, <Thread(tpool_thread_9, started daemon 140525061486272)>, <Thread(tpool_thread_10, started daemon 140525053077184)>, <Thread(tpool_thread_11, started daemon 140525044668096)>, <Thread(tpool_thread_12, started daemon 140525036259008)>, <Thread(tpool_thread_13, started daemon 140525027849920)>, <Thread(tpool_thread_14, started daemon 140525019440832)>, <Thread(tpool_thread_15, started daemon 140525011031744)>, <Thread(tpool_thread_16, started daemon 140525002622656)>, <Thread(tpool_thread_17, started daemon 140524994213568)>, <Thread(tpool_thread_18, started daemon 140524985804480)>, <Thread(tpool_thread_19, started daemon 140524977395392)>] {{(pid=86639) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 02 20:01:42 devstack sudo[104737]: pam_unix(sudo:session): session closed for user root
Jul 02 20:01:42 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-cad64c13-2273-45cb-acbe-616da18fe945 tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Acquiring lock "cinder-e47c5f34-b71b-4a0e-8696-604ea92d203a-delete_volume" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 20:01:42 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-01bac917-2cb8-4dab-8fb4-774aebf265f1 tempest-TestServerVolumeAttachmentScenario-1761887952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-3176f4d1-2a0d-4e63-8a99-e0118b014efd 1073741824" returned: 0 in 1.568s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:01:42 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-cad64c13-2273-45cb-acbe-616da18fe945 tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Lock "cinder-e47c5f34-b71b-4a0e-8696-604ea92d203a-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 20:01:42 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-01bac917-2cb8-4dab-8fb4-774aebf265f1 tempest-TestServerVolumeAttachmentScenario-1761887952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-3176f4d1-2a0d-4e63-8a99-e0118b014efd {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:01:42 devstack sudo[104749]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-3176f4d1-2a0d-4e63-8a99-e0118b014efd
Jul 02 20:01:42 devstack sudo[104749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:01:42 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-cad64c13-2273-45cb-acbe-616da18fe945 tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Acquiring lock "cinder-quobyte-e47c5f34-b71b-4a0e-8696-604ea92d203a" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 20:01:42 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-cad64c13-2273-45cb-acbe-616da18fe945 tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Lock "cinder-quobyte-e47c5f34-b71b-4a0e-8696-604ea92d203a" acquired by "delete_volume" :: waited 0.045s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 20:01:43 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[03338097-8c28-42eb-afb1-3fe86f5eeecd]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 20:01:43 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-cad64c13-2273-45cb-acbe-616da18fe945 tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-e47c5f34-b71b-4a0e-8696-604ea92d203a {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:01:43 devstack sudo[104742]: pam_unix(sudo:session): session closed for user root
Jul 02 20:01:43 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-fa1f38ce-7288-493d-aa01-942ac9173520 tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e" returned: 0 in 1.220s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:01:43 devstack sudo[104752]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-e47c5f34-b71b-4a0e-8696-604ea92d203a
Jul 02 20:01:43 devstack sudo[104752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:01:43 devstack cinder-volume[86639]: DEBUG cinder.manager [None req-fa1f38ce-7288-493d-aa01-942ac9173520 tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Notifying Schedulers of capabilities ... {{(pid=86639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 20:01:43 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-fa1f38ce-7288-493d-aa01-942ac9173520 tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Deleted volume successfully.
Jul 02 20:01:43 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-fa1f38ce-7288-493d-aa01-942ac9173520 tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Lock "cinder-378fac18-afb5-4c3e-913c-8601d33393a1-delete_volume" released by "delete_volume" :: held 3.955s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 20:01:43 devstack sudo[104749]: pam_unix(sudo:session): session closed for user root
Jul 02 20:01:43 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-01bac917-2cb8-4dab-8fb4-774aebf265f1 tempest-TestServerVolumeAttachmentScenario-1761887952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-3176f4d1-2a0d-4e63-8a99-e0118b014efd" returned: 0 in 1.034s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:01:43 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-01bac917-2cb8-4dab-8fb4-774aebf265f1 tempest-TestServerVolumeAttachmentScenario-1761887952 None] <== create_volume: return (2692ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'} {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 20:01:43 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-01bac917-2cb8-4dab-8fb4-774aebf265f1 tempest-TestServerVolumeAttachmentScenario-1761887952 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.705s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 20:01:43 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-f67f17e8-cfa3-444d-b34e-700110a685e7 tempest-TestServerVolumeAttachmentScenario-1761887952 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.106s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 20:01:43 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-f67f17e8-cfa3-444d-b34e-700110a685e7 tempest-TestServerVolumeAttachmentScenario-1761887952 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce906cb830>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T18:01:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1732890856',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f0c28ce-9fcf-43b4-8606-c979fe33f49e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0555b9344dd4c03ae1c7b844bfb7cda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T18:01:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T18:01:42Z,use_quota=True,user_id='8057200c3b8d4686a2ada4b82b516d1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)}" {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 20:01:43 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-f67f17e8-cfa3-444d-b34e-700110a685e7 tempest-TestServerVolumeAttachmentScenario-1761887952 None] Creating volume 3f0c28ce-9fcf-43b4-8606-c979fe33f49e {{(pid=86639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 20:01:43 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-f67f17e8-cfa3-444d-b34e-700110a685e7 tempest-TestServerVolumeAttachmentScenario-1761887952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 20:01:43 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-f67f17e8-cfa3-444d-b34e-700110a685e7 tempest-TestServerVolumeAttachmentScenario-1761887952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 20:01:43 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-f67f17e8-cfa3-444d-b34e-700110a685e7 tempest-TestServerVolumeAttachmentScenario-1761887952 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 20:01:43 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-f67f17e8-cfa3-444d-b34e-700110a685e7 tempest-TestServerVolumeAttachmentScenario-1761887952 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 20:01:43 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-f67f17e8-cfa3-444d-b34e-700110a685e7 tempest-TestServerVolumeAttachmentScenario-1761887952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 20:01:43 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-f67f17e8-cfa3-444d-b34e-700110a685e7 tempest-TestServerVolumeAttachmentScenario-1761887952 None] Selected osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92 as target Quobyte volume. {{(pid=86639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 20:01:43 devstack cinder-volume[86639]: INFO cinder.volume.drivers.remotefs [None req-f67f17e8-cfa3-444d-b34e-700110a685e7 tempest-TestServerVolumeAttachmentScenario-1761887952 None] casted to osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92
Jul 02 20:01:43 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-f67f17e8-cfa3-444d-b34e-700110a685e7 tempest-TestServerVolumeAttachmentScenario-1761887952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-3f0c28ce-9fcf-43b4-8606-c979fe33f49e 1073741824 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:01:43 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-01bac917-2cb8-4dab-8fb4-774aebf265f1 tempest-TestServerVolumeAttachmentScenario-1761887952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8f509d7-483c-44d8-b045-bf4600fed327) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3176f4d1-2a0d-4e63-8a99-e0118b014efd', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:01:43 devstack sudo[104756]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-3f0c28ce-9fcf-43b4-8606-c979fe33f49e 1073741824
Jul 02 20:01:43 devstack sudo[104756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:01:44 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-01bac917-2cb8-4dab-8fb4-774aebf265f1 tempest-TestServerVolumeAttachmentScenario-1761887952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0cfd9ffd-6226-4ea5-baf7-a7bd4482c0a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:01:44 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-01bac917-2cb8-4dab-8fb4-774aebf265f1 tempest-TestServerVolumeAttachmentScenario-1761887952 None] Volume volume-3176f4d1-2a0d-4e63-8a99-e0118b014efd (3176f4d1-2a0d-4e63-8a99-e0118b014efd): created successfully
Jul 02 20:01:44 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-01bac917-2cb8-4dab-8fb4-774aebf265f1 tempest-TestServerVolumeAttachmentScenario-1761887952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0cfd9ffd-6226-4ea5-baf7-a7bd4482c0a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:01:44 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-01bac917-2cb8-4dab-8fb4-774aebf265f1 tempest-TestServerVolumeAttachmentScenario-1761887952 None] Flow 'volume_create_manager' (07d540f2-db5a-4d0d-85d2-236149210bc5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 20:01:44 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-01bac917-2cb8-4dab-8fb4-774aebf265f1 tempest-TestServerVolumeAttachmentScenario-1761887952 None] Created volume successfully.
Jul 02 20:01:44 devstack sudo[104752]: pam_unix(sudo:session): session closed for user root
Jul 02 20:01:44 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-cad64c13-2273-45cb-acbe-616da18fe945 tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-e47c5f34-b71b-4a0e-8696-604ea92d203a" returned: 0 in 1.194s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:01:44 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-cad64c13-2273-45cb-acbe-616da18fe945 tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-e47c5f34-b71b-4a0e-8696-604ea92d203a {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:01:44 devstack sudo[104762]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-e47c5f34-b71b-4a0e-8696-604ea92d203a
Jul 02 20:01:44 devstack sudo[104762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:01:45 devstack sudo[104762]: pam_unix(sudo:session): session closed for user root
Jul 02 20:01:45 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-cad64c13-2273-45cb-acbe-616da18fe945 tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-e47c5f34-b71b-4a0e-8696-604ea92d203a" returned: 0 in 0.820s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:01:45 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-cad64c13-2273-45cb-acbe-616da18fe945 tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Lock "cinder-quobyte-e47c5f34-b71b-4a0e-8696-604ea92d203a" released by "delete_volume" :: held 2.078s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 20:01:45 devstack sudo[104756]: pam_unix(sudo:session): session closed for user root
Jul 02 20:01:45 devstack cinder-volume[86639]: DEBUG cinder.quota [None req-cad64c13-2273-45cb-acbe-616da18fe945 tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Created reservations ['7685d283-185b-4369-8447-30653b9971b9', '6ddff95a-4fbc-4c0a-b7e1-df7a1a6e69bb', '2876d9af-8b20-473b-9136-3b456caf311e', '8b67c5c5-f222-4f12-882a-3fc953d0e0bb'] {{(pid=86639) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 20:01:45 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-f67f17e8-cfa3-444d-b34e-700110a685e7 tempest-TestServerVolumeAttachmentScenario-1761887952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-3f0c28ce-9fcf-43b4-8606-c979fe33f49e 1073741824" returned: 0 in 1.210s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:01:45 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-f67f17e8-cfa3-444d-b34e-700110a685e7 tempest-TestServerVolumeAttachmentScenario-1761887952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-3f0c28ce-9fcf-43b4-8606-c979fe33f49e {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:01:45 devstack sudo[104836]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-3f0c28ce-9fcf-43b4-8606-c979fe33f49e
Jul 02 20:01:45 devstack sudo[104836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:01:45 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-cad64c13-2273-45cb-acbe-616da18fe945 tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 20:01:45 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-cad64c13-2273-45cb-acbe-616da18fe945 tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 20:01:45 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-cad64c13-2273-45cb-acbe-616da18fe945 tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 20:01:45 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-cad64c13-2273-45cb-acbe-616da18fe945 tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 20:01:45 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-cad64c13-2273-45cb-acbe-616da18fe945 tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 20:01:45 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-cad64c13-2273-45cb-acbe-616da18fe945 tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:01:45 devstack sudo[104838]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e
Jul 02 20:01:45 devstack sudo[104838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:01:46 devstack sudo[104838]: pam_unix(sudo:session): session closed for user root
Jul 02 20:01:46 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-cad64c13-2273-45cb-acbe-616da18fe945 tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e" returned: 0 in 0.782s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:01:46 devstack cinder-volume[86639]: DEBUG cinder.manager [None req-cad64c13-2273-45cb-acbe-616da18fe945 tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Notifying Schedulers of capabilities ... {{(pid=86639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 20:01:46 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-cad64c13-2273-45cb-acbe-616da18fe945 tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Deleted volume successfully.
Jul 02 20:01:46 devstack sudo[104836]: pam_unix(sudo:session): session closed for user root
Jul 02 20:01:46 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-f67f17e8-cfa3-444d-b34e-700110a685e7 tempest-TestServerVolumeAttachmentScenario-1761887952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-3f0c28ce-9fcf-43b4-8606-c979fe33f49e" returned: 0 in 0.903s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:01:46 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-f67f17e8-cfa3-444d-b34e-700110a685e7 tempest-TestServerVolumeAttachmentScenario-1761887952 None] <== create_volume: return (2168ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'} {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 20:01:46 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-f67f17e8-cfa3-444d-b34e-700110a685e7 tempest-TestServerVolumeAttachmentScenario-1761887952 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.173s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 20:01:46 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-cad64c13-2273-45cb-acbe-616da18fe945 tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Lock "cinder-e47c5f34-b71b-4a0e-8696-604ea92d203a-delete_volume" released by "delete_volume" :: held 3.257s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 20:01:46 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-f67f17e8-cfa3-444d-b34e-700110a685e7 tempest-TestServerVolumeAttachmentScenario-1761887952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1719445a-c046-4c32-b379-f9e426098c23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f0c28ce-9fcf-43b4-8606-c979fe33f49e', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:01:46 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-f67f17e8-cfa3-444d-b34e-700110a685e7 tempest-TestServerVolumeAttachmentScenario-1761887952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01178af6-ba1f-4b9f-b7b1-299dafb0f719) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:01:46 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-f67f17e8-cfa3-444d-b34e-700110a685e7 tempest-TestServerVolumeAttachmentScenario-1761887952 None] Volume volume-3f0c28ce-9fcf-43b4-8606-c979fe33f49e (3f0c28ce-9fcf-43b4-8606-c979fe33f49e): created successfully
Jul 02 20:01:46 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-f67f17e8-cfa3-444d-b34e-700110a685e7 tempest-TestServerVolumeAttachmentScenario-1761887952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01178af6-ba1f-4b9f-b7b1-299dafb0f719) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:01:46 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-f67f17e8-cfa3-444d-b34e-700110a685e7 tempest-TestServerVolumeAttachmentScenario-1761887952 None] Flow 'volume_create_manager' (21de2906-114a-4798-9971-6f9aea914cf4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 20:01:46 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-f67f17e8-cfa3-444d-b34e-700110a685e7 tempest-TestServerVolumeAttachmentScenario-1761887952 None] Created volume successfully.
Jul 02 20:01:46 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-d4355065-58d0-4f36-b1f3-76d7916e1ecb tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Acquiring lock "cinder-4ac6a9a6-07cb-408a-82e7-8258f3c089bf-delete_volume" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 20:01:46 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-d4355065-58d0-4f36-b1f3-76d7916e1ecb tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Lock "cinder-4ac6a9a6-07cb-408a-82e7-8258f3c089bf-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 20:01:46 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-d4355065-58d0-4f36-b1f3-76d7916e1ecb tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Acquiring lock "cinder-quobyte-4ac6a9a6-07cb-408a-82e7-8258f3c089bf" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 20:01:46 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-d4355065-58d0-4f36-b1f3-76d7916e1ecb tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Lock "cinder-quobyte-4ac6a9a6-07cb-408a-82e7-8258f3c089bf" acquired by "delete_volume" :: waited 0.019s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 20:01:46 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7ffc3bc-c048-4fca-8b77-8808add8e789]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 20:01:46 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-d4355065-58d0-4f36-b1f3-76d7916e1ecb tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-4ac6a9a6-07cb-408a-82e7-8258f3c089bf {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:01:46 devstack sudo[104848]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-4ac6a9a6-07cb-408a-82e7-8258f3c089bf
Jul 02 20:01:46 devstack sudo[104848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:01:47 devstack sudo[104848]: pam_unix(sudo:session): session closed for user root
Jul 02 20:01:47 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-d4355065-58d0-4f36-b1f3-76d7916e1ecb tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-4ac6a9a6-07cb-408a-82e7-8258f3c089bf" returned: 0 in 0.785s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:01:47 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-d4355065-58d0-4f36-b1f3-76d7916e1ecb tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-4ac6a9a6-07cb-408a-82e7-8258f3c089bf {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:01:47 devstack sudo[104853]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-4ac6a9a6-07cb-408a-82e7-8258f3c089bf
Jul 02 20:01:47 devstack sudo[104853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:01:48 devstack sudo[104853]: pam_unix(sudo:session): session closed for user root
Jul 02 20:01:48 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-d4355065-58d0-4f36-b1f3-76d7916e1ecb tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-4ac6a9a6-07cb-408a-82e7-8258f3c089bf" returned: 0 in 0.904s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:01:48 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-d4355065-58d0-4f36-b1f3-76d7916e1ecb tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Lock "cinder-quobyte-4ac6a9a6-07cb-408a-82e7-8258f3c089bf" released by "delete_volume" :: held 1.749s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 20:01:48 devstack cinder-volume[86639]: DEBUG cinder.quota [None req-d4355065-58d0-4f36-b1f3-76d7916e1ecb tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Created reservations ['be81eff4-7898-47f1-9c05-9cd3e30b32a8', '84dbb21d-423b-4bfd-96bc-2568b420764d', '67f1c65b-bb3f-4a01-a0da-6236507ee3b3', '88e1c0f4-de06-43a1-8b98-0fc18b25ebed'] {{(pid=86639) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 20:01:48 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-d4355065-58d0-4f36-b1f3-76d7916e1ecb tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 20:01:48 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-d4355065-58d0-4f36-b1f3-76d7916e1ecb tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 20:01:48 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-d4355065-58d0-4f36-b1f3-76d7916e1ecb tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 20:01:48 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-d4355065-58d0-4f36-b1f3-76d7916e1ecb tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 20:01:48 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-d4355065-58d0-4f36-b1f3-76d7916e1ecb tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 20:01:48 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-d4355065-58d0-4f36-b1f3-76d7916e1ecb tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:01:48 devstack sudo[105219]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e
Jul 02 20:01:48 devstack sudo[105219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:01:48 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-e4f46055-6bc0-4294-914e-29ff88dd8bb2 tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Acquiring lock "cinder-ec7ba515-7a9d-4193-ae2c-e20241eb559a-delete_volume" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 20:01:48 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-e4f46055-6bc0-4294-914e-29ff88dd8bb2 tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Lock "cinder-ec7ba515-7a9d-4193-ae2c-e20241eb559a-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 20:01:48 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-e4f46055-6bc0-4294-914e-29ff88dd8bb2 tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Acquiring lock "cinder-quobyte-ec7ba515-7a9d-4193-ae2c-e20241eb559a" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 20:01:48 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-e4f46055-6bc0-4294-914e-29ff88dd8bb2 tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Lock "cinder-quobyte-ec7ba515-7a9d-4193-ae2c-e20241eb559a" acquired by "delete_volume" :: waited 0.050s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 20:01:48 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[462212bb-1e07-4ce8-994f-14375e13c46a]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 20:01:48 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-e4f46055-6bc0-4294-914e-29ff88dd8bb2 tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-ec7ba515-7a9d-4193-ae2c-e20241eb559a {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:01:49 devstack sudo[105230]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-ec7ba515-7a9d-4193-ae2c-e20241eb559a
Jul 02 20:01:49 devstack sudo[105230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:01:49 devstack sudo[105219]: pam_unix(sudo:session): session closed for user root
Jul 02 20:01:49 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-d4355065-58d0-4f36-b1f3-76d7916e1ecb tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e" returned: 0 in 1.147s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:01:49 devstack cinder-volume[86639]: DEBUG cinder.manager [None req-d4355065-58d0-4f36-b1f3-76d7916e1ecb tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Notifying Schedulers of capabilities ... {{(pid=86639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 20:01:49 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-d4355065-58d0-4f36-b1f3-76d7916e1ecb tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Deleted volume successfully.
Jul 02 20:01:49 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-d4355065-58d0-4f36-b1f3-76d7916e1ecb tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Lock "cinder-4ac6a9a6-07cb-408a-82e7-8258f3c089bf-delete_volume" released by "delete_volume" :: held 3.249s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 20:01:49 devstack sudo[105230]: pam_unix(sudo:session): session closed for user root
Jul 02 20:01:49 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-e4f46055-6bc0-4294-914e-29ff88dd8bb2 tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-ec7ba515-7a9d-4193-ae2c-e20241eb559a" returned: 0 in 1.003s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:01:49 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-e4f46055-6bc0-4294-914e-29ff88dd8bb2 tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-ec7ba515-7a9d-4193-ae2c-e20241eb559a {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:01:50 devstack sudo[105240]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-ec7ba515-7a9d-4193-ae2c-e20241eb559a
Jul 02 20:01:50 devstack sudo[105240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:01:50 devstack sudo[105240]: pam_unix(sudo:session): session closed for user root
Jul 02 20:01:50 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-e4f46055-6bc0-4294-914e-29ff88dd8bb2 tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-ec7ba515-7a9d-4193-ae2c-e20241eb559a" returned: 0 in 0.805s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:01:50 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-e4f46055-6bc0-4294-914e-29ff88dd8bb2 tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Lock "cinder-quobyte-ec7ba515-7a9d-4193-ae2c-e20241eb559a" released by "delete_volume" :: held 1.919s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 20:01:50 devstack cinder-volume[86639]: DEBUG cinder.quota [None req-e4f46055-6bc0-4294-914e-29ff88dd8bb2 tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Created reservations ['500ac47c-0e60-4cad-8f2b-33895d70af17', 'c25708a2-eed4-4059-8bd6-79313c29854f', 'c06c5e3c-ab22-4d49-b017-1507b838cfdd', '3dff025d-6f1e-4d74-ac8b-1dd0ff5b96d2'] {{(pid=86639) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 20:01:51 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-e4f46055-6bc0-4294-914e-29ff88dd8bb2 tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 20:01:51 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-e4f46055-6bc0-4294-914e-29ff88dd8bb2 tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 20:01:51 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-e4f46055-6bc0-4294-914e-29ff88dd8bb2 tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 20:01:51 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-e4f46055-6bc0-4294-914e-29ff88dd8bb2 tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 20:01:51 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-e4f46055-6bc0-4294-914e-29ff88dd8bb2 tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 20:01:51 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-e4f46055-6bc0-4294-914e-29ff88dd8bb2 tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:01:51 devstack sudo[105243]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e
Jul 02 20:01:51 devstack sudo[105243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:01:52 devstack sudo[105243]: pam_unix(sudo:session): session closed for user root
Jul 02 20:01:52 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-e4f46055-6bc0-4294-914e-29ff88dd8bb2 tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e" returned: 0 in 1.222s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:01:52 devstack cinder-volume[86639]: DEBUG cinder.manager [None req-e4f46055-6bc0-4294-914e-29ff88dd8bb2 tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Notifying Schedulers of capabilities ... {{(pid=86639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 20:01:52 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-e4f46055-6bc0-4294-914e-29ff88dd8bb2 tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Deleted volume successfully.
Jul 02 20:01:52 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-e4f46055-6bc0-4294-914e-29ff88dd8bb2 tempest-CreateVolumesFromSourceVolumeTest-1108097847 None] Lock "cinder-ec7ba515-7a9d-4193-ae2c-e20241eb559a-delete_volume" released by "delete_volume" :: held 3.693s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 20:01:59 devstack cinder-volume[86639]: DEBUG cinder.volume.flows.manager.create_volume [None req-5722b6c3-0f5e-4042-ac6b-ed52d9db52c7 tempest-VolumeImageDependencyTests-966831365 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 20:01:59 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-5722b6c3-0f5e-4042-ac6b-ed52d9db52c7 tempest-VolumeImageDependencyTests-966831365 None] Flow 'volume_create_manager' (4c192b9e-7c96-49b3-b979-611f8fd542d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 20:01:59 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-5722b6c3-0f5e-4042-ac6b-ed52d9db52c7 tempest-VolumeImageDependencyTests-966831365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4de9b97c-bee5-45f4-abc0-492f762aee02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:01:59 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-5722b6c3-0f5e-4042-ac6b-ed52d9db52c7 tempest-VolumeImageDependencyTests-966831365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4de9b97c-bee5-45f4-abc0-492f762aee02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T18:01:59Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96ce3f28-f43d-4952-a057-36cddc4c0f71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1b74adf78c84ea983f37acb26ce9145',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T18:01:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T18:01:59Z,use_quota=True,user_id='2acea039282e433ea83b399606a588b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:01:59 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-5722b6c3-0f5e-4042-ac6b-ed52d9db52c7 tempest-VolumeImageDependencyTests-966831365 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8f9a60e-6b65-4109-9111-5f56dd3371f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:01:59 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-5722b6c3-0f5e-4042-ac6b-ed52d9db52c7 tempest-VolumeImageDependencyTests-966831365 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8f9a60e-6b65-4109-9111-5f56dd3371f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:01:59 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-5722b6c3-0f5e-4042-ac6b-ed52d9db52c7 tempest-VolumeImageDependencyTests-966831365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eeb54c7e-68bf-4a5c-a827-43dffb5fa636) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:01:59 devstack cinder-volume[86639]: DEBUG cinder.image.glance [None req-5722b6c3-0f5e-4042-ac6b-ed52d9db52c7 tempest-VolumeImageDependencyTests-966831365 None] Creating Keystone auth plugin from conf {{(pid=86639) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jul 02 20:01:59 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-5722b6c3-0f5e-4042-ac6b-ed52d9db52c7 tempest-VolumeImageDependencyTests-966831365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eeb54c7e-68bf-4a5c-a827-43dffb5fa636) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '96ce3f28-f43d-4952-a057-36cddc4c0f71', 'volume_name': 'volume-96ce3f28-f43d-4952-a057-36cddc4c0f71', 'volume_size': 1, 'image_id': '68d97eca-322c-41d7-aec1-995a44e77549', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/68d97eca-322c-41d7-aec1-995a44e77549', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ada696e536e9e284ed1ed1643ed59766', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b1b74adf78c84ea983f37acb26ce9145', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'dd6be3d221bc2a79354e1f55337465febef680605a26d745096ecd25f4772cdd25cf872326acbbff1cd2820282be573d8baa31a94d94ca0aa951e1e2d19092ea', 'id': '68d97eca-322c-41d7-aec1-995a44e77549', 'created_at': datetime.datetime(2026, 7, 2, 18, 1, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 2, 18, 1, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/68d97eca-322c-41d7-aec1-995a44e77549/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fce8f096810>}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:01:59 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-5722b6c3-0f5e-4042-ac6b-ed52d9db52c7 tempest-VolumeImageDependencyTests-966831365 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a6938dd-96cd-4a82-b316-99255ac91477) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:01:59 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-5722b6c3-0f5e-4042-ac6b-ed52d9db52c7 tempest-VolumeImageDependencyTests-966831365 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a6938dd-96cd-4a82-b316-99255ac91477) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:01:59 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-5722b6c3-0f5e-4042-ac6b-ed52d9db52c7 tempest-VolumeImageDependencyTests-966831365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (642f9b62-a7c9-4c77-96be-71d518d2dbdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:01:59 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-5722b6c3-0f5e-4042-ac6b-ed52d9db52c7 tempest-VolumeImageDependencyTests-966831365 None] Volume 96ce3f28-f43d-4952-a057-36cddc4c0f71: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-96ce3f28-f43d-4952-a057-36cddc4c0f71', 'volume_size': 1, 'image_id': '68d97eca-322c-41d7-aec1-995a44e77549', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/68d97eca-322c-41d7-aec1-995a44e77549', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ada696e536e9e284ed1ed1643ed59766', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b1b74adf78c84ea983f37acb26ce9145', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'dd6be3d221bc2a79354e1f55337465febef680605a26d745096ecd25f4772cdd25cf872326acbbff1cd2820282be573d8baa31a94d94ca0aa951e1e2d19092ea', 'id': '68d97eca-322c-41d7-aec1-995a44e77549', 'created_at': datetime.datetime(2026, 7, 2, 18, 1, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 2, 18, 1, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/68d97eca-322c-41d7-aec1-995a44e77549/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fce8f096810>}
Jul 02 20:01:59 devstack cinder-volume[86639]: DEBUG cinder.volume.flows.manager.create_volume [None req-5722b6c3-0f5e-4042-ac6b-ed52d9db52c7 tempest-VolumeImageDependencyTests-966831365 None] Trying to clone 96ce3f28-f43d-4952-a057-36cddc4c0f71 from image 68d97eca-322c-41d7-aec1-995a44e77549 at location (None, [{'url': 'file:///opt/stack/data/glance/images/68d97eca-322c-41d7-aec1-995a44e77549', 'metadata': {}}]). {{(pid=86639) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jul 02 20:02:00 devstack cinder-volume[86639]: DEBUG cinder.image.image_utils [None req-5722b6c3-0f5e-4042-ac6b-ed52d9db52c7 tempest-VolumeImageDependencyTests-966831365 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_68d97eca-322c-41d7-aec1-995a44e77549_gagec5xndevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86639) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jul 02 20:02:00 devstack cinder-volume[86639]: INFO cinder.image.image_utils [None req-5722b6c3-0f5e-4042-ac6b-ed52d9db52c7 tempest-VolumeImageDependencyTests-966831365 None] Image download 0.00 MB at 0.00 MB/s
Jul 02 20:02:00 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8b570ae-ce12-418b-8cc2-381f73977a8a]: (4, 'raw') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 20:02:00 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-5722b6c3-0f5e-4042-ac6b-ed52d9db52c7 tempest-VolumeImageDependencyTests-966831365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_68d97eca-322c-41d7-aec1-995a44e77549_gagec5xndevstack@QuobyteHD {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:02:00 devstack sudo[105336]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_68d97eca-322c-41d7-aec1-995a44e77549_gagec5xndevstack@QuobyteHD
Jul 02 20:02:00 devstack sudo[105336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:02:01 devstack sudo[105336]: pam_unix(sudo:session): session closed for user root
Jul 02 20:02:01 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-5722b6c3-0f5e-4042-ac6b-ed52d9db52c7 tempest-VolumeImageDependencyTests-966831365 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_68d97eca-322c-41d7-aec1-995a44e77549_gagec5xndevstack@QuobyteHD" returned: 0 in 0.970s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:02:01 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-5722b6c3-0f5e-4042-ac6b-ed52d9db52c7 tempest-VolumeImageDependencyTests-966831365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_68d97eca-322c-41d7-aec1-995a44e77549_gagec5xndevstack@QuobyteHD {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:02:01 devstack sudo[105343]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_68d97eca-322c-41d7-aec1-995a44e77549_gagec5xndevstack@QuobyteHD
Jul 02 20:02:01 devstack sudo[105343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:02:02 devstack sudo[105343]: pam_unix(sudo:session): session closed for user root
Jul 02 20:02:02 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-5722b6c3-0f5e-4042-ac6b-ed52d9db52c7 tempest-VolumeImageDependencyTests-966831365 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_68d97eca-322c-41d7-aec1-995a44e77549_gagec5xndevstack@QuobyteHD" returned: 1 in 0.910s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:02:02 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-5722b6c3-0f5e-4042-ac6b-ed52d9db52c7 tempest-VolumeImageDependencyTests-966831365 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_68d97eca-322c-41d7-aec1-995a44e77549_gagec5xndevstack@QuobyteHD' failed. Not Retrying. {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 02 20:02:02 devstack cinder-volume[86639]: DEBUG cinder.image.image_utils [None req-5722b6c3-0f5e-4042-ac6b-ed52d9db52c7 tempest-VolumeImageDependencyTests-966831365 None] Temporary image 68d97eca-322c-41d7-aec1-995a44e77549 is fetched for user 2acea039282e433ea83b399606a588b9. {{(pid=86639) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jul 02 20:02:02 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[7079aadc-ec01-464f-b02e-7587f510e678]: (4, 'raw') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 20:02:02 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-5722b6c3-0f5e-4042-ac6b-ed52d9db52c7 tempest-VolumeImageDependencyTests-966831365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_68d97eca-322c-41d7-aec1-995a44e77549_gagec5xndevstack@QuobyteHD {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:02:02 devstack sudo[105348]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_68d97eca-322c-41d7-aec1-995a44e77549_gagec5xndevstack@QuobyteHD
Jul 02 20:02:02 devstack sudo[105348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:02:03 devstack sudo[105348]: pam_unix(sudo:session): session closed for user root
Jul 02 20:02:03 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-5722b6c3-0f5e-4042-ac6b-ed52d9db52c7 tempest-VolumeImageDependencyTests-966831365 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_68d97eca-322c-41d7-aec1-995a44e77549_gagec5xndevstack@QuobyteHD" returned: 0 in 0.939s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:02:03 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-5722b6c3-0f5e-4042-ac6b-ed52d9db52c7 tempest-VolumeImageDependencyTests-966831365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_68d97eca-322c-41d7-aec1-995a44e77549_gagec5xndevstack@QuobyteHD {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:02:03 devstack sudo[105352]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_68d97eca-322c-41d7-aec1-995a44e77549_gagec5xndevstack@QuobyteHD
Jul 02 20:02:03 devstack sudo[105352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:02:04 devstack sudo[105352]: pam_unix(sudo:session): session closed for user root
Jul 02 20:02:04 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-5722b6c3-0f5e-4042-ac6b-ed52d9db52c7 tempest-VolumeImageDependencyTests-966831365 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_68d97eca-322c-41d7-aec1-995a44e77549_gagec5xndevstack@QuobyteHD" returned: 1 in 0.958s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:02:04 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-5722b6c3-0f5e-4042-ac6b-ed52d9db52c7 tempest-VolumeImageDependencyTests-966831365 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_68d97eca-322c-41d7-aec1-995a44e77549_gagec5xndevstack@QuobyteHD' failed. Not Retrying. {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 02 20:02:04 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-5722b6c3-0f5e-4042-ac6b-ed52d9db52c7 tempest-VolumeImageDependencyTests-966831365 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 20:02:04 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-5722b6c3-0f5e-4042-ac6b-ed52d9db52c7 tempest-VolumeImageDependencyTests-966831365 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 20:02:04 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-5722b6c3-0f5e-4042-ac6b-ed52d9db52c7 tempest-VolumeImageDependencyTests-966831365 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce906cb830>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T18:01:59Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96ce3f28-f43d-4952-a057-36cddc4c0f71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1b74adf78c84ea983f37acb26ce9145',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T18:01:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T18:01:59Z,use_quota=True,user_id='2acea039282e433ea83b399606a588b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)}" {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 20:02:04 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-5722b6c3-0f5e-4042-ac6b-ed52d9db52c7 tempest-VolumeImageDependencyTests-966831365 None] Creating volume 96ce3f28-f43d-4952-a057-36cddc4c0f71 {{(pid=86639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 20:02:04 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-5722b6c3-0f5e-4042-ac6b-ed52d9db52c7 tempest-VolumeImageDependencyTests-966831365 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 20:02:04 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-5722b6c3-0f5e-4042-ac6b-ed52d9db52c7 tempest-VolumeImageDependencyTests-966831365 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 20:02:04 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-5722b6c3-0f5e-4042-ac6b-ed52d9db52c7 tempest-VolumeImageDependencyTests-966831365 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 20:02:04 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-5722b6c3-0f5e-4042-ac6b-ed52d9db52c7 tempest-VolumeImageDependencyTests-966831365 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 20:02:04 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-5722b6c3-0f5e-4042-ac6b-ed52d9db52c7 tempest-VolumeImageDependencyTests-966831365 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 20:02:04 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-5722b6c3-0f5e-4042-ac6b-ed52d9db52c7 tempest-VolumeImageDependencyTests-966831365 None] Selected osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92 as target Quobyte volume. {{(pid=86639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 20:02:04 devstack cinder-volume[86639]: INFO cinder.volume.drivers.remotefs [None req-5722b6c3-0f5e-4042-ac6b-ed52d9db52c7 tempest-VolumeImageDependencyTests-966831365 None] casted to osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92
Jul 02 20:02:04 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-5722b6c3-0f5e-4042-ac6b-ed52d9db52c7 tempest-VolumeImageDependencyTests-966831365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-96ce3f28-f43d-4952-a057-36cddc4c0f71 1073741824 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:02:04 devstack sudo[105360]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-96ce3f28-f43d-4952-a057-36cddc4c0f71 1073741824
Jul 02 20:02:04 devstack sudo[105360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:02:05 devstack sudo[105360]: pam_unix(sudo:session): session closed for user root
Jul 02 20:02:05 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-5722b6c3-0f5e-4042-ac6b-ed52d9db52c7 tempest-VolumeImageDependencyTests-966831365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-96ce3f28-f43d-4952-a057-36cddc4c0f71 1073741824" returned: 0 in 0.966s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:02:05 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-5722b6c3-0f5e-4042-ac6b-ed52d9db52c7 tempest-VolumeImageDependencyTests-966831365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-96ce3f28-f43d-4952-a057-36cddc4c0f71 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:02:05 devstack sudo[105395]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-96ce3f28-f43d-4952-a057-36cddc4c0f71
Jul 02 20:02:05 devstack sudo[105395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:02:05 devstack sudo[105395]: pam_unix(sudo:session): session closed for user root
Jul 02 20:02:05 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-5722b6c3-0f5e-4042-ac6b-ed52d9db52c7 tempest-VolumeImageDependencyTests-966831365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-96ce3f28-f43d-4952-a057-36cddc4c0f71" returned: 0 in 0.620s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:02:05 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-5722b6c3-0f5e-4042-ac6b-ed52d9db52c7 tempest-VolumeImageDependencyTests-966831365 None] <== create_volume: return (1652ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'} {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 20:02:05 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-5722b6c3-0f5e-4042-ac6b-ed52d9db52c7 tempest-VolumeImageDependencyTests-966831365 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.655s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 20:02:06 devstack cinder-volume[86639]: DEBUG cinder.volume.volume_utils [None req-5722b6c3-0f5e-4042-ac6b-ed52d9db52c7 tempest-VolumeImageDependencyTests-966831365 None] Attempting download of 68d97eca-322c-41d7-aec1-995a44e77549 ((None, [{'url': 'file:///opt/stack/data/glance/images/68d97eca-322c-41d7-aec1-995a44e77549', 'metadata': {}}])) to volume 96ce3f28-f43d-4952-a057-36cddc4c0f71. {{(pid=86639) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jul 02 20:02:06 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[01ace30a-f315-493e-8f22-30bc5cb88ac0]: (4, 'raw') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 20:02:06 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-5722b6c3-0f5e-4042-ac6b-ed52d9db52c7 tempest-VolumeImageDependencyTests-966831365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_68d97eca-322c-41d7-aec1-995a44e77549_9ytbgqm2 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:02:06 devstack sudo[105398]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_68d97eca-322c-41d7-aec1-995a44e77549_9ytbgqm2
Jul 02 20:02:06 devstack sudo[105398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:02:06 devstack sudo[105398]: pam_unix(sudo:session): session closed for user root
Jul 02 20:02:06 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-5722b6c3-0f5e-4042-ac6b-ed52d9db52c7 tempest-VolumeImageDependencyTests-966831365 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_68d97eca-322c-41d7-aec1-995a44e77549_9ytbgqm2" returned: 0 in 0.770s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:02:06 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-5722b6c3-0f5e-4042-ac6b-ed52d9db52c7 tempest-VolumeImageDependencyTests-966831365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_68d97eca-322c-41d7-aec1-995a44e77549_9ytbgqm2 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:02:06 devstack sudo[105402]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_68d97eca-322c-41d7-aec1-995a44e77549_9ytbgqm2
Jul 02 20:02:06 devstack sudo[105402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:02:07 devstack sudo[105402]: pam_unix(sudo:session): session closed for user root
Jul 02 20:02:07 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-5722b6c3-0f5e-4042-ac6b-ed52d9db52c7 tempest-VolumeImageDependencyTests-966831365 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_68d97eca-322c-41d7-aec1-995a44e77549_9ytbgqm2" returned: 1 in 0.710s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:02:07 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-5722b6c3-0f5e-4042-ac6b-ed52d9db52c7 tempest-VolumeImageDependencyTests-966831365 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_68d97eca-322c-41d7-aec1-995a44e77549_9ytbgqm2' failed. Not Retrying. {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 02 20:02:07 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[09590f29-19e7-40c4-b32e-78468591a520]: (4, 'raw') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 20:02:07 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-5722b6c3-0f5e-4042-ac6b-ed52d9db52c7 tempest-VolumeImageDependencyTests-966831365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_68d97eca-322c-41d7-aec1-995a44e77549_gagec5xndevstack@QuobyteHD {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:02:07 devstack sudo[105406]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_68d97eca-322c-41d7-aec1-995a44e77549_gagec5xndevstack@QuobyteHD
Jul 02 20:02:07 devstack sudo[105406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:02:08 devstack sudo[105406]: pam_unix(sudo:session): session closed for user root
Jul 02 20:02:08 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-5722b6c3-0f5e-4042-ac6b-ed52d9db52c7 tempest-VolumeImageDependencyTests-966831365 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_68d97eca-322c-41d7-aec1-995a44e77549_gagec5xndevstack@QuobyteHD" returned: 0 in 0.727s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:02:08 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-5722b6c3-0f5e-4042-ac6b-ed52d9db52c7 tempest-VolumeImageDependencyTests-966831365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_68d97eca-322c-41d7-aec1-995a44e77549_gagec5xndevstack@QuobyteHD {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:02:08 devstack sudo[105410]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_68d97eca-322c-41d7-aec1-995a44e77549_gagec5xndevstack@QuobyteHD
Jul 02 20:02:08 devstack sudo[105410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:02:09 devstack sudo[105410]: pam_unix(sudo:session): session closed for user root
Jul 02 20:02:09 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-5722b6c3-0f5e-4042-ac6b-ed52d9db52c7 tempest-VolumeImageDependencyTests-966831365 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_68d97eca-322c-41d7-aec1-995a44e77549_gagec5xndevstack@QuobyteHD" returned: 1 in 0.736s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:02:09 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-5722b6c3-0f5e-4042-ac6b-ed52d9db52c7 tempest-VolumeImageDependencyTests-966831365 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_68d97eca-322c-41d7-aec1-995a44e77549_gagec5xndevstack@QuobyteHD' failed. Not Retrying. {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 02 20:02:09 devstack cinder-volume[86639]: DEBUG cinder.image.image_utils [None req-5722b6c3-0f5e-4042-ac6b-ed52d9db52c7 tempest-VolumeImageDependencyTests-966831365 None] 68d97eca-322c-41d7-aec1-995a44e77549 was raw, converting to raw {{(pid=86639) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jul 02 20:02:09 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-5722b6c3-0f5e-4042-ac6b-ed52d9db52c7 tempest-VolumeImageDependencyTests-966831365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_68d97eca-322c-41d7-aec1-995a44e77549_gagec5xndevstack@QuobyteHD /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-96ce3f28-f43d-4952-a057-36cddc4c0f71 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:02:09 devstack sudo[105415]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_68d97eca-322c-41d7-aec1-995a44e77549_gagec5xndevstack@QuobyteHD /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-96ce3f28-f43d-4952-a057-36cddc4c0f71
Jul 02 20:02:09 devstack sudo[105415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:02:09 devstack sudo[105415]: pam_unix(sudo:session): session closed for user root
Jul 02 20:02:09 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-5722b6c3-0f5e-4042-ac6b-ed52d9db52c7 tempest-VolumeImageDependencyTests-966831365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_68d97eca-322c-41d7-aec1-995a44e77549_gagec5xndevstack@QuobyteHD /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-96ce3f28-f43d-4952-a057-36cddc4c0f71" returned: 0 in 0.818s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:02:09 devstack cinder-volume[86639]: DEBUG cinder.image.image_utils [None req-5722b6c3-0f5e-4042-ac6b-ed52d9db52c7 tempest-VolumeImageDependencyTests-966831365 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_68d97eca-322c-41d7-aec1-995a44e77549_gagec5xndevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-96ce3f28-f43d-4952-a057-36cddc4c0f71 {{(pid=86639) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 02 20:02:09 devstack cinder-volume[86639]: INFO cinder.image.image_utils [None req-5722b6c3-0f5e-4042-ac6b-ed52d9db52c7 tempest-VolumeImageDependencyTests-966831365 None] Converted 0.00 MB image at 0.00 MB/s
Jul 02 20:02:09 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-5722b6c3-0f5e-4042-ac6b-ed52d9db52c7 tempest-VolumeImageDependencyTests-966831365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-96ce3f28-f43d-4952-a057-36cddc4c0f71 1G {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:02:09 devstack sudo[105420]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-96ce3f28-f43d-4952-a057-36cddc4c0f71 1G
Jul 02 20:02:09 devstack sudo[105420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:02:10 devstack sudo[105420]: pam_unix(sudo:session): session closed for user root
Jul 02 20:02:10 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-5722b6c3-0f5e-4042-ac6b-ed52d9db52c7 tempest-VolumeImageDependencyTests-966831365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-96ce3f28-f43d-4952-a057-36cddc4c0f71 1G" returned: 0 in 0.714s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:02:10 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b63f3c9-1b1b-485b-98ea-eba5ae77fa38]: (4, 'raw') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 20:02:10 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-5722b6c3-0f5e-4042-ac6b-ed52d9db52c7 tempest-VolumeImageDependencyTests-966831365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-96ce3f28-f43d-4952-a057-36cddc4c0f71 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:02:10 devstack sudo[105425]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-96ce3f28-f43d-4952-a057-36cddc4c0f71
Jul 02 20:02:10 devstack sudo[105425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:02:11 devstack sudo[105425]: pam_unix(sudo:session): session closed for user root
Jul 02 20:02:11 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-5722b6c3-0f5e-4042-ac6b-ed52d9db52c7 tempest-VolumeImageDependencyTests-966831365 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-96ce3f28-f43d-4952-a057-36cddc4c0f71" returned: 0 in 0.754s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:02:11 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-5722b6c3-0f5e-4042-ac6b-ed52d9db52c7 tempest-VolumeImageDependencyTests-966831365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-96ce3f28-f43d-4952-a057-36cddc4c0f71 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:02:11 devstack sudo[105429]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-96ce3f28-f43d-4952-a057-36cddc4c0f71
Jul 02 20:02:11 devstack sudo[105429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:02:12 devstack sudo[105429]: pam_unix(sudo:session): session closed for user root
Jul 02 20:02:12 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-5722b6c3-0f5e-4042-ac6b-ed52d9db52c7 tempest-VolumeImageDependencyTests-966831365 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-96ce3f28-f43d-4952-a057-36cddc4c0f71" returned: 1 in 0.856s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:02:12 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-5722b6c3-0f5e-4042-ac6b-ed52d9db52c7 tempest-VolumeImageDependencyTests-966831365 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-96ce3f28-f43d-4952-a057-36cddc4c0f71' failed. Not Retrying. {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 02 20:02:12 devstack cinder-volume[86639]: DEBUG cinder.volume.volume_utils [None req-5722b6c3-0f5e-4042-ac6b-ed52d9db52c7 tempest-VolumeImageDependencyTests-966831365 None] Downloaded image 68d97eca-322c-41d7-aec1-995a44e77549 ((None, [{'url': 'file:///opt/stack/data/glance/images/68d97eca-322c-41d7-aec1-995a44e77549', 'metadata': {}}])) to volume 96ce3f28-f43d-4952-a057-36cddc4c0f71 successfully. {{(pid=86639) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jul 02 20:02:12 devstack cinder-volume[86639]: DEBUG cinder.image.image_utils [None req-5722b6c3-0f5e-4042-ac6b-ed52d9db52c7 tempest-VolumeImageDependencyTests-966831365 None] Temporary image 68d97eca-322c-41d7-aec1-995a44e77549 for user 2acea039282e433ea83b399606a588b9 is deleted. {{(pid=86639) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jul 02 20:02:12 devstack cinder-volume[86639]: DEBUG cinder.volume.volume_utils [None req-5722b6c3-0f5e-4042-ac6b-ed52d9db52c7 tempest-VolumeImageDependencyTests-966831365 None] Marking volume 96ce3f28-f43d-4952-a057-36cddc4c0f71 as bootable. {{(pid=86639) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jul 02 20:02:12 devstack cinder-volume[86639]: DEBUG cinder.volume.flows.manager.create_volume [None req-5722b6c3-0f5e-4042-ac6b-ed52d9db52c7 tempest-VolumeImageDependencyTests-966831365 None] Copying metadata from image 68d97eca-322c-41d7-aec1-995a44e77549 to 96ce3f28-f43d-4952-a057-36cddc4c0f71. {{(pid=86639) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jul 02 20:02:12 devstack cinder-volume[86639]: DEBUG cinder.volume.flows.manager.create_volume [None req-5722b6c3-0f5e-4042-ac6b-ed52d9db52c7 tempest-VolumeImageDependencyTests-966831365 None] Creating volume glance metadata for volume 96ce3f28-f43d-4952-a057-36cddc4c0f71 backed by image 68d97eca-322c-41d7-aec1-995a44e77549 with: {'image_id': '68d97eca-322c-41d7-aec1-995a44e77549', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'ada696e536e9e284ed1ed1643ed59766', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86639) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jul 02 20:02:12 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-5722b6c3-0f5e-4042-ac6b-ed52d9db52c7 tempest-VolumeImageDependencyTests-966831365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (642f9b62-a7c9-4c77-96be-71d518d2dbdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96ce3f28-f43d-4952-a057-36cddc4c0f71', 'volume_size': 1, 'image_id': '68d97eca-322c-41d7-aec1-995a44e77549', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/68d97eca-322c-41d7-aec1-995a44e77549', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ada696e536e9e284ed1ed1643ed59766', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b1b74adf78c84ea983f37acb26ce9145', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'dd6be3d221bc2a79354e1f55337465febef680605a26d745096ecd25f4772cdd25cf872326acbbff1cd2820282be573d8baa31a94d94ca0aa951e1e2d19092ea', 'id': '68d97eca-322c-41d7-aec1-995a44e77549', 'created_at': datetime.datetime(2026, 7, 2, 18, 1, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 2, 18, 1, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/68d97eca-322c-41d7-aec1-995a44e77549/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fce8f096810>}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:02:12 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-5722b6c3-0f5e-4042-ac6b-ed52d9db52c7 tempest-VolumeImageDependencyTests-966831365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c5154b0-0074-4b88-b581-48da41760807) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:02:12 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-5722b6c3-0f5e-4042-ac6b-ed52d9db52c7 tempest-VolumeImageDependencyTests-966831365 None] Volume volume-96ce3f28-f43d-4952-a057-36cddc4c0f71 (96ce3f28-f43d-4952-a057-36cddc4c0f71): created successfully
Jul 02 20:02:12 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-5722b6c3-0f5e-4042-ac6b-ed52d9db52c7 tempest-VolumeImageDependencyTests-966831365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c5154b0-0074-4b88-b581-48da41760807) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:02:12 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-5722b6c3-0f5e-4042-ac6b-ed52d9db52c7 tempest-VolumeImageDependencyTests-966831365 None] Flow 'volume_create_manager' (4c192b9e-7c96-49b3-b979-611f8fd542d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 20:02:12 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-5722b6c3-0f5e-4042-ac6b-ed52d9db52c7 tempest-VolumeImageDependencyTests-966831365 None] Created volume successfully.
Jul 02 20:02:13 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-6e64adf2-0d46-43dd-b341-fb6142cbc14e tempest-VolumeImageDependencyTests-966831365 None] Acquiring lock "cinder-96ce3f28-f43d-4952-a057-36cddc4c0f71-delete_volume" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 20:02:13 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-6e64adf2-0d46-43dd-b341-fb6142cbc14e tempest-VolumeImageDependencyTests-966831365 None] Lock "cinder-96ce3f28-f43d-4952-a057-36cddc4c0f71-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 20:02:13 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-6e64adf2-0d46-43dd-b341-fb6142cbc14e tempest-VolumeImageDependencyTests-966831365 None] Acquiring lock "cinder-quobyte-96ce3f28-f43d-4952-a057-36cddc4c0f71" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 20:02:13 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-6e64adf2-0d46-43dd-b341-fb6142cbc14e tempest-VolumeImageDependencyTests-966831365 None] Lock "cinder-quobyte-96ce3f28-f43d-4952-a057-36cddc4c0f71" acquired by "delete_volume" :: waited 0.020s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 20:02:13 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[25572a03-fa5e-431d-917d-8b7c5796d11c]: (4, 'raw') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 20:02:13 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-6e64adf2-0d46-43dd-b341-fb6142cbc14e tempest-VolumeImageDependencyTests-966831365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-96ce3f28-f43d-4952-a057-36cddc4c0f71 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:02:13 devstack sudo[105435]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-96ce3f28-f43d-4952-a057-36cddc4c0f71
Jul 02 20:02:13 devstack sudo[105435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:02:14 devstack sudo[105435]: pam_unix(sudo:session): session closed for user root
Jul 02 20:02:14 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-6e64adf2-0d46-43dd-b341-fb6142cbc14e tempest-VolumeImageDependencyTests-966831365 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-96ce3f28-f43d-4952-a057-36cddc4c0f71" returned: 0 in 0.812s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:02:14 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-6e64adf2-0d46-43dd-b341-fb6142cbc14e tempest-VolumeImageDependencyTests-966831365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-96ce3f28-f43d-4952-a057-36cddc4c0f71 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:02:14 devstack sudo[105453]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-96ce3f28-f43d-4952-a057-36cddc4c0f71
Jul 02 20:02:14 devstack sudo[105453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:02:14 devstack sudo[105453]: pam_unix(sudo:session): session closed for user root
Jul 02 20:02:14 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-6e64adf2-0d46-43dd-b341-fb6142cbc14e tempest-VolumeImageDependencyTests-966831365 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-96ce3f28-f43d-4952-a057-36cddc4c0f71" returned: 1 in 0.727s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:02:14 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-6e64adf2-0d46-43dd-b341-fb6142cbc14e tempest-VolumeImageDependencyTests-966831365 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-96ce3f28-f43d-4952-a057-36cddc4c0f71' failed. Not Retrying. {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 02 20:02:14 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-6e64adf2-0d46-43dd-b341-fb6142cbc14e tempest-VolumeImageDependencyTests-966831365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-96ce3f28-f43d-4952-a057-36cddc4c0f71 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:02:15 devstack sudo[105458]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-96ce3f28-f43d-4952-a057-36cddc4c0f71
Jul 02 20:02:15 devstack sudo[105458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:02:15 devstack sudo[105458]: pam_unix(sudo:session): session closed for user root
Jul 02 20:02:15 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-6e64adf2-0d46-43dd-b341-fb6142cbc14e tempest-VolumeImageDependencyTests-966831365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-96ce3f28-f43d-4952-a057-36cddc4c0f71" returned: 0 in 0.628s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:02:15 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-6e64adf2-0d46-43dd-b341-fb6142cbc14e tempest-VolumeImageDependencyTests-966831365 None] Lock "cinder-quobyte-96ce3f28-f43d-4952-a057-36cddc4c0f71" released by "delete_volume" :: held 2.234s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 20:02:15 devstack cinder-volume[86639]: DEBUG cinder.quota [None req-6e64adf2-0d46-43dd-b341-fb6142cbc14e tempest-VolumeImageDependencyTests-966831365 None] Created reservations ['08a8cf34-16ae-48ff-bdbc-ce6b1c9bbb1d', '6f86b626-78a5-4166-9b79-4c22e9dfbfa3', 'ca44fbab-57f4-428b-8e9d-d49e2642e7dc', '9d7a4594-7977-466f-a8fc-3411021ee0a8'] {{(pid=86639) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 20:02:15 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-6e64adf2-0d46-43dd-b341-fb6142cbc14e tempest-VolumeImageDependencyTests-966831365 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 20:02:15 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-6e64adf2-0d46-43dd-b341-fb6142cbc14e tempest-VolumeImageDependencyTests-966831365 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 20:02:15 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-6e64adf2-0d46-43dd-b341-fb6142cbc14e tempest-VolumeImageDependencyTests-966831365 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 20:02:15 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-6e64adf2-0d46-43dd-b341-fb6142cbc14e tempest-VolumeImageDependencyTests-966831365 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 20:02:15 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-6e64adf2-0d46-43dd-b341-fb6142cbc14e tempest-VolumeImageDependencyTests-966831365 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 20:02:15 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-6e64adf2-0d46-43dd-b341-fb6142cbc14e tempest-VolumeImageDependencyTests-966831365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:02:15 devstack sudo[105462]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e
Jul 02 20:02:15 devstack sudo[105462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:02:16 devstack sudo[105462]: pam_unix(sudo:session): session closed for user root
Jul 02 20:02:16 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-6e64adf2-0d46-43dd-b341-fb6142cbc14e tempest-VolumeImageDependencyTests-966831365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e" returned: 0 in 0.631s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:02:16 devstack cinder-volume[86639]: DEBUG cinder.manager [None req-6e64adf2-0d46-43dd-b341-fb6142cbc14e tempest-VolumeImageDependencyTests-966831365 None] Notifying Schedulers of capabilities ... {{(pid=86639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 20:02:16 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-6e64adf2-0d46-43dd-b341-fb6142cbc14e tempest-VolumeImageDependencyTests-966831365 None] Deleted volume successfully.
Jul 02 20:02:16 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-6e64adf2-0d46-43dd-b341-fb6142cbc14e tempest-VolumeImageDependencyTests-966831365 None] Lock "cinder-96ce3f28-f43d-4952-a057-36cddc4c0f71-delete_volume" released by "delete_volume" :: held 3.124s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 20:02:19 devstack cinder-volume[86639]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b27a9c2-4942-42f2-ba19-a5c71b1cdaba tempest-CinderUnicodeTest-1330113583 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 20:02:19 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-0b27a9c2-4942-42f2-ba19-a5c71b1cdaba tempest-CinderUnicodeTest-1330113583 None] Flow 'volume_create_manager' (9ff228e7-3f5d-4621-ac44-6a5d3220be98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 20:02:19 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-0b27a9c2-4942-42f2-ba19-a5c71b1cdaba tempest-CinderUnicodeTest-1330113583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c14b280-79d7-4459-b3eb-f2bf10a42881) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:02:19 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-0b27a9c2-4942-42f2-ba19-a5c71b1cdaba tempest-CinderUnicodeTest-1330113583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c14b280-79d7-4459-b3eb-f2bf10a42881) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T18:02:19Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54969815-d642-4d21-9fcf-b0c53da0c072,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='779cbbcf81164e6f9084d1ad208990ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T18:02:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T18:02:20Z,use_quota=True,user_id='a1ae034be739413a8b9151b18f0d0339',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:02:19 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-0b27a9c2-4942-42f2-ba19-a5c71b1cdaba tempest-CinderUnicodeTest-1330113583 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b84d6180-022e-46ac-acbe-fc625b2c67ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:02:19 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-0b27a9c2-4942-42f2-ba19-a5c71b1cdaba tempest-CinderUnicodeTest-1330113583 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b84d6180-022e-46ac-acbe-fc625b2c67ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:02:19 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-0b27a9c2-4942-42f2-ba19-a5c71b1cdaba tempest-CinderUnicodeTest-1330113583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43c9ffb1-4198-45ba-b9d5-4501d98a10a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:02:19 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-0b27a9c2-4942-42f2-ba19-a5c71b1cdaba tempest-CinderUnicodeTest-1330113583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43c9ffb1-4198-45ba-b9d5-4501d98a10a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '54969815-d642-4d21-9fcf-b0c53da0c072', 'volume_name': 'volume-54969815-d642-4d21-9fcf-b0c53da0c072', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:02:19 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-0b27a9c2-4942-42f2-ba19-a5c71b1cdaba tempest-CinderUnicodeTest-1330113583 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42bc46c8-9e73-4392-b1db-1d21fe171f59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:02:19 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-0b27a9c2-4942-42f2-ba19-a5c71b1cdaba tempest-CinderUnicodeTest-1330113583 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42bc46c8-9e73-4392-b1db-1d21fe171f59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:02:19 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-0b27a9c2-4942-42f2-ba19-a5c71b1cdaba tempest-CinderUnicodeTest-1330113583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df6426e3-395e-4655-9e81-9f6b94756eb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:02:19 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-0b27a9c2-4942-42f2-ba19-a5c71b1cdaba tempest-CinderUnicodeTest-1330113583 None] Volume 54969815-d642-4d21-9fcf-b0c53da0c072: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-54969815-d642-4d21-9fcf-b0c53da0c072', 'volume_size': 1}
Jul 02 20:02:19 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-0b27a9c2-4942-42f2-ba19-a5c71b1cdaba tempest-CinderUnicodeTest-1330113583 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 20:02:19 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-0b27a9c2-4942-42f2-ba19-a5c71b1cdaba tempest-CinderUnicodeTest-1330113583 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 20:02:19 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-0b27a9c2-4942-42f2-ba19-a5c71b1cdaba tempest-CinderUnicodeTest-1330113583 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce906cb830>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T18:02:19Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54969815-d642-4d21-9fcf-b0c53da0c072,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='779cbbcf81164e6f9084d1ad208990ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T18:02:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T18:02:20Z,use_quota=True,user_id='a1ae034be739413a8b9151b18f0d0339',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)}" {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 20:02:19 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-0b27a9c2-4942-42f2-ba19-a5c71b1cdaba tempest-CinderUnicodeTest-1330113583 None] Creating volume 54969815-d642-4d21-9fcf-b0c53da0c072 {{(pid=86639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 20:02:19 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-0b27a9c2-4942-42f2-ba19-a5c71b1cdaba tempest-CinderUnicodeTest-1330113583 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 20:02:19 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-0b27a9c2-4942-42f2-ba19-a5c71b1cdaba tempest-CinderUnicodeTest-1330113583 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 20:02:19 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-0b27a9c2-4942-42f2-ba19-a5c71b1cdaba tempest-CinderUnicodeTest-1330113583 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 20:02:19 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-0b27a9c2-4942-42f2-ba19-a5c71b1cdaba tempest-CinderUnicodeTest-1330113583 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 20:02:19 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-0b27a9c2-4942-42f2-ba19-a5c71b1cdaba tempest-CinderUnicodeTest-1330113583 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 20:02:19 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-0b27a9c2-4942-42f2-ba19-a5c71b1cdaba tempest-CinderUnicodeTest-1330113583 None] Selected osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92 as target Quobyte volume. {{(pid=86639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 20:02:19 devstack cinder-volume[86639]: INFO cinder.volume.drivers.remotefs [None req-0b27a9c2-4942-42f2-ba19-a5c71b1cdaba tempest-CinderUnicodeTest-1330113583 None] casted to osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92
Jul 02 20:02:19 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-0b27a9c2-4942-42f2-ba19-a5c71b1cdaba tempest-CinderUnicodeTest-1330113583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-54969815-d642-4d21-9fcf-b0c53da0c072 1073741824 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:02:19 devstack sudo[105465]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-54969815-d642-4d21-9fcf-b0c53da0c072 1073741824
Jul 02 20:02:19 devstack sudo[105465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:02:20 devstack sudo[105465]: pam_unix(sudo:session): session closed for user root
Jul 02 20:02:20 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-0b27a9c2-4942-42f2-ba19-a5c71b1cdaba tempest-CinderUnicodeTest-1330113583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-54969815-d642-4d21-9fcf-b0c53da0c072 1073741824" returned: 0 in 0.785s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:02:20 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-0b27a9c2-4942-42f2-ba19-a5c71b1cdaba tempest-CinderUnicodeTest-1330113583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-54969815-d642-4d21-9fcf-b0c53da0c072 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:02:20 devstack sudo[105471]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-54969815-d642-4d21-9fcf-b0c53da0c072
Jul 02 20:02:20 devstack sudo[105471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:02:21 devstack sudo[105471]: pam_unix(sudo:session): session closed for user root
Jul 02 20:02:21 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-0b27a9c2-4942-42f2-ba19-a5c71b1cdaba tempest-CinderUnicodeTest-1330113583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-54969815-d642-4d21-9fcf-b0c53da0c072" returned: 0 in 0.616s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:02:21 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-0b27a9c2-4942-42f2-ba19-a5c71b1cdaba tempest-CinderUnicodeTest-1330113583 None] <== create_volume: return (1454ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'} {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 20:02:21 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-0b27a9c2-4942-42f2-ba19-a5c71b1cdaba tempest-CinderUnicodeTest-1330113583 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.456s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 20:02:21 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-0b27a9c2-4942-42f2-ba19-a5c71b1cdaba tempest-CinderUnicodeTest-1330113583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df6426e3-395e-4655-9e81-9f6b94756eb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54969815-d642-4d21-9fcf-b0c53da0c072', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:02:21 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-0b27a9c2-4942-42f2-ba19-a5c71b1cdaba tempest-CinderUnicodeTest-1330113583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d2d3e7b-2ee9-4dc8-bc3c-fd055f4c712f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:02:21 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-0b27a9c2-4942-42f2-ba19-a5c71b1cdaba tempest-CinderUnicodeTest-1330113583 None] Volume volume-54969815-d642-4d21-9fcf-b0c53da0c072 (54969815-d642-4d21-9fcf-b0c53da0c072): created successfully
Jul 02 20:02:21 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-0b27a9c2-4942-42f2-ba19-a5c71b1cdaba tempest-CinderUnicodeTest-1330113583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d2d3e7b-2ee9-4dc8-bc3c-fd055f4c712f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:02:21 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-0b27a9c2-4942-42f2-ba19-a5c71b1cdaba tempest-CinderUnicodeTest-1330113583 None] Flow 'volume_create_manager' (9ff228e7-3f5d-4621-ac44-6a5d3220be98) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 20:02:21 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-0b27a9c2-4942-42f2-ba19-a5c71b1cdaba tempest-CinderUnicodeTest-1330113583 None] Created volume successfully.
Jul 02 20:02:22 devstack cinder-volume[86639]: DEBUG cinder.volume.flows.manager.create_volume [None req-1508ac52-f39c-4adf-a8cc-68df01df7a57 tempest-CinderUnicodeTest-1330113583 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 20:02:22 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-1508ac52-f39c-4adf-a8cc-68df01df7a57 tempest-CinderUnicodeTest-1330113583 None] Flow 'volume_create_manager' (7a657389-5d0b-41b6-9673-98e8a84c5702) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 20:02:22 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-1508ac52-f39c-4adf-a8cc-68df01df7a57 tempest-CinderUnicodeTest-1330113583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80e2a93f-cfe9-4d35-b279-e53c01d72b5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:02:22 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-1508ac52-f39c-4adf-a8cc-68df01df7a57 tempest-CinderUnicodeTest-1330113583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80e2a93f-cfe9-4d35-b279-e53c01d72b5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T18:02:22Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1428004064',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd613410-e788-4eb3-8308-a1ed399980ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='779cbbcf81164e6f9084d1ad208990ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T18:02:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T18:02:22Z,use_quota=True,user_id='a1ae034be739413a8b9151b18f0d0339',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:02:22 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-1508ac52-f39c-4adf-a8cc-68df01df7a57 tempest-CinderUnicodeTest-1330113583 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (073d230f-edd9-4439-9012-c2303e256e90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:02:22 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-1508ac52-f39c-4adf-a8cc-68df01df7a57 tempest-CinderUnicodeTest-1330113583 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (073d230f-edd9-4439-9012-c2303e256e90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:02:22 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-1508ac52-f39c-4adf-a8cc-68df01df7a57 tempest-CinderUnicodeTest-1330113583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99876385-36b6-4e1e-9207-18657c100b00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:02:22 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-1508ac52-f39c-4adf-a8cc-68df01df7a57 tempest-CinderUnicodeTest-1330113583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99876385-36b6-4e1e-9207-18657c100b00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dd613410-e788-4eb3-8308-a1ed399980ee', 'volume_name': 'volume-dd613410-e788-4eb3-8308-a1ed399980ee', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:02:22 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-1508ac52-f39c-4adf-a8cc-68df01df7a57 tempest-CinderUnicodeTest-1330113583 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8bf2feb7-1eeb-479b-82f6-e4be2e2521e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:02:22 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-1508ac52-f39c-4adf-a8cc-68df01df7a57 tempest-CinderUnicodeTest-1330113583 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8bf2feb7-1eeb-479b-82f6-e4be2e2521e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:02:22 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-1508ac52-f39c-4adf-a8cc-68df01df7a57 tempest-CinderUnicodeTest-1330113583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7eb0e09-eefc-48db-a5a9-986df97e85f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:02:22 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-1508ac52-f39c-4adf-a8cc-68df01df7a57 tempest-CinderUnicodeTest-1330113583 None] Volume dd613410-e788-4eb3-8308-a1ed399980ee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dd613410-e788-4eb3-8308-a1ed399980ee', 'volume_size': 1}
Jul 02 20:02:22 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-1508ac52-f39c-4adf-a8cc-68df01df7a57 tempest-CinderUnicodeTest-1330113583 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 20:02:22 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-1508ac52-f39c-4adf-a8cc-68df01df7a57 tempest-CinderUnicodeTest-1330113583 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 20:02:22 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-1508ac52-f39c-4adf-a8cc-68df01df7a57 tempest-CinderUnicodeTest-1330113583 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce906cb830>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T18:02:22Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1428004064',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd613410-e788-4eb3-8308-a1ed399980ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='779cbbcf81164e6f9084d1ad208990ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T18:02:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T18:02:22Z,use_quota=True,user_id='a1ae034be739413a8b9151b18f0d0339',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)}" {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 20:02:22 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-1508ac52-f39c-4adf-a8cc-68df01df7a57 tempest-CinderUnicodeTest-1330113583 None] Creating volume dd613410-e788-4eb3-8308-a1ed399980ee {{(pid=86639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 20:02:22 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-1508ac52-f39c-4adf-a8cc-68df01df7a57 tempest-CinderUnicodeTest-1330113583 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 20:02:22 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-1508ac52-f39c-4adf-a8cc-68df01df7a57 tempest-CinderUnicodeTest-1330113583 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 20:02:22 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-1508ac52-f39c-4adf-a8cc-68df01df7a57 tempest-CinderUnicodeTest-1330113583 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 20:02:22 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-1508ac52-f39c-4adf-a8cc-68df01df7a57 tempest-CinderUnicodeTest-1330113583 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 20:02:22 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-1508ac52-f39c-4adf-a8cc-68df01df7a57 tempest-CinderUnicodeTest-1330113583 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 20:02:22 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-1508ac52-f39c-4adf-a8cc-68df01df7a57 tempest-CinderUnicodeTest-1330113583 None] Selected osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92 as target Quobyte volume. {{(pid=86639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 20:02:22 devstack cinder-volume[86639]: INFO cinder.volume.drivers.remotefs [None req-1508ac52-f39c-4adf-a8cc-68df01df7a57 tempest-CinderUnicodeTest-1330113583 None] casted to osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92
Jul 02 20:02:22 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-1508ac52-f39c-4adf-a8cc-68df01df7a57 tempest-CinderUnicodeTest-1330113583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-dd613410-e788-4eb3-8308-a1ed399980ee 1073741824 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:02:22 devstack sudo[105474]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-dd613410-e788-4eb3-8308-a1ed399980ee 1073741824
Jul 02 20:02:22 devstack sudo[105474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:02:23 devstack sudo[105474]: pam_unix(sudo:session): session closed for user root
Jul 02 20:02:23 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-1508ac52-f39c-4adf-a8cc-68df01df7a57 tempest-CinderUnicodeTest-1330113583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-dd613410-e788-4eb3-8308-a1ed399980ee 1073741824" returned: 0 in 0.839s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:02:23 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-1508ac52-f39c-4adf-a8cc-68df01df7a57 tempest-CinderUnicodeTest-1330113583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-dd613410-e788-4eb3-8308-a1ed399980ee {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:02:23 devstack sudo[105479]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-dd613410-e788-4eb3-8308-a1ed399980ee
Jul 02 20:02:23 devstack sudo[105479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:02:23 devstack sudo[105479]: pam_unix(sudo:session): session closed for user root
Jul 02 20:02:23 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-1508ac52-f39c-4adf-a8cc-68df01df7a57 tempest-CinderUnicodeTest-1330113583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-dd613410-e788-4eb3-8308-a1ed399980ee" returned: 0 in 0.638s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:02:23 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-1508ac52-f39c-4adf-a8cc-68df01df7a57 tempest-CinderUnicodeTest-1330113583 None] <== create_volume: return (1529ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'} {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 20:02:23 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-1508ac52-f39c-4adf-a8cc-68df01df7a57 tempest-CinderUnicodeTest-1330113583 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.532s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 20:02:23 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-1508ac52-f39c-4adf-a8cc-68df01df7a57 tempest-CinderUnicodeTest-1330113583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7eb0e09-eefc-48db-a5a9-986df97e85f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd613410-e788-4eb3-8308-a1ed399980ee', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:02:23 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-1508ac52-f39c-4adf-a8cc-68df01df7a57 tempest-CinderUnicodeTest-1330113583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (096f9c7b-f45d-4e59-b561-f6dab7e2f5ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:02:23 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-1508ac52-f39c-4adf-a8cc-68df01df7a57 tempest-CinderUnicodeTest-1330113583 None] Volume volume-dd613410-e788-4eb3-8308-a1ed399980ee (dd613410-e788-4eb3-8308-a1ed399980ee): created successfully
Jul 02 20:02:24 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-1508ac52-f39c-4adf-a8cc-68df01df7a57 tempest-CinderUnicodeTest-1330113583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (096f9c7b-f45d-4e59-b561-f6dab7e2f5ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:02:24 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-1508ac52-f39c-4adf-a8cc-68df01df7a57 tempest-CinderUnicodeTest-1330113583 None] Flow 'volume_create_manager' (7a657389-5d0b-41b6-9673-98e8a84c5702) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 20:02:24 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-1508ac52-f39c-4adf-a8cc-68df01df7a57 tempest-CinderUnicodeTest-1330113583 None] Created volume successfully.
Jul 02 20:02:24 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-40f3daa6-5e35-4330-a277-093e3b090610 tempest-CinderUnicodeTest-1330113583 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 20:02:24 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-40f3daa6-5e35-4330-a277-093e3b090610 tempest-CinderUnicodeTest-1330113583 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 20:02:24 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-40f3daa6-5e35-4330-a277-093e3b090610 tempest-CinderUnicodeTest-1330113583 None] Creating offline snapshot 5f989bac-dfda-4741-8359-eab79c5efe85 of volume dd613410-e788-4eb3-8308-a1ed399980ee {{(pid=86639) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 02 20:02:24 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6744f02-8fd5-4c2c-8a67-821a11dcbbdd]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 20:02:24 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-40f3daa6-5e35-4330-a277-093e3b090610 tempest-CinderUnicodeTest-1330113583 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-dd613410-e788-4eb3-8308-a1ed399980ee {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:02:24 devstack sudo[105488]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-dd613410-e788-4eb3-8308-a1ed399980ee
Jul 02 20:02:24 devstack sudo[105488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:02:25 devstack sudo[105488]: pam_unix(sudo:session): session closed for user root
Jul 02 20:02:25 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-40f3daa6-5e35-4330-a277-093e3b090610 tempest-CinderUnicodeTest-1330113583 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-dd613410-e788-4eb3-8308-a1ed399980ee" returned: 0 in 0.783s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:02:25 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-40f3daa6-5e35-4330-a277-093e3b090610 tempest-CinderUnicodeTest-1330113583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-dd613410-e788-4eb3-8308-a1ed399980ee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-dd613410-e788-4eb3-8308-a1ed399980ee.5f989bac-dfda-4741-8359-eab79c5efe85 1G {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:02:25 devstack sudo[105493]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-dd613410-e788-4eb3-8308-a1ed399980ee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-dd613410-e788-4eb3-8308-a1ed399980ee.5f989bac-dfda-4741-8359-eab79c5efe85 1G
Jul 02 20:02:25 devstack sudo[105493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:02:26 devstack sudo[105493]: pam_unix(sudo:session): session closed for user root
Jul 02 20:02:26 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-40f3daa6-5e35-4330-a277-093e3b090610 tempest-CinderUnicodeTest-1330113583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-dd613410-e788-4eb3-8308-a1ed399980ee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-dd613410-e788-4eb3-8308-a1ed399980ee.5f989bac-dfda-4741-8359-eab79c5efe85 1G" returned: 0 in 0.847s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:02:26 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-40f3daa6-5e35-4330-a277-093e3b090610 tempest-CinderUnicodeTest-1330113583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dd613410-e788-4eb3-8308-a1ed399980ee -F qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-dd613410-e788-4eb3-8308-a1ed399980ee.5f989bac-dfda-4741-8359-eab79c5efe85 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:02:26 devstack sudo[105499]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dd613410-e788-4eb3-8308-a1ed399980ee -F qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-dd613410-e788-4eb3-8308-a1ed399980ee.5f989bac-dfda-4741-8359-eab79c5efe85
Jul 02 20:02:26 devstack sudo[105499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:02:27 devstack sudo[105499]: pam_unix(sudo:session): session closed for user root
Jul 02 20:02:27 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-40f3daa6-5e35-4330-a277-093e3b090610 tempest-CinderUnicodeTest-1330113583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dd613410-e788-4eb3-8308-a1ed399980ee -F qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-dd613410-e788-4eb3-8308-a1ed399980ee.5f989bac-dfda-4741-8359-eab79c5efe85" returned: 0 in 0.746s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:02:27 devstack cinder-volume[86639]: WARNING cinder.volume.drivers.remotefs [None req-40f3daa6-5e35-4330-a277-093e3b090610 tempest-CinderUnicodeTest-1330113583 None] /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-dd613410-e788-4eb3-8308-a1ed399980ee.5f989bac-dfda-4741-8359-eab79c5efe85 is being set with open permissions: ugo+rw
Jul 02 20:02:27 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-40f3daa6-5e35-4330-a277-093e3b090610 tempest-CinderUnicodeTest-1330113583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-dd613410-e788-4eb3-8308-a1ed399980ee.5f989bac-dfda-4741-8359-eab79c5efe85 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:02:27 devstack sudo[105513]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-dd613410-e788-4eb3-8308-a1ed399980ee.5f989bac-dfda-4741-8359-eab79c5efe85
Jul 02 20:02:27 devstack sudo[105513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:02:27 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [req-a1b75fcc-0a10-4374-ae53-f16e7f028e52 req-58a5c16c-8c2d-4267-a297-18168226d171 tempest-TestServerVolumeAttachmentScenario-1761887952 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 20:02:28 devstack sudo[105513]: pam_unix(sudo:session): session closed for user root
Jul 02 20:02:28 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-40f3daa6-5e35-4330-a277-093e3b090610 tempest-CinderUnicodeTest-1330113583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-dd613410-e788-4eb3-8308-a1ed399980ee.5f989bac-dfda-4741-8359-eab79c5efe85" returned: 0 in 0.867s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:02:28 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-40f3daa6-5e35-4330-a277-093e3b090610 tempest-CinderUnicodeTest-1330113583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-dd613410-e788-4eb3-8308-a1ed399980ee.info {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:02:28 devstack sudo[105526]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-dd613410-e788-4eb3-8308-a1ed399980ee.info
Jul 02 20:02:28 devstack sudo[105526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:02:28 devstack sudo[105526]: pam_unix(sudo:session): session closed for user root
Jul 02 20:02:28 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-40f3daa6-5e35-4330-a277-093e3b090610 tempest-CinderUnicodeTest-1330113583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-dd613410-e788-4eb3-8308-a1ed399980ee.info" returned: 0 in 0.677s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:02:28 devstack cinder-volume[86639]: WARNING cinder.volume.drivers.remotefs [None req-40f3daa6-5e35-4330-a277-093e3b090610 tempest-CinderUnicodeTest-1330113583 None] /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-dd613410-e788-4eb3-8308-a1ed399980ee.info is being set with open permissions: ugo+rw
Jul 02 20:02:28 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-40f3daa6-5e35-4330-a277-093e3b090610 tempest-CinderUnicodeTest-1330113583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-dd613410-e788-4eb3-8308-a1ed399980ee.info {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:02:28 devstack sudo[105529]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-dd613410-e788-4eb3-8308-a1ed399980ee.info
Jul 02 20:02:28 devstack sudo[105529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:02:29 devstack sudo[105529]: pam_unix(sudo:session): session closed for user root
Jul 02 20:02:29 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-40f3daa6-5e35-4330-a277-093e3b090610 tempest-CinderUnicodeTest-1330113583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-dd613410-e788-4eb3-8308-a1ed399980ee.info" returned: 0 in 0.861s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:02:29 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-40f3daa6-5e35-4330-a277-093e3b090610 tempest-CinderUnicodeTest-1330113583 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.946s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 20:02:29 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [req-a1b75fcc-0a10-4374-ae53-f16e7f028e52 req-58a5c16c-8c2d-4267-a297-18168226d171 tempest-TestServerVolumeAttachmentScenario-1761887952 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.811s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 20:02:29 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e305955-7b81-4d11-a1ae-9feecf08f3b6]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 20:02:29 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [req-a1b75fcc-0a10-4374-ae53-f16e7f028e52 req-58a5c16c-8c2d-4267-a297-18168226d171 tempest-TestServerVolumeAttachmentScenario-1761887952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-3176f4d1-2a0d-4e63-8a99-e0118b014efd {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:02:29 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-40f3daa6-5e35-4330-a277-093e3b090610 tempest-CinderUnicodeTest-1330113583 None] Create snapshot completed successfully
Jul 02 20:02:29 devstack sudo[105570]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-3176f4d1-2a0d-4e63-8a99-e0118b014efd
Jul 02 20:02:29 devstack sudo[105570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:02:30 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-eb037204-e39d-4c52-9413-7041a6c07578 tempest-CinderUnicodeTest-1330113583 None] Acquiring lock "cinder-5f989bac-dfda-4741-8359-eab79c5efe85-delete_snapshot" by "delete_snapshot" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 20:02:30 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-eb037204-e39d-4c52-9413-7041a6c07578 tempest-CinderUnicodeTest-1330113583 None] Lock "cinder-5f989bac-dfda-4741-8359-eab79c5efe85-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 20:02:30 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-eb037204-e39d-4c52-9413-7041a6c07578 tempest-CinderUnicodeTest-1330113583 None] Acquiring lock "cinder-quobyte-dd613410-e788-4eb3-8308-a1ed399980ee" by "delete_snapshot" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 20:02:30 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-eb037204-e39d-4c52-9413-7041a6c07578 tempest-CinderUnicodeTest-1330113583 None] Lock "cinder-quobyte-dd613410-e788-4eb3-8308-a1ed399980ee" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 20:02:30 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-eb037204-e39d-4c52-9413-7041a6c07578 tempest-CinderUnicodeTest-1330113583 None] Acquiring lock "cinder-quobyte-5f989bac-dfda-4741-8359-eab79c5efe85" by "_delete_snapshot" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 20:02:30 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-eb037204-e39d-4c52-9413-7041a6c07578 tempest-CinderUnicodeTest-1330113583 None] Lock "cinder-quobyte-5f989bac-dfda-4741-8359-eab79c5efe85" acquired by "_delete_snapshot" :: waited 0.042s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 20:02:30 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-eb037204-e39d-4c52-9413-7041a6c07578 tempest-CinderUnicodeTest-1330113583 None] Deleting offline snapshot 5f989bac-dfda-4741-8359-eab79c5efe85 of volume dd613410-e788-4eb3-8308-a1ed399980ee {{(pid=86639) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 02 20:02:30 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-eb037204-e39d-4c52-9413-7041a6c07578 tempest-CinderUnicodeTest-1330113583 None] snapshot_file for this snap is: volume-dd613410-e788-4eb3-8308-a1ed399980ee.5f989bac-dfda-4741-8359-eab79c5efe85 {{(pid=86639) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 02 20:02:30 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f96d858-cb1d-4278-b321-0ebfabd73faa]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 20:02:30 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-eb037204-e39d-4c52-9413-7041a6c07578 tempest-CinderUnicodeTest-1330113583 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-dd613410-e788-4eb3-8308-a1ed399980ee.5f989bac-dfda-4741-8359-eab79c5efe85 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:02:30 devstack sudo[105574]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-dd613410-e788-4eb3-8308-a1ed399980ee.5f989bac-dfda-4741-8359-eab79c5efe85
Jul 02 20:02:30 devstack sudo[105574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:02:30 devstack sudo[105570]: pam_unix(sudo:session): session closed for user root
Jul 02 20:02:30 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [req-a1b75fcc-0a10-4374-ae53-f16e7f028e52 req-58a5c16c-8c2d-4267-a297-18168226d171 tempest-TestServerVolumeAttachmentScenario-1761887952 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-3176f4d1-2a0d-4e63-8a99-e0118b014efd" returned: 0 in 0.961s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:02:30 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [req-a1b75fcc-0a10-4374-ae53-f16e7f028e52 req-58a5c16c-8c2d-4267-a297-18168226d171 tempest-TestServerVolumeAttachmentScenario-1761887952 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.004s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 20:02:30 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [req-a1b75fcc-0a10-4374-ae53-f16e7f028e52 req-58a5c16c-8c2d-4267-a297-18168226d171 tempest-TestServerVolumeAttachmentScenario-1761887952 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92', 'name': 'volume-3176f4d1-2a0d-4e63-8a99-e0118b014efd', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e4114cc7-8b6f-4da1-93c9-0e1fb1188682', 'enforce_multipath': True} {{(pid=86639) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 02 20:02:30 devstack cinder-volume[86639]: INFO cinder.volume.manager [req-a1b75fcc-0a10-4374-ae53-f16e7f028e52 req-58a5c16c-8c2d-4267-a297-18168226d171 tempest-TestServerVolumeAttachmentScenario-1761887952 None] attachment_update completed successfully.
Jul 02 20:02:31 devstack sudo[105574]: pam_unix(sudo:session): session closed for user root
Jul 02 20:02:31 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-eb037204-e39d-4c52-9413-7041a6c07578 tempest-CinderUnicodeTest-1330113583 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-dd613410-e788-4eb3-8308-a1ed399980ee.5f989bac-dfda-4741-8359-eab79c5efe85" returned: 0 in 0.834s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:02:31 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-eb037204-e39d-4c52-9413-7041a6c07578 tempest-CinderUnicodeTest-1330113583 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dd613410-e788-4eb3-8308-a1ed399980ee(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86639) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 02 20:02:31 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[04606b8c-32fe-441d-81ea-4db8c421dcb6]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 20:02:31 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-eb037204-e39d-4c52-9413-7041a6c07578 tempest-CinderUnicodeTest-1330113583 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-dd613410-e788-4eb3-8308-a1ed399980ee {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:02:31 devstack sudo[105651]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-dd613410-e788-4eb3-8308-a1ed399980ee
Jul 02 20:02:31 devstack sudo[105651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:02:32 devstack sudo[105651]: pam_unix(sudo:session): session closed for user root
Jul 02 20:02:32 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-eb037204-e39d-4c52-9413-7041a6c07578 tempest-CinderUnicodeTest-1330113583 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-dd613410-e788-4eb3-8308-a1ed399980ee" returned: 0 in 0.883s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:02:32 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-eb037204-e39d-4c52-9413-7041a6c07578 tempest-CinderUnicodeTest-1330113583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-dd613410-e788-4eb3-8308-a1ed399980ee.5f989bac-dfda-4741-8359-eab79c5efe85 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:02:32 devstack sudo[105971]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-dd613410-e788-4eb3-8308-a1ed399980ee.5f989bac-dfda-4741-8359-eab79c5efe85
Jul 02 20:02:32 devstack sudo[105971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:02:32 devstack cinder-volume[86639]: INFO cinder.volume.manager [req-a1aac665-1629-4c28-9810-833b641dbe3d req-5df0d5d6-a607-40e6-a9b6-3a678b7f880c tempest-TestShelveInstance-1204606342 None] Terminate volume connection completed successfully.
Jul 02 20:02:32 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [req-a1aac665-1629-4c28-9810-833b641dbe3d req-5df0d5d6-a607-40e6-a9b6-3a678b7f880c tempest-TestShelveInstance-1204606342 None] Deleting attachment 56c1095d-042d-4130-9df6-1db1402455e1. {{(pid=86639) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 02 20:02:32 devstack sudo[105971]: pam_unix(sudo:session): session closed for user root
Jul 02 20:02:32 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-eb037204-e39d-4c52-9413-7041a6c07578 tempest-CinderUnicodeTest-1330113583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-dd613410-e788-4eb3-8308-a1ed399980ee.5f989bac-dfda-4741-8359-eab79c5efe85" returned: 0 in 0.790s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:02:32 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-eb037204-e39d-4c52-9413-7041a6c07578 tempest-CinderUnicodeTest-1330113583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-dd613410-e788-4eb3-8308-a1ed399980ee.5f989bac-dfda-4741-8359-eab79c5efe85 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:02:32 devstack sudo[105976]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-dd613410-e788-4eb3-8308-a1ed399980ee.5f989bac-dfda-4741-8359-eab79c5efe85
Jul 02 20:02:32 devstack sudo[105976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:02:32 devstack cinder-volume[86639]: DEBUG cinder.coordination [req-a1aac665-1629-4c28-9810-833b641dbe3d req-e8036d5f-72d5-40b4-b035-63f524cdb60b tempest-TestShelveInstance-1204606342 None] Acquiring lock "cinder-a992da0d-c1f8-4a49-8b48-729e67de065d-delete_volume" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 20:02:32 devstack cinder-volume[86639]: DEBUG cinder.coordination [req-a1aac665-1629-4c28-9810-833b641dbe3d req-e8036d5f-72d5-40b4-b035-63f524cdb60b tempest-TestShelveInstance-1204606342 None] Lock "cinder-a992da0d-c1f8-4a49-8b48-729e67de065d-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 20:02:32 devstack cinder-volume[86639]: DEBUG dbcounter [-] [86639] Writing DB stats cinder:UPDATE=81,cinder:DELETE=6,cinder:SELECT=56,cinder:INSERT=19 {{(pid=86639) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 02 20:02:32 devstack cinder-volume[86639]: DEBUG dbcounter [-] [86639] Writing DB stats cinder:UPDATE=78,cinder:SELECT=76,cinder:INSERT=24,cinder:DELETE=8 {{(pid=86639) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 02 20:02:32 devstack cinder-volume[86639]: DEBUG cinder.coordination [req-a1aac665-1629-4c28-9810-833b641dbe3d req-e8036d5f-72d5-40b4-b035-63f524cdb60b tempest-TestShelveInstance-1204606342 None] Acquiring lock "cinder-quobyte-a992da0d-c1f8-4a49-8b48-729e67de065d" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 20:02:32 devstack cinder-volume[86639]: DEBUG cinder.coordination [req-a1aac665-1629-4c28-9810-833b641dbe3d req-e8036d5f-72d5-40b4-b035-63f524cdb60b tempest-TestShelveInstance-1204606342 None] Lock "cinder-quobyte-a992da0d-c1f8-4a49-8b48-729e67de065d" acquired by "delete_volume" :: waited 0.023s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 20:02:32 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ebedf56-9513-40e0-87f5-8dab8d06a180]: (4, 'raw') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 20:02:33 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [req-a1aac665-1629-4c28-9810-833b641dbe3d req-e8036d5f-72d5-40b4-b035-63f524cdb60b tempest-TestShelveInstance-1204606342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-a992da0d-c1f8-4a49-8b48-729e67de065d {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:02:33 devstack sudo[105978]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-a992da0d-c1f8-4a49-8b48-729e67de065d
Jul 02 20:02:33 devstack sudo[105978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:02:33 devstack sudo[105976]: pam_unix(sudo:session): session closed for user root
Jul 02 20:02:33 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-eb037204-e39d-4c52-9413-7041a6c07578 tempest-CinderUnicodeTest-1330113583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-dd613410-e788-4eb3-8308-a1ed399980ee.5f989bac-dfda-4741-8359-eab79c5efe85" returned: 0 in 0.824s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:02:33 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-eb037204-e39d-4c52-9413-7041a6c07578 tempest-CinderUnicodeTest-1330113583 None] Lock "cinder-quobyte-5f989bac-dfda-4741-8359-eab79c5efe85" released by "_delete_snapshot" :: held 3.535s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 20:02:33 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-eb037204-e39d-4c52-9413-7041a6c07578 tempest-CinderUnicodeTest-1330113583 None] Lock "cinder-quobyte-dd613410-e788-4eb3-8308-a1ed399980ee" released by "delete_snapshot" :: held 3.590s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 20:02:33 devstack cinder-volume[86639]: DEBUG cinder.quota [None req-eb037204-e39d-4c52-9413-7041a6c07578 tempest-CinderUnicodeTest-1330113583 None] Created reservations ['c404b70e-881b-443d-8854-f80541ff9447', 'ebbb0ad4-dd09-40d8-ad20-4f8fa867254a', 'ea011cad-c8e0-4699-91f4-1f4befda4def', 'e6c98f12-12cd-4fef-a698-0099ad8bc8ad'] {{(pid=86639) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 20:02:33 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-eb037204-e39d-4c52-9413-7041a6c07578 tempest-CinderUnicodeTest-1330113583 None] Delete snapshot completed successfully.
Jul 02 20:02:33 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-eb037204-e39d-4c52-9413-7041a6c07578 tempest-CinderUnicodeTest-1330113583 None] Lock "cinder-5f989bac-dfda-4741-8359-eab79c5efe85-delete_snapshot" released by "delete_snapshot" :: held 3.769s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 20:02:33 devstack sudo[105978]: pam_unix(sudo:session): session closed for user root
Jul 02 20:02:33 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [req-a1aac665-1629-4c28-9810-833b641dbe3d req-e8036d5f-72d5-40b4-b035-63f524cdb60b tempest-TestShelveInstance-1204606342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-a992da0d-c1f8-4a49-8b48-729e67de065d" returned: 0 in 0.953s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:02:33 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [req-a1aac665-1629-4c28-9810-833b641dbe3d req-e8036d5f-72d5-40b4-b035-63f524cdb60b tempest-TestShelveInstance-1204606342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-a992da0d-c1f8-4a49-8b48-729e67de065d {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:02:34 devstack sudo[105986]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-a992da0d-c1f8-4a49-8b48-729e67de065d
Jul 02 20:02:34 devstack sudo[105986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:02:34 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-2bc27a51-1855-4d59-8d33-d6ef83410dde tempest-CinderUnicodeTest-1330113583 None] Acquiring lock "cinder-dd613410-e788-4eb3-8308-a1ed399980ee-delete_volume" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 20:02:34 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-2bc27a51-1855-4d59-8d33-d6ef83410dde tempest-CinderUnicodeTest-1330113583 None] Lock "cinder-dd613410-e788-4eb3-8308-a1ed399980ee-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 20:02:34 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-2bc27a51-1855-4d59-8d33-d6ef83410dde tempest-CinderUnicodeTest-1330113583 None] Acquiring lock "cinder-quobyte-dd613410-e788-4eb3-8308-a1ed399980ee" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 20:02:34 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-2bc27a51-1855-4d59-8d33-d6ef83410dde tempest-CinderUnicodeTest-1330113583 None] Lock "cinder-quobyte-dd613410-e788-4eb3-8308-a1ed399980ee" acquired by "delete_volume" :: waited 0.018s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 20:02:34 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f94ae96-4d21-498c-8e93-8f4b3c2091e9]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 20:02:34 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-2bc27a51-1855-4d59-8d33-d6ef83410dde tempest-CinderUnicodeTest-1330113583 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-dd613410-e788-4eb3-8308-a1ed399980ee {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:02:34 devstack sudo[106026]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-dd613410-e788-4eb3-8308-a1ed399980ee
Jul 02 20:02:34 devstack sudo[106026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:02:35 devstack sudo[105986]: pam_unix(sudo:session): session closed for user root
Jul 02 20:02:35 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [req-a1aac665-1629-4c28-9810-833b641dbe3d req-e8036d5f-72d5-40b4-b035-63f524cdb60b tempest-TestShelveInstance-1204606342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-a992da0d-c1f8-4a49-8b48-729e67de065d" returned: 1 in 1.142s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:02:35 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [req-a1aac665-1629-4c28-9810-833b641dbe3d req-e8036d5f-72d5-40b4-b035-63f524cdb60b tempest-TestShelveInstance-1204606342 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-a992da0d-c1f8-4a49-8b48-729e67de065d' failed. Not Retrying. {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 02 20:02:35 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [req-a1aac665-1629-4c28-9810-833b641dbe3d req-e8036d5f-72d5-40b4-b035-63f524cdb60b tempest-TestShelveInstance-1204606342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-a992da0d-c1f8-4a49-8b48-729e67de065d {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:02:35 devstack sudo[106033]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-a992da0d-c1f8-4a49-8b48-729e67de065d
Jul 02 20:02:35 devstack sudo[106033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:02:35 devstack sudo[106026]: pam_unix(sudo:session): session closed for user root
Jul 02 20:02:35 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-2bc27a51-1855-4d59-8d33-d6ef83410dde tempest-CinderUnicodeTest-1330113583 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-dd613410-e788-4eb3-8308-a1ed399980ee" returned: 0 in 1.182s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:02:35 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-2bc27a51-1855-4d59-8d33-d6ef83410dde tempest-CinderUnicodeTest-1330113583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-dd613410-e788-4eb3-8308-a1ed399980ee {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:02:35 devstack sudo[106038]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-dd613410-e788-4eb3-8308-a1ed399980ee
Jul 02 20:02:35 devstack sudo[106038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:02:36 devstack sudo[106033]: pam_unix(sudo:session): session closed for user root
Jul 02 20:02:36 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [req-a1aac665-1629-4c28-9810-833b641dbe3d req-e8036d5f-72d5-40b4-b035-63f524cdb60b tempest-TestShelveInstance-1204606342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-a992da0d-c1f8-4a49-8b48-729e67de065d" returned: 0 in 1.008s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:02:36 devstack cinder-volume[86639]: DEBUG cinder.coordination [req-a1aac665-1629-4c28-9810-833b641dbe3d req-e8036d5f-72d5-40b4-b035-63f524cdb60b tempest-TestShelveInstance-1204606342 None] Lock "cinder-quobyte-a992da0d-c1f8-4a49-8b48-729e67de065d" released by "delete_volume" :: held 3.208s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 20:02:36 devstack cinder-volume[86639]: DEBUG cinder.quota [req-a1aac665-1629-4c28-9810-833b641dbe3d req-e8036d5f-72d5-40b4-b035-63f524cdb60b tempest-TestShelveInstance-1204606342 None] Created reservations ['3d91aa48-5161-49bd-bc90-db49e2849be7', 'f01cf059-b34b-48c7-8942-0b6e9fc49038', '9a787351-e1d1-42d0-9d06-b0626c9969db', '32b53d55-3eb1-4621-b686-b18fcf72a273'] {{(pid=86639) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 20:02:36 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [req-a1aac665-1629-4c28-9810-833b641dbe3d req-e8036d5f-72d5-40b4-b035-63f524cdb60b tempest-TestShelveInstance-1204606342 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 20:02:36 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [req-a1aac665-1629-4c28-9810-833b641dbe3d req-e8036d5f-72d5-40b4-b035-63f524cdb60b tempest-TestShelveInstance-1204606342 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 20:02:36 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [req-a1aac665-1629-4c28-9810-833b641dbe3d req-e8036d5f-72d5-40b4-b035-63f524cdb60b tempest-TestShelveInstance-1204606342 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 20:02:36 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [req-a1aac665-1629-4c28-9810-833b641dbe3d req-e8036d5f-72d5-40b4-b035-63f524cdb60b tempest-TestShelveInstance-1204606342 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 20:02:36 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [req-a1aac665-1629-4c28-9810-833b641dbe3d req-e8036d5f-72d5-40b4-b035-63f524cdb60b tempest-TestShelveInstance-1204606342 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 20:02:36 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [req-a1aac665-1629-4c28-9810-833b641dbe3d req-e8036d5f-72d5-40b4-b035-63f524cdb60b tempest-TestShelveInstance-1204606342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:02:36 devstack sudo[106041]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e
Jul 02 20:02:36 devstack sudo[106041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:02:36 devstack sudo[106038]: pam_unix(sudo:session): session closed for user root
Jul 02 20:02:36 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-2bc27a51-1855-4d59-8d33-d6ef83410dde tempest-CinderUnicodeTest-1330113583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-dd613410-e788-4eb3-8308-a1ed399980ee" returned: 0 in 1.154s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:02:36 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-2bc27a51-1855-4d59-8d33-d6ef83410dde tempest-CinderUnicodeTest-1330113583 None] Lock "cinder-quobyte-dd613410-e788-4eb3-8308-a1ed399980ee" released by "delete_volume" :: held 2.457s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 20:02:37 devstack cinder-volume[86639]: DEBUG cinder.quota [None req-2bc27a51-1855-4d59-8d33-d6ef83410dde tempest-CinderUnicodeTest-1330113583 None] Created reservations ['880cfac1-432d-46f5-813a-89f3dfd4f544', '658e58c2-6bb4-4dfd-8402-17d02e754d04', 'b99c5d09-8d99-44cb-94e3-3a5a66f754fe', 'c8ce7fb4-4684-41df-a6e5-8cc995b52916'] {{(pid=86639) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 20:02:37 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-2bc27a51-1855-4d59-8d33-d6ef83410dde tempest-CinderUnicodeTest-1330113583 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 20:02:37 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-2bc27a51-1855-4d59-8d33-d6ef83410dde tempest-CinderUnicodeTest-1330113583 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 20:02:37 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-2bc27a51-1855-4d59-8d33-d6ef83410dde tempest-CinderUnicodeTest-1330113583 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 20:02:37 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-2bc27a51-1855-4d59-8d33-d6ef83410dde tempest-CinderUnicodeTest-1330113583 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 20:02:37 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-2bc27a51-1855-4d59-8d33-d6ef83410dde tempest-CinderUnicodeTest-1330113583 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 20:02:37 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-2bc27a51-1855-4d59-8d33-d6ef83410dde tempest-CinderUnicodeTest-1330113583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:02:37 devstack sudo[106044]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e
Jul 02 20:02:37 devstack sudo[106044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:02:37 devstack sudo[106041]: pam_unix(sudo:session): session closed for user root
Jul 02 20:02:37 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [req-a1aac665-1629-4c28-9810-833b641dbe3d req-e8036d5f-72d5-40b4-b035-63f524cdb60b tempest-TestShelveInstance-1204606342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e" returned: 0 in 1.159s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:02:37 devstack cinder-volume[86639]: DEBUG cinder.manager [req-a1aac665-1629-4c28-9810-833b641dbe3d req-e8036d5f-72d5-40b4-b035-63f524cdb60b tempest-TestShelveInstance-1204606342 None] Notifying Schedulers of capabilities ... {{(pid=86639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 20:02:37 devstack cinder-volume[86639]: INFO cinder.volume.manager [req-a1aac665-1629-4c28-9810-833b641dbe3d req-e8036d5f-72d5-40b4-b035-63f524cdb60b tempest-TestShelveInstance-1204606342 None] Deleted volume successfully.
Jul 02 20:02:37 devstack cinder-volume[86639]: DEBUG cinder.coordination [req-a1aac665-1629-4c28-9810-833b641dbe3d req-e8036d5f-72d5-40b4-b035-63f524cdb60b tempest-TestShelveInstance-1204606342 None] Lock "cinder-a992da0d-c1f8-4a49-8b48-729e67de065d-delete_volume" released by "delete_volume" :: held 4.723s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 20:02:38 devstack sudo[106044]: pam_unix(sudo:session): session closed for user root
Jul 02 20:02:38 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-2bc27a51-1855-4d59-8d33-d6ef83410dde tempest-CinderUnicodeTest-1330113583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e" returned: 0 in 0.836s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:02:38 devstack cinder-volume[86639]: DEBUG cinder.manager [None req-2bc27a51-1855-4d59-8d33-d6ef83410dde tempest-CinderUnicodeTest-1330113583 None] Notifying Schedulers of capabilities ... {{(pid=86639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 20:02:38 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-2bc27a51-1855-4d59-8d33-d6ef83410dde tempest-CinderUnicodeTest-1330113583 None] Deleted volume successfully.
Jul 02 20:02:38 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-2bc27a51-1855-4d59-8d33-d6ef83410dde tempest-CinderUnicodeTest-1330113583 None] Lock "cinder-dd613410-e788-4eb3-8308-a1ed399980ee-delete_volume" released by "delete_volume" :: held 3.625s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 20:02:38 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-0aacfb3e-1ce7-433e-a36b-9785db540bff tempest-CinderUnicodeTest-1330113583 None] Acquiring lock "cinder-54969815-d642-4d21-9fcf-b0c53da0c072-delete_volume" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 20:02:38 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-0aacfb3e-1ce7-433e-a36b-9785db540bff tempest-CinderUnicodeTest-1330113583 None] Lock "cinder-54969815-d642-4d21-9fcf-b0c53da0c072-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 20:02:38 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-0aacfb3e-1ce7-433e-a36b-9785db540bff tempest-CinderUnicodeTest-1330113583 None] Acquiring lock "cinder-quobyte-54969815-d642-4d21-9fcf-b0c53da0c072" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 20:02:38 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-0aacfb3e-1ce7-433e-a36b-9785db540bff tempest-CinderUnicodeTest-1330113583 None] Lock "cinder-quobyte-54969815-d642-4d21-9fcf-b0c53da0c072" acquired by "delete_volume" :: waited 0.020s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 20:02:38 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[03b35bd6-15ba-462a-b047-61ce7bdc1c82]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 20:02:38 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-0aacfb3e-1ce7-433e-a36b-9785db540bff tempest-CinderUnicodeTest-1330113583 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-54969815-d642-4d21-9fcf-b0c53da0c072 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:02:38 devstack sudo[106051]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-54969815-d642-4d21-9fcf-b0c53da0c072
Jul 02 20:02:38 devstack sudo[106051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:02:39 devstack sudo[106051]: pam_unix(sudo:session): session closed for user root
Jul 02 20:02:39 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-0aacfb3e-1ce7-433e-a36b-9785db540bff tempest-CinderUnicodeTest-1330113583 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-54969815-d642-4d21-9fcf-b0c53da0c072" returned: 0 in 0.817s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:02:39 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-0aacfb3e-1ce7-433e-a36b-9785db540bff tempest-CinderUnicodeTest-1330113583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-54969815-d642-4d21-9fcf-b0c53da0c072 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:02:39 devstack sudo[106056]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-54969815-d642-4d21-9fcf-b0c53da0c072
Jul 02 20:02:39 devstack sudo[106056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:02:39 devstack sudo[106056]: pam_unix(sudo:session): session closed for user root
Jul 02 20:02:39 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-0aacfb3e-1ce7-433e-a36b-9785db540bff tempest-CinderUnicodeTest-1330113583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-54969815-d642-4d21-9fcf-b0c53da0c072" returned: 0 in 0.766s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:02:39 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-0aacfb3e-1ce7-433e-a36b-9785db540bff tempest-CinderUnicodeTest-1330113583 None] Lock "cinder-quobyte-54969815-d642-4d21-9fcf-b0c53da0c072" released by "delete_volume" :: held 1.640s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 20:02:39 devstack cinder-volume[86639]: DEBUG cinder.quota [None req-0aacfb3e-1ce7-433e-a36b-9785db540bff tempest-CinderUnicodeTest-1330113583 None] Created reservations ['a0415050-18d3-48b0-9aa5-0f8776cc809e', '5bdf6f42-fe31-4c09-924d-43cdee4d5ca1', '9acbe3de-194c-4d58-b39c-a007a261917a', '5bb1fff5-462d-48ff-a0e8-c32a40895394'] {{(pid=86639) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 20:02:39 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-0aacfb3e-1ce7-433e-a36b-9785db540bff tempest-CinderUnicodeTest-1330113583 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 20:02:39 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-0aacfb3e-1ce7-433e-a36b-9785db540bff tempest-CinderUnicodeTest-1330113583 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 20:02:39 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-0aacfb3e-1ce7-433e-a36b-9785db540bff tempest-CinderUnicodeTest-1330113583 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 20:02:39 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-0aacfb3e-1ce7-433e-a36b-9785db540bff tempest-CinderUnicodeTest-1330113583 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 20:02:39 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-0aacfb3e-1ce7-433e-a36b-9785db540bff tempest-CinderUnicodeTest-1330113583 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 20:02:39 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-0aacfb3e-1ce7-433e-a36b-9785db540bff tempest-CinderUnicodeTest-1330113583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:02:39 devstack sudo[106061]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e
Jul 02 20:02:39 devstack sudo[106061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:02:40 devstack sudo[106061]: pam_unix(sudo:session): session closed for user root
Jul 02 20:02:40 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-0aacfb3e-1ce7-433e-a36b-9785db540bff tempest-CinderUnicodeTest-1330113583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e" returned: 0 in 0.929s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:02:40 devstack cinder-volume[86639]: DEBUG cinder.manager [None req-0aacfb3e-1ce7-433e-a36b-9785db540bff tempest-CinderUnicodeTest-1330113583 None] Notifying Schedulers of capabilities ... {{(pid=86639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 20:02:40 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-0aacfb3e-1ce7-433e-a36b-9785db540bff tempest-CinderUnicodeTest-1330113583 None] Deleted volume successfully.
Jul 02 20:02:40 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-0aacfb3e-1ce7-433e-a36b-9785db540bff tempest-CinderUnicodeTest-1330113583 None] Lock "cinder-54969815-d642-4d21-9fcf-b0c53da0c072-delete_volume" released by "delete_volume" :: held 2.821s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 20:02:41 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [req-1c58cce7-4ed5-4581-8247-1d2d7861a4b2 req-bc17baaa-b1e9-403d-b974-6fb161d6b952 tempest-TestServerVolumeAttachmentScenario-1761887952 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 20:02:41 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [req-1c58cce7-4ed5-4581-8247-1d2d7861a4b2 req-bc17baaa-b1e9-403d-b974-6fb161d6b952 tempest-TestServerVolumeAttachmentScenario-1761887952 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 20:02:41 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[97f8d394-2e89-4f5a-bd68-1723c86176fc]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 20:02:41 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [req-1c58cce7-4ed5-4581-8247-1d2d7861a4b2 req-bc17baaa-b1e9-403d-b974-6fb161d6b952 tempest-TestServerVolumeAttachmentScenario-1761887952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-3f0c28ce-9fcf-43b4-8606-c979fe33f49e {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:02:41 devstack cinder-volume[86639]: DEBUG oslo_service.periodic_task [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86639) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 02 20:02:41 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 20:02:41 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 20:02:41 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 20:02:41 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 20:02:41 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 20:02:41 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:02:41 devstack sudo[106081]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e
Jul 02 20:02:41 devstack sudo[106081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:02:41 devstack sudo[106080]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-3f0c28ce-9fcf-43b4-8606-c979fe33f49e
Jul 02 20:02:41 devstack sudo[106080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:02:42 devstack sudo[106080]: pam_unix(sudo:session): session closed for user root
Jul 02 20:02:42 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [req-1c58cce7-4ed5-4581-8247-1d2d7861a4b2 req-bc17baaa-b1e9-403d-b974-6fb161d6b952 tempest-TestServerVolumeAttachmentScenario-1761887952 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-3f0c28ce-9fcf-43b4-8606-c979fe33f49e" returned: 0 in 1.064s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:02:42 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [req-1c58cce7-4ed5-4581-8247-1d2d7861a4b2 req-bc17baaa-b1e9-403d-b974-6fb161d6b952 tempest-TestServerVolumeAttachmentScenario-1761887952 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.095s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 20:02:42 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [req-1c58cce7-4ed5-4581-8247-1d2d7861a4b2 req-bc17baaa-b1e9-403d-b974-6fb161d6b952 tempest-TestServerVolumeAttachmentScenario-1761887952 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92', 'name': 'volume-3f0c28ce-9fcf-43b4-8606-c979fe33f49e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '43a2e5c2-f82a-4872-9a9a-d744d1880b1c', 'enforce_multipath': True} {{(pid=86639) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 02 20:02:42 devstack sudo[106081]: pam_unix(sudo:session): session closed for user root
Jul 02 20:02:42 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e" returned: 0 in 1.081s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:02:42 devstack cinder-volume[86639]: DEBUG cinder.manager [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] Notifying Schedulers of capabilities ... {{(pid=86639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 20:02:42 devstack cinder-volume[86639]: DEBUG oslo_service.periodic_task [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] Running periodic task VolumeManager._thread_info {{(pid=86639) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 02 20:02:42 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] thread count: 28 {{(pid=86639) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 02 20:02:42 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] thread info: [<_MainThread(MainThread, started 140525261275264)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 140525150678016)>, <Thread(Thread-3 (stat_writer), started daemon 140525150025920)>, <Thread(Rabbit-heartbeat, started daemon 140525150500864)>, <Thread(Thread-5 (_runner), started daemon 140525149847296)>, <Thread(Thread-7 (_runner), started daemon 140525149863424)>, <Thread(fd_logger, started daemon 140525146589376)>, <Thread(privsep_reader, started daemon 140525144562432)>, <Thread(tpool_thread_0, started daemon 140525137151680)>, <Thread(tpool_thread_1, started daemon 140525128758976)>, <Thread(tpool_thread_2, started daemon 140525120349888)>, <Thread(tpool_thread_3, started daemon 140525111940800)>, <Thread(tpool_thread_4, started daemon 140525103531712)>, <Thread(tpool_thread_5, started daemon 140525095122624)>, <Thread(tpool_thread_6, started daemon 140525086713536)>, <Thread(tpool_thread_7, started daemon 140525078304448)>, <Thread(tpool_thread_8, started daemon 140525069895360)>, <Thread(tpool_thread_9, started daemon 140525061486272)>, <Thread(tpool_thread_10, started daemon 140525053077184)>, <Thread(tpool_thread_11, started daemon 140525044668096)>, <Thread(tpool_thread_12, started daemon 140525036259008)>, <Thread(tpool_thread_13, started daemon 140525027849920)>, <Thread(tpool_thread_14, started daemon 140525019440832)>, <Thread(tpool_thread_15, started daemon 140525011031744)>, <Thread(tpool_thread_16, started daemon 140525002622656)>, <Thread(tpool_thread_17, started daemon 140524994213568)>, <Thread(tpool_thread_18, started daemon 140524985804480)>, <Thread(tpool_thread_19, started daemon 140524977395392)>] {{(pid=86639) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 02 20:02:42 devstack cinder-volume[86639]: INFO cinder.volume.manager [req-1c58cce7-4ed5-4581-8247-1d2d7861a4b2 req-bc17baaa-b1e9-403d-b974-6fb161d6b952 tempest-TestServerVolumeAttachmentScenario-1761887952 None] attachment_update completed successfully.
Jul 02 20:02:49 devstack cinder-volume[86639]: INFO cinder.volume.manager [req-d3cb92b0-753c-4e34-80a7-10b4cd44d5f8 req-8ffcaf3e-e239-451c-b695-a134a9236005 tempest-TestServerVolumeAttachmentScenario-1761887952 None] Terminate volume connection completed successfully.
Jul 02 20:02:49 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [req-d3cb92b0-753c-4e34-80a7-10b4cd44d5f8 req-8ffcaf3e-e239-451c-b695-a134a9236005 tempest-TestServerVolumeAttachmentScenario-1761887952 None] Deleting attachment 43a2e5c2-f82a-4872-9a9a-d744d1880b1c. {{(pid=86639) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 02 20:02:51 devstack cinder-volume[86639]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca271abb-279e-4a81-957a-910c841d6543 tempest-VolumeDependencyTests-314886768 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 20:02:51 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-ca271abb-279e-4a81-957a-910c841d6543 tempest-VolumeDependencyTests-314886768 None] Flow 'volume_create_manager' (fe8a8c3b-1e3c-43be-a61a-b1b0ce4ec42d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 20:02:51 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-ca271abb-279e-4a81-957a-910c841d6543 tempest-VolumeDependencyTests-314886768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08867aad-174f-43b3-9a0e-3bbc1d9c957a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:02:51 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-ca271abb-279e-4a81-957a-910c841d6543 tempest-VolumeDependencyTests-314886768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08867aad-174f-43b3-9a0e-3bbc1d9c957a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T18:02:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-999324104',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55aa8292-7512-48e6-856a-19a5a2734cbf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b65224613a534d31afe75f4159de66d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T18:02:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T18:02:52Z,use_quota=True,user_id='93b52b53ab4e4433bce95b99c35b4f67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:02:51 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-ca271abb-279e-4a81-957a-910c841d6543 tempest-VolumeDependencyTests-314886768 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (512a69fb-86f5-49e3-9c2b-a9838e916792) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:02:51 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-ca271abb-279e-4a81-957a-910c841d6543 tempest-VolumeDependencyTests-314886768 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (512a69fb-86f5-49e3-9c2b-a9838e916792) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:02:51 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-ca271abb-279e-4a81-957a-910c841d6543 tempest-VolumeDependencyTests-314886768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee1c8f5e-ca83-4bbf-840d-c684ca092096) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:02:51 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-ca271abb-279e-4a81-957a-910c841d6543 tempest-VolumeDependencyTests-314886768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee1c8f5e-ca83-4bbf-840d-c684ca092096) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '55aa8292-7512-48e6-856a-19a5a2734cbf', 'volume_name': 'volume-55aa8292-7512-48e6-856a-19a5a2734cbf', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:02:51 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-ca271abb-279e-4a81-957a-910c841d6543 tempest-VolumeDependencyTests-314886768 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62125f57-2253-4fc0-b397-3b4ed982218c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:02:51 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-ca271abb-279e-4a81-957a-910c841d6543 tempest-VolumeDependencyTests-314886768 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62125f57-2253-4fc0-b397-3b4ed982218c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:02:51 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-ca271abb-279e-4a81-957a-910c841d6543 tempest-VolumeDependencyTests-314886768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8e0442a-49be-40ed-880e-044a0ce582b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:02:51 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-ca271abb-279e-4a81-957a-910c841d6543 tempest-VolumeDependencyTests-314886768 None] Volume 55aa8292-7512-48e6-856a-19a5a2734cbf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-55aa8292-7512-48e6-856a-19a5a2734cbf', 'volume_size': 1}
Jul 02 20:02:51 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-ca271abb-279e-4a81-957a-910c841d6543 tempest-VolumeDependencyTests-314886768 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 20:02:51 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-ca271abb-279e-4a81-957a-910c841d6543 tempest-VolumeDependencyTests-314886768 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 20:02:51 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-ca271abb-279e-4a81-957a-910c841d6543 tempest-VolumeDependencyTests-314886768 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce906cb830>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T18:02:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-999324104',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55aa8292-7512-48e6-856a-19a5a2734cbf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b65224613a534d31afe75f4159de66d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T18:02:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T18:02:52Z,use_quota=True,user_id='93b52b53ab4e4433bce95b99c35b4f67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)}" {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 20:02:51 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-ca271abb-279e-4a81-957a-910c841d6543 tempest-VolumeDependencyTests-314886768 None] Creating volume 55aa8292-7512-48e6-856a-19a5a2734cbf {{(pid=86639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 20:02:51 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-ca271abb-279e-4a81-957a-910c841d6543 tempest-VolumeDependencyTests-314886768 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 20:02:51 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-ca271abb-279e-4a81-957a-910c841d6543 tempest-VolumeDependencyTests-314886768 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 20:02:51 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-ca271abb-279e-4a81-957a-910c841d6543 tempest-VolumeDependencyTests-314886768 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 20:02:51 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-ca271abb-279e-4a81-957a-910c841d6543 tempest-VolumeDependencyTests-314886768 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 20:02:51 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-ca271abb-279e-4a81-957a-910c841d6543 tempest-VolumeDependencyTests-314886768 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 20:02:51 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-ca271abb-279e-4a81-957a-910c841d6543 tempest-VolumeDependencyTests-314886768 None] Selected osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92 as target Quobyte volume. {{(pid=86639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 20:02:51 devstack cinder-volume[86639]: INFO cinder.volume.drivers.remotefs [None req-ca271abb-279e-4a81-957a-910c841d6543 tempest-VolumeDependencyTests-314886768 None] casted to osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92
Jul 02 20:02:51 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-ca271abb-279e-4a81-957a-910c841d6543 tempest-VolumeDependencyTests-314886768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-55aa8292-7512-48e6-856a-19a5a2734cbf 1073741824 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:02:51 devstack sudo[106122]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-55aa8292-7512-48e6-856a-19a5a2734cbf 1073741824
Jul 02 20:02:51 devstack sudo[106122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:02:52 devstack sudo[106122]: pam_unix(sudo:session): session closed for user root
Jul 02 20:02:52 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-ca271abb-279e-4a81-957a-910c841d6543 tempest-VolumeDependencyTests-314886768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-55aa8292-7512-48e6-856a-19a5a2734cbf 1073741824" returned: 0 in 1.014s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:02:52 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-ca271abb-279e-4a81-957a-910c841d6543 tempest-VolumeDependencyTests-314886768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-55aa8292-7512-48e6-856a-19a5a2734cbf {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:02:52 devstack sudo[106130]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-55aa8292-7512-48e6-856a-19a5a2734cbf
Jul 02 20:02:52 devstack sudo[106130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:02:53 devstack cinder-volume[86639]: INFO cinder.volume.manager [req-a3cc2aec-7b92-4593-b0e7-cd0c6c07aefc req-0746d378-d65e-414b-9c86-a987861d344e tempest-TestServerVolumeAttachmentScenario-1761887952 None] Terminate volume connection completed successfully.
Jul 02 20:02:53 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [req-a3cc2aec-7b92-4593-b0e7-cd0c6c07aefc req-0746d378-d65e-414b-9c86-a987861d344e tempest-TestServerVolumeAttachmentScenario-1761887952 None] Deleting attachment e4114cc7-8b6f-4da1-93c9-0e1fb1188682. {{(pid=86639) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 02 20:02:53 devstack sudo[106130]: pam_unix(sudo:session): session closed for user root
Jul 02 20:02:53 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-ca271abb-279e-4a81-957a-910c841d6543 tempest-VolumeDependencyTests-314886768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-55aa8292-7512-48e6-856a-19a5a2734cbf" returned: 0 in 0.930s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:02:53 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-ca271abb-279e-4a81-957a-910c841d6543 tempest-VolumeDependencyTests-314886768 None] <== create_volume: return (2012ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'} {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 20:02:53 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-ca271abb-279e-4a81-957a-910c841d6543 tempest-VolumeDependencyTests-314886768 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.015s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 20:02:53 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-ca271abb-279e-4a81-957a-910c841d6543 tempest-VolumeDependencyTests-314886768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8e0442a-49be-40ed-880e-044a0ce582b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-55aa8292-7512-48e6-856a-19a5a2734cbf', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:02:53 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-ca271abb-279e-4a81-957a-910c841d6543 tempest-VolumeDependencyTests-314886768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b2eaee7-505d-4fbe-ba53-de9a3967a533) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:02:53 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-ca271abb-279e-4a81-957a-910c841d6543 tempest-VolumeDependencyTests-314886768 None] Volume volume-55aa8292-7512-48e6-856a-19a5a2734cbf (55aa8292-7512-48e6-856a-19a5a2734cbf): created successfully
Jul 02 20:02:53 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-ca271abb-279e-4a81-957a-910c841d6543 tempest-VolumeDependencyTests-314886768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b2eaee7-505d-4fbe-ba53-de9a3967a533) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:02:53 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-ca271abb-279e-4a81-957a-910c841d6543 tempest-VolumeDependencyTests-314886768 None] Flow 'volume_create_manager' (fe8a8c3b-1e3c-43be-a61a-b1b0ce4ec42d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 20:02:53 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-ca271abb-279e-4a81-957a-910c841d6543 tempest-VolumeDependencyTests-314886768 None] Created volume successfully.
Jul 02 20:02:55 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-96f9dcb4-14ea-4c37-ad0e-2fc309de68c5 tempest-VolumeDependencyTests-314886768 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 20:02:55 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-96f9dcb4-14ea-4c37-ad0e-2fc309de68c5 tempest-VolumeDependencyTests-314886768 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 20:02:55 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-96f9dcb4-14ea-4c37-ad0e-2fc309de68c5 tempest-VolumeDependencyTests-314886768 None] Creating offline snapshot 3b3e2887-0ef3-4bc4-b92f-cafb3bb384a7 of volume 55aa8292-7512-48e6-856a-19a5a2734cbf {{(pid=86639) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 02 20:02:55 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[84508ed4-4100-4ef4-8c1b-de52e7eb9d33]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 20:02:55 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-96f9dcb4-14ea-4c37-ad0e-2fc309de68c5 tempest-VolumeDependencyTests-314886768 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-55aa8292-7512-48e6-856a-19a5a2734cbf {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:02:55 devstack sudo[106140]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-55aa8292-7512-48e6-856a-19a5a2734cbf
Jul 02 20:02:55 devstack sudo[106140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:02:56 devstack sudo[106140]: pam_unix(sudo:session): session closed for user root
Jul 02 20:02:56 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-96f9dcb4-14ea-4c37-ad0e-2fc309de68c5 tempest-VolumeDependencyTests-314886768 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-55aa8292-7512-48e6-856a-19a5a2734cbf" returned: 0 in 1.014s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:02:56 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-96f9dcb4-14ea-4c37-ad0e-2fc309de68c5 tempest-VolumeDependencyTests-314886768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-55aa8292-7512-48e6-856a-19a5a2734cbf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-55aa8292-7512-48e6-856a-19a5a2734cbf.3b3e2887-0ef3-4bc4-b92f-cafb3bb384a7 1G {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:02:56 devstack sudo[106146]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-55aa8292-7512-48e6-856a-19a5a2734cbf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-55aa8292-7512-48e6-856a-19a5a2734cbf.3b3e2887-0ef3-4bc4-b92f-cafb3bb384a7 1G
Jul 02 20:02:56 devstack sudo[106146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:02:57 devstack sudo[106146]: pam_unix(sudo:session): session closed for user root
Jul 02 20:02:57 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-96f9dcb4-14ea-4c37-ad0e-2fc309de68c5 tempest-VolumeDependencyTests-314886768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-55aa8292-7512-48e6-856a-19a5a2734cbf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-55aa8292-7512-48e6-856a-19a5a2734cbf.3b3e2887-0ef3-4bc4-b92f-cafb3bb384a7 1G" returned: 0 in 1.280s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:02:57 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-96f9dcb4-14ea-4c37-ad0e-2fc309de68c5 tempest-VolumeDependencyTests-314886768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-55aa8292-7512-48e6-856a-19a5a2734cbf -F qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-55aa8292-7512-48e6-856a-19a5a2734cbf.3b3e2887-0ef3-4bc4-b92f-cafb3bb384a7 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:02:57 devstack sudo[106189]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-55aa8292-7512-48e6-856a-19a5a2734cbf -F qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-55aa8292-7512-48e6-856a-19a5a2734cbf.3b3e2887-0ef3-4bc4-b92f-cafb3bb384a7
Jul 02 20:02:57 devstack sudo[106189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:02:58 devstack sudo[106189]: pam_unix(sudo:session): session closed for user root
Jul 02 20:02:58 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-96f9dcb4-14ea-4c37-ad0e-2fc309de68c5 tempest-VolumeDependencyTests-314886768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-55aa8292-7512-48e6-856a-19a5a2734cbf -F qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-55aa8292-7512-48e6-856a-19a5a2734cbf.3b3e2887-0ef3-4bc4-b92f-cafb3bb384a7" returned: 0 in 0.790s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:02:58 devstack cinder-volume[86639]: WARNING cinder.volume.drivers.remotefs [None req-96f9dcb4-14ea-4c37-ad0e-2fc309de68c5 tempest-VolumeDependencyTests-314886768 None] /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-55aa8292-7512-48e6-856a-19a5a2734cbf.3b3e2887-0ef3-4bc4-b92f-cafb3bb384a7 is being set with open permissions: ugo+rw
Jul 02 20:02:58 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-96f9dcb4-14ea-4c37-ad0e-2fc309de68c5 tempest-VolumeDependencyTests-314886768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-55aa8292-7512-48e6-856a-19a5a2734cbf.3b3e2887-0ef3-4bc4-b92f-cafb3bb384a7 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:02:58 devstack sudo[106195]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-55aa8292-7512-48e6-856a-19a5a2734cbf.3b3e2887-0ef3-4bc4-b92f-cafb3bb384a7
Jul 02 20:02:58 devstack sudo[106195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:02:59 devstack sudo[106195]: pam_unix(sudo:session): session closed for user root
Jul 02 20:02:59 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-96f9dcb4-14ea-4c37-ad0e-2fc309de68c5 tempest-VolumeDependencyTests-314886768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-55aa8292-7512-48e6-856a-19a5a2734cbf.3b3e2887-0ef3-4bc4-b92f-cafb3bb384a7" returned: 0 in 0.915s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:02:59 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-96f9dcb4-14ea-4c37-ad0e-2fc309de68c5 tempest-VolumeDependencyTests-314886768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-55aa8292-7512-48e6-856a-19a5a2734cbf.info {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:02:59 devstack sudo[106200]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-55aa8292-7512-48e6-856a-19a5a2734cbf.info
Jul 02 20:02:59 devstack sudo[106200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:02:59 devstack sudo[106200]: pam_unix(sudo:session): session closed for user root
Jul 02 20:02:59 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-96f9dcb4-14ea-4c37-ad0e-2fc309de68c5 tempest-VolumeDependencyTests-314886768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-55aa8292-7512-48e6-856a-19a5a2734cbf.info" returned: 0 in 0.744s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:02:59 devstack cinder-volume[86639]: WARNING cinder.volume.drivers.remotefs [None req-96f9dcb4-14ea-4c37-ad0e-2fc309de68c5 tempest-VolumeDependencyTests-314886768 None] /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-55aa8292-7512-48e6-856a-19a5a2734cbf.info is being set with open permissions: ugo+rw
Jul 02 20:02:59 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-96f9dcb4-14ea-4c37-ad0e-2fc309de68c5 tempest-VolumeDependencyTests-314886768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-55aa8292-7512-48e6-856a-19a5a2734cbf.info {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:02:59 devstack sudo[106203]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-55aa8292-7512-48e6-856a-19a5a2734cbf.info
Jul 02 20:03:00 devstack sudo[106203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:03:00 devstack sudo[106203]: pam_unix(sudo:session): session closed for user root
Jul 02 20:03:00 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-96f9dcb4-14ea-4c37-ad0e-2fc309de68c5 tempest-VolumeDependencyTests-314886768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-55aa8292-7512-48e6-856a-19a5a2734cbf.info" returned: 0 in 0.738s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:03:00 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-96f9dcb4-14ea-4c37-ad0e-2fc309de68c5 tempest-VolumeDependencyTests-314886768 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.610s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 20:03:00 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-96f9dcb4-14ea-4c37-ad0e-2fc309de68c5 tempest-VolumeDependencyTests-314886768 None] Create snapshot completed successfully
Jul 02 20:03:02 devstack cinder-volume[86639]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec74659b-a892-4096-8bfc-b6090ff6ee71 tempest-VolumeDependencyTests-314886768 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 20:03:02 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-ec74659b-a892-4096-8bfc-b6090ff6ee71 tempest-VolumeDependencyTests-314886768 None] Flow 'volume_create_manager' (73469360-1ffb-4433-bcf7-799d6000f058) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 20:03:02 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-ec74659b-a892-4096-8bfc-b6090ff6ee71 tempest-VolumeDependencyTests-314886768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5acf1d65-fa23-44ba-8c41-c9a4118b1211) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:03:02 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-ec74659b-a892-4096-8bfc-b6090ff6ee71 tempest-VolumeDependencyTests-314886768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5acf1d65-fa23-44ba-8c41-c9a4118b1211) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T18:03:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-642710749',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0c1ba77-e9be-4918-ac3a-f5b7844a4c2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b65224613a534d31afe75f4159de66d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T18:03:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=3b3e2887-0ef3-4bc4-b92f-cafb3bb384a7,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T18:03:02Z,use_quota=True,user_id='93b52b53ab4e4433bce95b99c35b4f67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:03:02 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-ec74659b-a892-4096-8bfc-b6090ff6ee71 tempest-VolumeDependencyTests-314886768 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32d8e59d-499d-4b72-977a-f168f2d4bbb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:03:02 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-ec74659b-a892-4096-8bfc-b6090ff6ee71 tempest-VolumeDependencyTests-314886768 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32d8e59d-499d-4b72-977a-f168f2d4bbb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:03:02 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-ec74659b-a892-4096-8bfc-b6090ff6ee71 tempest-VolumeDependencyTests-314886768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe7ea9b4-3494-4a2a-b736-e29feb72e416) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:03:02 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-ec74659b-a892-4096-8bfc-b6090ff6ee71 tempest-VolumeDependencyTests-314886768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe7ea9b4-3494-4a2a-b736-e29feb72e416) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'd0c1ba77-e9be-4918-ac3a-f5b7844a4c2c', 'volume_name': 'volume-d0c1ba77-e9be-4918-ac3a-f5b7844a4c2c', 'volume_size': 1, 'snapshot_id': '3b3e2887-0ef3-4bc4-b92f-cafb3bb384a7'}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:03:02 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-ec74659b-a892-4096-8bfc-b6090ff6ee71 tempest-VolumeDependencyTests-314886768 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c9ffbfa-9381-4675-bb47-9a64bd14a820) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:03:02 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-ec74659b-a892-4096-8bfc-b6090ff6ee71 tempest-VolumeDependencyTests-314886768 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c9ffbfa-9381-4675-bb47-9a64bd14a820) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:03:02 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-ec74659b-a892-4096-8bfc-b6090ff6ee71 tempest-VolumeDependencyTests-314886768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f98ba90-93a1-4c04-9281-625bc4863993) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:03:02 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-ec74659b-a892-4096-8bfc-b6090ff6ee71 tempest-VolumeDependencyTests-314886768 None] Volume d0c1ba77-e9be-4918-ac3a-f5b7844a4c2c: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-d0c1ba77-e9be-4918-ac3a-f5b7844a4c2c', 'volume_size': 1, 'snapshot_id': '3b3e2887-0ef3-4bc4-b92f-cafb3bb384a7'}
Jul 02 20:03:02 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-ec74659b-a892-4096-8bfc-b6090ff6ee71 tempest-VolumeDependencyTests-314886768 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 20:03:02 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-ec74659b-a892-4096-8bfc-b6090ff6ee71 tempest-VolumeDependencyTests-314886768 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 20:03:02 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-ec74659b-a892-4096-8bfc-b6090ff6ee71 tempest-VolumeDependencyTests-314886768 None] Acquiring lock "cinder-quobyte-3b3e2887-0ef3-4bc4-b92f-cafb3bb384a7-d0c1ba77-e9be-4918-ac3a-f5b7844a4c2c" by "_create_volume_from_snapshot" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 20:03:02 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-ec74659b-a892-4096-8bfc-b6090ff6ee71 tempest-VolumeDependencyTests-314886768 None] Lock "cinder-quobyte-3b3e2887-0ef3-4bc4-b92f-cafb3bb384a7-d0c1ba77-e9be-4918-ac3a-f5b7844a4c2c" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 20:03:02 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-ec74659b-a892-4096-8bfc-b6090ff6ee71 tempest-VolumeDependencyTests-314886768 None] Creating volume d0c1ba77-e9be-4918-ac3a-f5b7844a4c2c from snapshot 3b3e2887-0ef3-4bc4-b92f-cafb3bb384a7 {{(pid=86639) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jul 02 20:03:02 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-ec74659b-a892-4096-8bfc-b6090ff6ee71 tempest-VolumeDependencyTests-314886768 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 20:03:02 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-ec74659b-a892-4096-8bfc-b6090ff6ee71 tempest-VolumeDependencyTests-314886768 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 20:03:02 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-ec74659b-a892-4096-8bfc-b6090ff6ee71 tempest-VolumeDependencyTests-314886768 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 20:03:02 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-ec74659b-a892-4096-8bfc-b6090ff6ee71 tempest-VolumeDependencyTests-314886768 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 20:03:02 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-ec74659b-a892-4096-8bfc-b6090ff6ee71 tempest-VolumeDependencyTests-314886768 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 20:03:02 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-ec74659b-a892-4096-8bfc-b6090ff6ee71 tempest-VolumeDependencyTests-314886768 None] Selected osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92 as target Quobyte volume. {{(pid=86639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 20:03:02 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-ec74659b-a892-4096-8bfc-b6090ff6ee71 tempest-VolumeDependencyTests-314886768 None] Acquiring lock "cinder-quobyte-d0c1ba77-e9be-4918-ac3a-f5b7844a4c2c" by "_copy_volume_from_snapshot" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 20:03:02 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-ec74659b-a892-4096-8bfc-b6090ff6ee71 tempest-VolumeDependencyTests-314886768 None] Lock "cinder-quobyte-d0c1ba77-e9be-4918-ac3a-f5b7844a4c2c" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 20:03:02 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-ec74659b-a892-4096-8bfc-b6090ff6ee71 tempest-VolumeDependencyTests-314886768 None] snapshot: 3b3e2887-0ef3-4bc4-b92f-cafb3bb384a7, volume: d0c1ba77-e9be-4918-ac3a-f5b7844a4c2c,  {{(pid=86639) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jul 02 20:03:02 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-ec74659b-a892-4096-8bfc-b6090ff6ee71 tempest-VolumeDependencyTests-314886768 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 20:03:02 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-ec74659b-a892-4096-8bfc-b6090ff6ee71 tempest-VolumeDependencyTests-314886768 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 20:03:02 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-ec74659b-a892-4096-8bfc-b6090ff6ee71 tempest-VolumeDependencyTests-314886768 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 20:03:02 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-ec74659b-a892-4096-8bfc-b6090ff6ee71 tempest-VolumeDependencyTests-314886768 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 20:03:02 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-ec74659b-a892-4096-8bfc-b6090ff6ee71 tempest-VolumeDependencyTests-314886768 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 20:03:02 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[01afe31f-7608-452b-94ae-471cfcdeca65]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 20:03:02 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-ec74659b-a892-4096-8bfc-b6090ff6ee71 tempest-VolumeDependencyTests-314886768 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-55aa8292-7512-48e6-856a-19a5a2734cbf.3b3e2887-0ef3-4bc4-b92f-cafb3bb384a7 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:03:02 devstack sudo[106206]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-55aa8292-7512-48e6-856a-19a5a2734cbf.3b3e2887-0ef3-4bc4-b92f-cafb3bb384a7
Jul 02 20:03:02 devstack sudo[106206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:03:03 devstack sudo[106206]: pam_unix(sudo:session): session closed for user root
Jul 02 20:03:03 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-ec74659b-a892-4096-8bfc-b6090ff6ee71 tempest-VolumeDependencyTests-314886768 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-55aa8292-7512-48e6-856a-19a5a2734cbf.3b3e2887-0ef3-4bc4-b92f-cafb3bb384a7" returned: 0 in 0.968s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:03:03 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-ec74659b-a892-4096-8bfc-b6090ff6ee71 tempest-VolumeDependencyTests-314886768 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-55aa8292-7512-48e6-856a-19a5a2734cbf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86639) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 02 20:03:03 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-ec74659b-a892-4096-8bfc-b6090ff6ee71 tempest-VolumeDependencyTests-314886768 None] will copy from snapshot at /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-55aa8292-7512-48e6-856a-19a5a2734cbf {{(pid=86639) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jul 02 20:03:03 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-ec74659b-a892-4096-8bfc-b6090ff6ee71 tempest-VolumeDependencyTests-314886768 None] Creating direct copy from snapshot {{(pid=86639) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jul 02 20:03:03 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[b35cc2b3-f729-4a93-897d-c3c1fa9c267e]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 20:03:03 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-ec74659b-a892-4096-8bfc-b6090ff6ee71 tempest-VolumeDependencyTests-314886768 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-55aa8292-7512-48e6-856a-19a5a2734cbf {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:03:03 devstack sudo[106211]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-55aa8292-7512-48e6-856a-19a5a2734cbf
Jul 02 20:03:03 devstack sudo[106211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:03:04 devstack sudo[106211]: pam_unix(sudo:session): session closed for user root
Jul 02 20:03:04 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-ec74659b-a892-4096-8bfc-b6090ff6ee71 tempest-VolumeDependencyTests-314886768 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-55aa8292-7512-48e6-856a-19a5a2734cbf" returned: 0 in 0.961s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:03:04 devstack cinder-volume[86639]: DEBUG cinder.utils [None req-ec74659b-a892-4096-8bfc-b6090ff6ee71 tempest-VolumeDependencyTests-314886768 None] Path /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-d0c1ba77-e9be-4918-ac3a-f5b7844a4c2c not found in is_blk_device check {{(pid=86639) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 02 20:03:04 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-ec74659b-a892-4096-8bfc-b6090ff6ee71 tempest-VolumeDependencyTests-314886768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-55aa8292-7512-48e6-856a-19a5a2734cbf /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-d0c1ba77-e9be-4918-ac3a-f5b7844a4c2c {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:03:04 devstack sudo[106217]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-55aa8292-7512-48e6-856a-19a5a2734cbf /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-d0c1ba77-e9be-4918-ac3a-f5b7844a4c2c
Jul 02 20:03:04 devstack sudo[106217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:03:04 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-f8b5eab0-7422-4bbe-bf68-cdcb005a2550 tempest-TestServerVolumeAttachmentScenario-1761887952 None] Acquiring lock "cinder-3f0c28ce-9fcf-43b4-8606-c979fe33f49e-delete_volume" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 20:03:04 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-f8b5eab0-7422-4bbe-bf68-cdcb005a2550 tempest-TestServerVolumeAttachmentScenario-1761887952 None] Lock "cinder-3f0c28ce-9fcf-43b4-8606-c979fe33f49e-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 20:03:04 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-f8b5eab0-7422-4bbe-bf68-cdcb005a2550 tempest-TestServerVolumeAttachmentScenario-1761887952 None] Acquiring lock "cinder-quobyte-3f0c28ce-9fcf-43b4-8606-c979fe33f49e" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 20:03:04 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-f8b5eab0-7422-4bbe-bf68-cdcb005a2550 tempest-TestServerVolumeAttachmentScenario-1761887952 None] Lock "cinder-quobyte-3f0c28ce-9fcf-43b4-8606-c979fe33f49e" acquired by "delete_volume" :: waited 0.035s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 20:03:04 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[7288fa59-f1cd-43c8-84bd-2edb905d6cce]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 20:03:04 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-f8b5eab0-7422-4bbe-bf68-cdcb005a2550 tempest-TestServerVolumeAttachmentScenario-1761887952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-3f0c28ce-9fcf-43b4-8606-c979fe33f49e {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:03:05 devstack sudo[106219]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-3f0c28ce-9fcf-43b4-8606-c979fe33f49e
Jul 02 20:03:05 devstack sudo[106219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:03:06 devstack sudo[106219]: pam_unix(sudo:session): session closed for user root
Jul 02 20:03:06 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-f8b5eab0-7422-4bbe-bf68-cdcb005a2550 tempest-TestServerVolumeAttachmentScenario-1761887952 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-3f0c28ce-9fcf-43b4-8606-c979fe33f49e" returned: 0 in 1.565s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:03:06 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-f8b5eab0-7422-4bbe-bf68-cdcb005a2550 tempest-TestServerVolumeAttachmentScenario-1761887952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-3f0c28ce-9fcf-43b4-8606-c979fe33f49e {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:03:06 devstack sudo[106235]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-3f0c28ce-9fcf-43b4-8606-c979fe33f49e
Jul 02 20:03:06 devstack sudo[106235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:03:09 devstack sudo[106235]: pam_unix(sudo:session): session closed for user root
Jul 02 20:03:09 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-f8b5eab0-7422-4bbe-bf68-cdcb005a2550 tempest-TestServerVolumeAttachmentScenario-1761887952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-3f0c28ce-9fcf-43b4-8606-c979fe33f49e" returned: 0 in 2.776s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:03:09 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-f8b5eab0-7422-4bbe-bf68-cdcb005a2550 tempest-TestServerVolumeAttachmentScenario-1761887952 None] Lock "cinder-quobyte-3f0c28ce-9fcf-43b4-8606-c979fe33f49e" released by "delete_volume" :: held 4.445s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 20:03:09 devstack cinder-volume[86639]: DEBUG cinder.quota [None req-f8b5eab0-7422-4bbe-bf68-cdcb005a2550 tempest-TestServerVolumeAttachmentScenario-1761887952 None] Created reservations ['6cf2e5b5-7957-4c3d-bd1e-248afc63535d', 'e2528dfc-cd32-4f40-b968-e502c844d40d', 'c997196f-18b1-438b-99dc-177bbb6a214c', '491a5e0d-b8f0-43eb-a302-c7b178760972'] {{(pid=86639) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 20:03:09 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-f8b5eab0-7422-4bbe-bf68-cdcb005a2550 tempest-TestServerVolumeAttachmentScenario-1761887952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 20:03:09 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-f8b5eab0-7422-4bbe-bf68-cdcb005a2550 tempest-TestServerVolumeAttachmentScenario-1761887952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 20:03:09 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-f8b5eab0-7422-4bbe-bf68-cdcb005a2550 tempest-TestServerVolumeAttachmentScenario-1761887952 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 20:03:09 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-f8b5eab0-7422-4bbe-bf68-cdcb005a2550 tempest-TestServerVolumeAttachmentScenario-1761887952 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 20:03:09 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-f8b5eab0-7422-4bbe-bf68-cdcb005a2550 tempest-TestServerVolumeAttachmentScenario-1761887952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 20:03:09 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-f8b5eab0-7422-4bbe-bf68-cdcb005a2550 tempest-TestServerVolumeAttachmentScenario-1761887952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:03:09 devstack sudo[106238]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e
Jul 02 20:03:09 devstack sudo[106238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:03:10 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-c94a6029-4a13-4594-aff7-aa8484199b80 tempest-TestServerVolumeAttachmentScenario-1761887952 None] Acquiring lock "cinder-3176f4d1-2a0d-4e63-8a99-e0118b014efd-delete_volume" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 20:03:10 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-c94a6029-4a13-4594-aff7-aa8484199b80 tempest-TestServerVolumeAttachmentScenario-1761887952 None] Lock "cinder-3176f4d1-2a0d-4e63-8a99-e0118b014efd-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 20:03:11 devstack sudo[106238]: pam_unix(sudo:session): session closed for user root
Jul 02 20:03:11 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-f8b5eab0-7422-4bbe-bf68-cdcb005a2550 tempest-TestServerVolumeAttachmentScenario-1761887952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e" returned: 0 in 1.297s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:03:11 devstack cinder-volume[86639]: DEBUG cinder.manager [None req-f8b5eab0-7422-4bbe-bf68-cdcb005a2550 tempest-TestServerVolumeAttachmentScenario-1761887952 None] Notifying Schedulers of capabilities ... {{(pid=86639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 20:03:11 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-f8b5eab0-7422-4bbe-bf68-cdcb005a2550 tempest-TestServerVolumeAttachmentScenario-1761887952 None] Deleted volume successfully.
Jul 02 20:03:11 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-c94a6029-4a13-4594-aff7-aa8484199b80 tempest-TestServerVolumeAttachmentScenario-1761887952 None] Acquiring lock "cinder-quobyte-3176f4d1-2a0d-4e63-8a99-e0118b014efd" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 20:03:11 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-f8b5eab0-7422-4bbe-bf68-cdcb005a2550 tempest-TestServerVolumeAttachmentScenario-1761887952 None] Lock "cinder-3f0c28ce-9fcf-43b4-8606-c979fe33f49e-delete_volume" released by "delete_volume" :: held 6.415s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 20:03:11 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-c94a6029-4a13-4594-aff7-aa8484199b80 tempest-TestServerVolumeAttachmentScenario-1761887952 None] Lock "cinder-quobyte-3176f4d1-2a0d-4e63-8a99-e0118b014efd" acquired by "delete_volume" :: waited 0.027s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 20:03:11 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd7ca2db-278b-4067-b9c3-09203a428143]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 20:03:11 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-c94a6029-4a13-4594-aff7-aa8484199b80 tempest-TestServerVolumeAttachmentScenario-1761887952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-3176f4d1-2a0d-4e63-8a99-e0118b014efd {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:03:11 devstack sudo[106217]: pam_unix(sudo:session): session closed for user root
Jul 02 20:03:11 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-ec74659b-a892-4096-8bfc-b6090ff6ee71 tempest-VolumeDependencyTests-314886768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-55aa8292-7512-48e6-856a-19a5a2734cbf /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-d0c1ba77-e9be-4918-ac3a-f5b7844a4c2c" returned: 0 in 6.893s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:03:11 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[0362ea4d-4d4b-487a-8bba-d723143f8dc9]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 20:03:11 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-ec74659b-a892-4096-8bfc-b6090ff6ee71 tempest-VolumeDependencyTests-314886768 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-55aa8292-7512-48e6-856a-19a5a2734cbf {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:03:11 devstack sudo[106241]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-3176f4d1-2a0d-4e63-8a99-e0118b014efd
Jul 02 20:03:11 devstack sudo[106241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:03:11 devstack sudo[106242]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-55aa8292-7512-48e6-856a-19a5a2734cbf
Jul 02 20:03:11 devstack sudo[106242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:03:12 devstack sudo[106241]: pam_unix(sudo:session): session closed for user root
Jul 02 20:03:12 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-c94a6029-4a13-4594-aff7-aa8484199b80 tempest-TestServerVolumeAttachmentScenario-1761887952 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-3176f4d1-2a0d-4e63-8a99-e0118b014efd" returned: 0 in 0.889s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:03:12 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-c94a6029-4a13-4594-aff7-aa8484199b80 tempest-TestServerVolumeAttachmentScenario-1761887952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-3176f4d1-2a0d-4e63-8a99-e0118b014efd {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:03:12 devstack sudo[106250]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-3176f4d1-2a0d-4e63-8a99-e0118b014efd
Jul 02 20:03:12 devstack sudo[106250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:03:12 devstack sudo[106242]: pam_unix(sudo:session): session closed for user root
Jul 02 20:03:12 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-ec74659b-a892-4096-8bfc-b6090ff6ee71 tempest-VolumeDependencyTests-314886768 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-55aa8292-7512-48e6-856a-19a5a2734cbf" returned: 0 in 1.049s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:03:12 devstack cinder-volume[86639]: DEBUG cinder.image.image_utils [None req-ec74659b-a892-4096-8bfc-b6090ff6ee71 tempest-VolumeDependencyTests-314886768 None] Image conversion details: src /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-55aa8292-7512-48e6-856a-19a5a2734cbf, size 1024.00 MB, duration 6.90 sec, destination /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-d0c1ba77-e9be-4918-ac3a-f5b7844a4c2c {{(pid=86639) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 02 20:03:12 devstack cinder-volume[86639]: INFO cinder.image.image_utils [None req-ec74659b-a892-4096-8bfc-b6090ff6ee71 tempest-VolumeDependencyTests-314886768 None] Converted 1024.00 MB image at 148.50 MB/s
Jul 02 20:03:12 devstack cinder-volume[86639]: WARNING cinder.volume.drivers.remotefs [None req-ec74659b-a892-4096-8bfc-b6090ff6ee71 tempest-VolumeDependencyTests-314886768 None] /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-d0c1ba77-e9be-4918-ac3a-f5b7844a4c2c is being set with open permissions: ugo+rw
Jul 02 20:03:12 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-ec74659b-a892-4096-8bfc-b6090ff6ee71 tempest-VolumeDependencyTests-314886768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-d0c1ba77-e9be-4918-ac3a-f5b7844a4c2c {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:03:12 devstack sudo[106253]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-d0c1ba77-e9be-4918-ac3a-f5b7844a4c2c
Jul 02 20:03:12 devstack sudo[106253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:03:12 devstack sudo[106250]: pam_unix(sudo:session): session closed for user root
Jul 02 20:03:12 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-c94a6029-4a13-4594-aff7-aa8484199b80 tempest-TestServerVolumeAttachmentScenario-1761887952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-3176f4d1-2a0d-4e63-8a99-e0118b014efd" returned: 0 in 0.763s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:03:12 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-c94a6029-4a13-4594-aff7-aa8484199b80 tempest-TestServerVolumeAttachmentScenario-1761887952 None] Lock "cinder-quobyte-3176f4d1-2a0d-4e63-8a99-e0118b014efd" released by "delete_volume" :: held 1.711s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 20:03:12 devstack cinder-volume[86639]: DEBUG cinder.quota [None req-c94a6029-4a13-4594-aff7-aa8484199b80 tempest-TestServerVolumeAttachmentScenario-1761887952 None] Created reservations ['dc5b16aa-78bd-4054-ba79-3a20a8318eb4', 'e09bcc7a-8ab6-46ac-a62a-2626ad2923c2', '4fd134cd-b84c-4e61-98b1-88579c31a0fb', '8ca6844b-e7ba-4870-acf4-5a6dd5b473b8'] {{(pid=86639) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 20:03:12 devstack sudo[106253]: pam_unix(sudo:session): session closed for user root
Jul 02 20:03:12 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-ec74659b-a892-4096-8bfc-b6090ff6ee71 tempest-VolumeDependencyTests-314886768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-d0c1ba77-e9be-4918-ac3a-f5b7844a4c2c" returned: 0 in 0.684s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:03:12 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-ec74659b-a892-4096-8bfc-b6090ff6ee71 tempest-VolumeDependencyTests-314886768 None] Lock "cinder-quobyte-d0c1ba77-e9be-4918-ac3a-f5b7844a4c2c" released by "_copy_volume_from_snapshot" :: held 10.676s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 20:03:12 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-ec74659b-a892-4096-8bfc-b6090ff6ee71 tempest-VolumeDependencyTests-314886768 None] Lock "cinder-quobyte-3b3e2887-0ef3-4bc4-b92f-cafb3bb384a7-d0c1ba77-e9be-4918-ac3a-f5b7844a4c2c" released by "_create_volume_from_snapshot" :: held 10.715s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 20:03:12 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-ec74659b-a892-4096-8bfc-b6090ff6ee71 tempest-VolumeDependencyTests-314886768 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.731s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 20:03:13 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-c94a6029-4a13-4594-aff7-aa8484199b80 tempest-TestServerVolumeAttachmentScenario-1761887952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 20:03:13 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-c94a6029-4a13-4594-aff7-aa8484199b80 tempest-TestServerVolumeAttachmentScenario-1761887952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 20:03:13 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-c94a6029-4a13-4594-aff7-aa8484199b80 tempest-TestServerVolumeAttachmentScenario-1761887952 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 20:03:13 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-c94a6029-4a13-4594-aff7-aa8484199b80 tempest-TestServerVolumeAttachmentScenario-1761887952 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 20:03:13 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-c94a6029-4a13-4594-aff7-aa8484199b80 tempest-TestServerVolumeAttachmentScenario-1761887952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 20:03:13 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-c94a6029-4a13-4594-aff7-aa8484199b80 tempest-TestServerVolumeAttachmentScenario-1761887952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:03:13 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-ec74659b-a892-4096-8bfc-b6090ff6ee71 tempest-VolumeDependencyTests-314886768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f98ba90-93a1-4c04-9281-625bc4863993) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d0c1ba77-e9be-4918-ac3a-f5b7844a4c2c', 'volume_size': 1, 'snapshot_id': '3b3e2887-0ef3-4bc4-b92f-cafb3bb384a7'}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:03:13 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-ec74659b-a892-4096-8bfc-b6090ff6ee71 tempest-VolumeDependencyTests-314886768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6dec2f1-345b-4f4d-99f1-ef8fdf279a6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:03:13 devstack sudo[106257]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e
Jul 02 20:03:13 devstack sudo[106257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:03:13 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-ec74659b-a892-4096-8bfc-b6090ff6ee71 tempest-VolumeDependencyTests-314886768 None] Volume volume-d0c1ba77-e9be-4918-ac3a-f5b7844a4c2c (d0c1ba77-e9be-4918-ac3a-f5b7844a4c2c): created successfully
Jul 02 20:03:13 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-ec74659b-a892-4096-8bfc-b6090ff6ee71 tempest-VolumeDependencyTests-314886768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6dec2f1-345b-4f4d-99f1-ef8fdf279a6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:03:13 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-ec74659b-a892-4096-8bfc-b6090ff6ee71 tempest-VolumeDependencyTests-314886768 None] Flow 'volume_create_manager' (73469360-1ffb-4433-bcf7-799d6000f058) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 20:03:13 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-ec74659b-a892-4096-8bfc-b6090ff6ee71 tempest-VolumeDependencyTests-314886768 None] Created volume successfully.
Jul 02 20:03:13 devstack sudo[106257]: pam_unix(sudo:session): session closed for user root
Jul 02 20:03:13 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-c94a6029-4a13-4594-aff7-aa8484199b80 tempest-TestServerVolumeAttachmentScenario-1761887952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e" returned: 0 in 0.822s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:03:13 devstack cinder-volume[86639]: DEBUG cinder.manager [None req-c94a6029-4a13-4594-aff7-aa8484199b80 tempest-TestServerVolumeAttachmentScenario-1761887952 None] Notifying Schedulers of capabilities ... {{(pid=86639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 20:03:13 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-c94a6029-4a13-4594-aff7-aa8484199b80 tempest-TestServerVolumeAttachmentScenario-1761887952 None] Deleted volume successfully.
Jul 02 20:03:13 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-c94a6029-4a13-4594-aff7-aa8484199b80 tempest-TestServerVolumeAttachmentScenario-1761887952 None] Lock "cinder-3176f4d1-2a0d-4e63-8a99-e0118b014efd-delete_volume" released by "delete_volume" :: held 2.943s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 20:03:14 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-dab197fc-2117-4260-86d1-29332d0bdb3b tempest-VolumeDependencyTests-314886768 None] Acquiring lock "cinder-3b3e2887-0ef3-4bc4-b92f-cafb3bb384a7-delete_snapshot" by "delete_snapshot" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 20:03:14 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-dab197fc-2117-4260-86d1-29332d0bdb3b tempest-VolumeDependencyTests-314886768 None] Lock "cinder-3b3e2887-0ef3-4bc4-b92f-cafb3bb384a7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 20:03:14 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-dab197fc-2117-4260-86d1-29332d0bdb3b tempest-VolumeDependencyTests-314886768 None] Acquiring lock "cinder-quobyte-55aa8292-7512-48e6-856a-19a5a2734cbf" by "delete_snapshot" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 20:03:14 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-dab197fc-2117-4260-86d1-29332d0bdb3b tempest-VolumeDependencyTests-314886768 None] Lock "cinder-quobyte-55aa8292-7512-48e6-856a-19a5a2734cbf" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 20:03:14 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-dab197fc-2117-4260-86d1-29332d0bdb3b tempest-VolumeDependencyTests-314886768 None] Acquiring lock "cinder-quobyte-3b3e2887-0ef3-4bc4-b92f-cafb3bb384a7" by "_delete_snapshot" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 20:03:14 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-dab197fc-2117-4260-86d1-29332d0bdb3b tempest-VolumeDependencyTests-314886768 None] Lock "cinder-quobyte-3b3e2887-0ef3-4bc4-b92f-cafb3bb384a7" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 20:03:14 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-dab197fc-2117-4260-86d1-29332d0bdb3b tempest-VolumeDependencyTests-314886768 None] Deleting offline snapshot 3b3e2887-0ef3-4bc4-b92f-cafb3bb384a7 of volume 55aa8292-7512-48e6-856a-19a5a2734cbf {{(pid=86639) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 02 20:03:14 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-dab197fc-2117-4260-86d1-29332d0bdb3b tempest-VolumeDependencyTests-314886768 None] snapshot_file for this snap is: volume-55aa8292-7512-48e6-856a-19a5a2734cbf.3b3e2887-0ef3-4bc4-b92f-cafb3bb384a7 {{(pid=86639) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 02 20:03:14 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3d13786-9df3-4255-a1d4-487f956e72ed]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 20:03:14 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-dab197fc-2117-4260-86d1-29332d0bdb3b tempest-VolumeDependencyTests-314886768 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-55aa8292-7512-48e6-856a-19a5a2734cbf.3b3e2887-0ef3-4bc4-b92f-cafb3bb384a7 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:03:14 devstack sudo[106261]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-55aa8292-7512-48e6-856a-19a5a2734cbf.3b3e2887-0ef3-4bc4-b92f-cafb3bb384a7
Jul 02 20:03:14 devstack sudo[106261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:03:15 devstack sudo[106261]: pam_unix(sudo:session): session closed for user root
Jul 02 20:03:15 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-dab197fc-2117-4260-86d1-29332d0bdb3b tempest-VolumeDependencyTests-314886768 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-55aa8292-7512-48e6-856a-19a5a2734cbf.3b3e2887-0ef3-4bc4-b92f-cafb3bb384a7" returned: 0 in 0.972s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:03:15 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-dab197fc-2117-4260-86d1-29332d0bdb3b tempest-VolumeDependencyTests-314886768 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-55aa8292-7512-48e6-856a-19a5a2734cbf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86639) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 02 20:03:15 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ae55be7-0bc6-47fe-ae84-8cf477d7bca2]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 20:03:15 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-dab197fc-2117-4260-86d1-29332d0bdb3b tempest-VolumeDependencyTests-314886768 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-55aa8292-7512-48e6-856a-19a5a2734cbf {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:03:15 devstack sudo[106266]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-55aa8292-7512-48e6-856a-19a5a2734cbf
Jul 02 20:03:15 devstack sudo[106266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:03:16 devstack sudo[106266]: pam_unix(sudo:session): session closed for user root
Jul 02 20:03:16 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-dab197fc-2117-4260-86d1-29332d0bdb3b tempest-VolumeDependencyTests-314886768 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-55aa8292-7512-48e6-856a-19a5a2734cbf" returned: 0 in 1.004s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:03:16 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-dab197fc-2117-4260-86d1-29332d0bdb3b tempest-VolumeDependencyTests-314886768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-55aa8292-7512-48e6-856a-19a5a2734cbf.3b3e2887-0ef3-4bc4-b92f-cafb3bb384a7 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:03:16 devstack sudo[106272]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-55aa8292-7512-48e6-856a-19a5a2734cbf.3b3e2887-0ef3-4bc4-b92f-cafb3bb384a7
Jul 02 20:03:16 devstack sudo[106272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:03:16 devstack cinder-volume[86639]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e055a3e-5b8a-4ca0-9c77-bfa625b75329 tempest-SnapshotDependencyTests-209878434 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 20:03:16 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-4e055a3e-5b8a-4ca0-9c77-bfa625b75329 tempest-SnapshotDependencyTests-209878434 None] Flow 'volume_create_manager' (e2951f50-349e-4441-bd60-2731718e2aec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 20:03:16 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-4e055a3e-5b8a-4ca0-9c77-bfa625b75329 tempest-SnapshotDependencyTests-209878434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eed636f5-967a-4a29-bb9a-02274267913b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:03:16 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-4e055a3e-5b8a-4ca0-9c77-bfa625b75329 tempest-SnapshotDependencyTests-209878434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eed636f5-967a-4a29-bb9a-02274267913b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T18:03:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1773588013',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee1e7c38-4615-4c8c-aa16-7b785fcec72e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d9d95c43ad04c94bc88ff66b0d423fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T18:03:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T18:03:16Z,use_quota=True,user_id='e03529e3708c4847b0fdf19c908a0e91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:03:16 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-4e055a3e-5b8a-4ca0-9c77-bfa625b75329 tempest-SnapshotDependencyTests-209878434 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4dc3ad21-7b65-4196-8241-6b4c0dc17659) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:03:16 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-4e055a3e-5b8a-4ca0-9c77-bfa625b75329 tempest-SnapshotDependencyTests-209878434 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4dc3ad21-7b65-4196-8241-6b4c0dc17659) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:03:16 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-4e055a3e-5b8a-4ca0-9c77-bfa625b75329 tempest-SnapshotDependencyTests-209878434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffa9505c-618d-4ce4-8597-02c03ea49581) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:03:16 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-4e055a3e-5b8a-4ca0-9c77-bfa625b75329 tempest-SnapshotDependencyTests-209878434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffa9505c-618d-4ce4-8597-02c03ea49581) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee1e7c38-4615-4c8c-aa16-7b785fcec72e', 'volume_name': 'volume-ee1e7c38-4615-4c8c-aa16-7b785fcec72e', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:03:16 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-4e055a3e-5b8a-4ca0-9c77-bfa625b75329 tempest-SnapshotDependencyTests-209878434 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (304c73e0-f7a5-42c2-9cf8-a3594c4c00cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:03:16 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-4e055a3e-5b8a-4ca0-9c77-bfa625b75329 tempest-SnapshotDependencyTests-209878434 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (304c73e0-f7a5-42c2-9cf8-a3594c4c00cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:03:16 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-4e055a3e-5b8a-4ca0-9c77-bfa625b75329 tempest-SnapshotDependencyTests-209878434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b343f3ea-0a0b-47ec-9526-9c2d39c8219c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:03:16 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-4e055a3e-5b8a-4ca0-9c77-bfa625b75329 tempest-SnapshotDependencyTests-209878434 None] Volume ee1e7c38-4615-4c8c-aa16-7b785fcec72e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee1e7c38-4615-4c8c-aa16-7b785fcec72e', 'volume_size': 1}
Jul 02 20:03:16 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-4e055a3e-5b8a-4ca0-9c77-bfa625b75329 tempest-SnapshotDependencyTests-209878434 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 20:03:16 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-4e055a3e-5b8a-4ca0-9c77-bfa625b75329 tempest-SnapshotDependencyTests-209878434 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 20:03:16 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-4e055a3e-5b8a-4ca0-9c77-bfa625b75329 tempest-SnapshotDependencyTests-209878434 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce906cb830>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T18:03:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1773588013',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee1e7c38-4615-4c8c-aa16-7b785fcec72e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d9d95c43ad04c94bc88ff66b0d423fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T18:03:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T18:03:16Z,use_quota=True,user_id='e03529e3708c4847b0fdf19c908a0e91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)}" {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 20:03:16 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-4e055a3e-5b8a-4ca0-9c77-bfa625b75329 tempest-SnapshotDependencyTests-209878434 None] Creating volume ee1e7c38-4615-4c8c-aa16-7b785fcec72e {{(pid=86639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 20:03:16 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-4e055a3e-5b8a-4ca0-9c77-bfa625b75329 tempest-SnapshotDependencyTests-209878434 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 20:03:16 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-4e055a3e-5b8a-4ca0-9c77-bfa625b75329 tempest-SnapshotDependencyTests-209878434 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 20:03:16 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-4e055a3e-5b8a-4ca0-9c77-bfa625b75329 tempest-SnapshotDependencyTests-209878434 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 20:03:16 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-4e055a3e-5b8a-4ca0-9c77-bfa625b75329 tempest-SnapshotDependencyTests-209878434 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 20:03:16 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-4e055a3e-5b8a-4ca0-9c77-bfa625b75329 tempest-SnapshotDependencyTests-209878434 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 20:03:16 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-4e055a3e-5b8a-4ca0-9c77-bfa625b75329 tempest-SnapshotDependencyTests-209878434 None] Selected osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92 as target Quobyte volume. {{(pid=86639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 20:03:16 devstack cinder-volume[86639]: INFO cinder.volume.drivers.remotefs [None req-4e055a3e-5b8a-4ca0-9c77-bfa625b75329 tempest-SnapshotDependencyTests-209878434 None] casted to osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92
Jul 02 20:03:16 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-4e055a3e-5b8a-4ca0-9c77-bfa625b75329 tempest-SnapshotDependencyTests-209878434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-ee1e7c38-4615-4c8c-aa16-7b785fcec72e 1073741824 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:03:16 devstack sudo[106274]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-ee1e7c38-4615-4c8c-aa16-7b785fcec72e 1073741824
Jul 02 20:03:16 devstack sudo[106274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:03:17 devstack sudo[106272]: pam_unix(sudo:session): session closed for user root
Jul 02 20:03:17 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-dab197fc-2117-4260-86d1-29332d0bdb3b tempest-VolumeDependencyTests-314886768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-55aa8292-7512-48e6-856a-19a5a2734cbf.3b3e2887-0ef3-4bc4-b92f-cafb3bb384a7" returned: 0 in 0.821s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:03:17 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-dab197fc-2117-4260-86d1-29332d0bdb3b tempest-VolumeDependencyTests-314886768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-55aa8292-7512-48e6-856a-19a5a2734cbf.3b3e2887-0ef3-4bc4-b92f-cafb3bb384a7 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:03:17 devstack sudo[106283]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-55aa8292-7512-48e6-856a-19a5a2734cbf.3b3e2887-0ef3-4bc4-b92f-cafb3bb384a7
Jul 02 20:03:17 devstack sudo[106283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:03:17 devstack sudo[106274]: pam_unix(sudo:session): session closed for user root
Jul 02 20:03:17 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-4e055a3e-5b8a-4ca0-9c77-bfa625b75329 tempest-SnapshotDependencyTests-209878434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-ee1e7c38-4615-4c8c-aa16-7b785fcec72e 1073741824" returned: 0 in 0.964s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:03:17 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-4e055a3e-5b8a-4ca0-9c77-bfa625b75329 tempest-SnapshotDependencyTests-209878434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-ee1e7c38-4615-4c8c-aa16-7b785fcec72e {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:03:17 devstack sudo[106286]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-ee1e7c38-4615-4c8c-aa16-7b785fcec72e
Jul 02 20:03:17 devstack sudo[106286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:03:18 devstack sudo[106283]: pam_unix(sudo:session): session closed for user root
Jul 02 20:03:18 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-dab197fc-2117-4260-86d1-29332d0bdb3b tempest-VolumeDependencyTests-314886768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-55aa8292-7512-48e6-856a-19a5a2734cbf.3b3e2887-0ef3-4bc4-b92f-cafb3bb384a7" returned: 0 in 0.851s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:03:18 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-dab197fc-2117-4260-86d1-29332d0bdb3b tempest-VolumeDependencyTests-314886768 None] Lock "cinder-quobyte-3b3e2887-0ef3-4bc4-b92f-cafb3bb384a7" released by "_delete_snapshot" :: held 3.815s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 20:03:18 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-dab197fc-2117-4260-86d1-29332d0bdb3b tempest-VolumeDependencyTests-314886768 None] Lock "cinder-quobyte-55aa8292-7512-48e6-856a-19a5a2734cbf" released by "delete_snapshot" :: held 3.846s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 20:03:18 devstack cinder-volume[86639]: DEBUG cinder.quota [None req-dab197fc-2117-4260-86d1-29332d0bdb3b tempest-VolumeDependencyTests-314886768 None] Created reservations ['64dde368-5bfa-4b54-9027-23ad76f186c1', '61e84947-fd1f-4f40-bdab-c44500cc066e', 'e3b6307e-3cf9-43f7-9ad3-7252b3463655', '42c82a08-e368-4320-a47f-d42d2850adf4'] {{(pid=86639) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 20:03:18 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-dab197fc-2117-4260-86d1-29332d0bdb3b tempest-VolumeDependencyTests-314886768 None] Delete snapshot completed successfully.
Jul 02 20:03:18 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-dab197fc-2117-4260-86d1-29332d0bdb3b tempest-VolumeDependencyTests-314886768 None] Lock "cinder-3b3e2887-0ef3-4bc4-b92f-cafb3bb384a7-delete_snapshot" released by "delete_snapshot" :: held 3.991s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 20:03:18 devstack sudo[106286]: pam_unix(sudo:session): session closed for user root
Jul 02 20:03:18 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-4e055a3e-5b8a-4ca0-9c77-bfa625b75329 tempest-SnapshotDependencyTests-209878434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-ee1e7c38-4615-4c8c-aa16-7b785fcec72e" returned: 0 in 0.831s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:03:18 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-4e055a3e-5b8a-4ca0-9c77-bfa625b75329 tempest-SnapshotDependencyTests-209878434 None] <== create_volume: return (1850ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'} {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 20:03:18 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-4e055a3e-5b8a-4ca0-9c77-bfa625b75329 tempest-SnapshotDependencyTests-209878434 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.852s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 20:03:18 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-4e055a3e-5b8a-4ca0-9c77-bfa625b75329 tempest-SnapshotDependencyTests-209878434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b343f3ea-0a0b-47ec-9526-9c2d39c8219c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee1e7c38-4615-4c8c-aa16-7b785fcec72e', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:03:18 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-4e055a3e-5b8a-4ca0-9c77-bfa625b75329 tempest-SnapshotDependencyTests-209878434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2a7ac63-8253-4e96-b97e-4ffdcb8e098e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:03:18 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-4e055a3e-5b8a-4ca0-9c77-bfa625b75329 tempest-SnapshotDependencyTests-209878434 None] Volume volume-ee1e7c38-4615-4c8c-aa16-7b785fcec72e (ee1e7c38-4615-4c8c-aa16-7b785fcec72e): created successfully
Jul 02 20:03:18 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-4e055a3e-5b8a-4ca0-9c77-bfa625b75329 tempest-SnapshotDependencyTests-209878434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2a7ac63-8253-4e96-b97e-4ffdcb8e098e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:03:18 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-4e055a3e-5b8a-4ca0-9c77-bfa625b75329 tempest-SnapshotDependencyTests-209878434 None] Flow 'volume_create_manager' (e2951f50-349e-4441-bd60-2731718e2aec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 20:03:18 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-4e055a3e-5b8a-4ca0-9c77-bfa625b75329 tempest-SnapshotDependencyTests-209878434 None] Created volume successfully.
Jul 02 20:03:18 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-c5d1f3c8-c659-4282-a048-1771934c789b tempest-VolumeDependencyTests-314886768 None] Acquiring lock "cinder-55aa8292-7512-48e6-856a-19a5a2734cbf-delete_volume" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 20:03:18 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-c5d1f3c8-c659-4282-a048-1771934c789b tempest-VolumeDependencyTests-314886768 None] Lock "cinder-55aa8292-7512-48e6-856a-19a5a2734cbf-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 20:03:18 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-c5d1f3c8-c659-4282-a048-1771934c789b tempest-VolumeDependencyTests-314886768 None] Acquiring lock "cinder-quobyte-55aa8292-7512-48e6-856a-19a5a2734cbf" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 20:03:18 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-c5d1f3c8-c659-4282-a048-1771934c789b tempest-VolumeDependencyTests-314886768 None] Lock "cinder-quobyte-55aa8292-7512-48e6-856a-19a5a2734cbf" acquired by "delete_volume" :: waited 0.015s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 20:03:18 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[7106f145-205a-4404-8f85-0ce5c71b72f1]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 20:03:18 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-c5d1f3c8-c659-4282-a048-1771934c789b tempest-VolumeDependencyTests-314886768 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-55aa8292-7512-48e6-856a-19a5a2734cbf {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:03:18 devstack sudo[106290]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-55aa8292-7512-48e6-856a-19a5a2734cbf
Jul 02 20:03:18 devstack sudo[106290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:03:19 devstack sudo[106290]: pam_unix(sudo:session): session closed for user root
Jul 02 20:03:19 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-c5d1f3c8-c659-4282-a048-1771934c789b tempest-VolumeDependencyTests-314886768 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-55aa8292-7512-48e6-856a-19a5a2734cbf" returned: 0 in 0.808s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:03:19 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-c5d1f3c8-c659-4282-a048-1771934c789b tempest-VolumeDependencyTests-314886768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-55aa8292-7512-48e6-856a-19a5a2734cbf {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:03:19 devstack sudo[106296]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-55aa8292-7512-48e6-856a-19a5a2734cbf
Jul 02 20:03:19 devstack sudo[106296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:03:19 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-9ce448b6-b611-4ca6-a835-289add68214a tempest-SnapshotDependencyTests-209878434 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 20:03:19 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-9ce448b6-b611-4ca6-a835-289add68214a tempest-SnapshotDependencyTests-209878434 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 20:03:19 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-9ce448b6-b611-4ca6-a835-289add68214a tempest-SnapshotDependencyTests-209878434 None] Creating offline snapshot 45c4b501-e62b-455a-b60f-9f3b6657e0c8 of volume ee1e7c38-4615-4c8c-aa16-7b785fcec72e {{(pid=86639) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 02 20:03:19 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[46ff6768-f720-4d9a-8278-80dedee7be09]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 20:03:19 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-9ce448b6-b611-4ca6-a835-289add68214a tempest-SnapshotDependencyTests-209878434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-ee1e7c38-4615-4c8c-aa16-7b785fcec72e {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:03:20 devstack sudo[106298]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-ee1e7c38-4615-4c8c-aa16-7b785fcec72e
Jul 02 20:03:20 devstack sudo[106298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:03:20 devstack sudo[106296]: pam_unix(sudo:session): session closed for user root
Jul 02 20:03:20 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-c5d1f3c8-c659-4282-a048-1771934c789b tempest-VolumeDependencyTests-314886768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-55aa8292-7512-48e6-856a-19a5a2734cbf" returned: 0 in 0.799s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:03:20 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-c5d1f3c8-c659-4282-a048-1771934c789b tempest-VolumeDependencyTests-314886768 None] Lock "cinder-quobyte-55aa8292-7512-48e6-856a-19a5a2734cbf" released by "delete_volume" :: held 1.682s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 20:03:20 devstack cinder-volume[86639]: DEBUG cinder.quota [None req-c5d1f3c8-c659-4282-a048-1771934c789b tempest-VolumeDependencyTests-314886768 None] Created reservations ['8e1cb1fd-1427-4e22-808f-c8cdac3349c6', '5281023c-7571-480b-b66e-828fd4f08e59', '9d6f7a14-91d7-4ce8-87f7-7acec10a26b1', '59d2f0a2-840a-476c-b263-78f087b72e76'] {{(pid=86639) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 20:03:20 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-c5d1f3c8-c659-4282-a048-1771934c789b tempest-VolumeDependencyTests-314886768 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 20:03:20 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-c5d1f3c8-c659-4282-a048-1771934c789b tempest-VolumeDependencyTests-314886768 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 20:03:20 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-c5d1f3c8-c659-4282-a048-1771934c789b tempest-VolumeDependencyTests-314886768 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 20:03:20 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-c5d1f3c8-c659-4282-a048-1771934c789b tempest-VolumeDependencyTests-314886768 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 20:03:20 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-c5d1f3c8-c659-4282-a048-1771934c789b tempest-VolumeDependencyTests-314886768 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 20:03:20 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-c5d1f3c8-c659-4282-a048-1771934c789b tempest-VolumeDependencyTests-314886768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:03:20 devstack sudo[106302]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e
Jul 02 20:03:20 devstack sudo[106302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:03:20 devstack sudo[106298]: pam_unix(sudo:session): session closed for user root
Jul 02 20:03:20 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-9ce448b6-b611-4ca6-a835-289add68214a tempest-SnapshotDependencyTests-209878434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-ee1e7c38-4615-4c8c-aa16-7b785fcec72e" returned: 0 in 1.011s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:03:20 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-9ce448b6-b611-4ca6-a835-289add68214a tempest-SnapshotDependencyTests-209878434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-ee1e7c38-4615-4c8c-aa16-7b785fcec72e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-ee1e7c38-4615-4c8c-aa16-7b785fcec72e.45c4b501-e62b-455a-b60f-9f3b6657e0c8 1G {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:03:20 devstack sudo[106307]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-ee1e7c38-4615-4c8c-aa16-7b785fcec72e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-ee1e7c38-4615-4c8c-aa16-7b785fcec72e.45c4b501-e62b-455a-b60f-9f3b6657e0c8 1G
Jul 02 20:03:20 devstack sudo[106307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:03:21 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-f7073bbf-8f91-4ad7-b621-7caafb523b8f tempest-VolumeDependencyTests-314886768 None] Acquiring lock "cinder-d0c1ba77-e9be-4918-ac3a-f5b7844a4c2c-delete_volume" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 20:03:21 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-f7073bbf-8f91-4ad7-b621-7caafb523b8f tempest-VolumeDependencyTests-314886768 None] Lock "cinder-d0c1ba77-e9be-4918-ac3a-f5b7844a4c2c-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 20:03:21 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-f7073bbf-8f91-4ad7-b621-7caafb523b8f tempest-VolumeDependencyTests-314886768 None] Acquiring lock "cinder-quobyte-d0c1ba77-e9be-4918-ac3a-f5b7844a4c2c" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 20:03:21 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-f7073bbf-8f91-4ad7-b621-7caafb523b8f tempest-VolumeDependencyTests-314886768 None] Lock "cinder-quobyte-d0c1ba77-e9be-4918-ac3a-f5b7844a4c2c" acquired by "delete_volume" :: waited 0.019s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 20:03:21 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[e34e3cdf-6eec-4446-94e1-6c347b4aec49]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 20:03:21 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-f7073bbf-8f91-4ad7-b621-7caafb523b8f tempest-VolumeDependencyTests-314886768 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-d0c1ba77-e9be-4918-ac3a-f5b7844a4c2c {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:03:21 devstack sudo[106302]: pam_unix(sudo:session): session closed for user root
Jul 02 20:03:21 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-c5d1f3c8-c659-4282-a048-1771934c789b tempest-VolumeDependencyTests-314886768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e" returned: 0 in 0.831s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:03:21 devstack cinder-volume[86639]: DEBUG cinder.manager [None req-c5d1f3c8-c659-4282-a048-1771934c789b tempest-VolumeDependencyTests-314886768 None] Notifying Schedulers of capabilities ... {{(pid=86639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 20:03:21 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-c5d1f3c8-c659-4282-a048-1771934c789b tempest-VolumeDependencyTests-314886768 None] Deleted volume successfully.
Jul 02 20:03:21 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-c5d1f3c8-c659-4282-a048-1771934c789b tempest-VolumeDependencyTests-314886768 None] Lock "cinder-55aa8292-7512-48e6-856a-19a5a2734cbf-delete_volume" released by "delete_volume" :: held 2.832s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 20:03:21 devstack sudo[106310]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-d0c1ba77-e9be-4918-ac3a-f5b7844a4c2c
Jul 02 20:03:21 devstack sudo[106310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:03:22 devstack sudo[106307]: pam_unix(sudo:session): session closed for user root
Jul 02 20:03:22 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-9ce448b6-b611-4ca6-a835-289add68214a tempest-SnapshotDependencyTests-209878434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-ee1e7c38-4615-4c8c-aa16-7b785fcec72e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-ee1e7c38-4615-4c8c-aa16-7b785fcec72e.45c4b501-e62b-455a-b60f-9f3b6657e0c8 1G" returned: 0 in 1.071s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:03:22 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-9ce448b6-b611-4ca6-a835-289add68214a tempest-SnapshotDependencyTests-209878434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ee1e7c38-4615-4c8c-aa16-7b785fcec72e -F qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-ee1e7c38-4615-4c8c-aa16-7b785fcec72e.45c4b501-e62b-455a-b60f-9f3b6657e0c8 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:03:22 devstack sudo[106316]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ee1e7c38-4615-4c8c-aa16-7b785fcec72e -F qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-ee1e7c38-4615-4c8c-aa16-7b785fcec72e.45c4b501-e62b-455a-b60f-9f3b6657e0c8
Jul 02 20:03:22 devstack sudo[106316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:03:22 devstack sudo[106310]: pam_unix(sudo:session): session closed for user root
Jul 02 20:03:22 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-f7073bbf-8f91-4ad7-b621-7caafb523b8f tempest-VolumeDependencyTests-314886768 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-d0c1ba77-e9be-4918-ac3a-f5b7844a4c2c" returned: 0 in 0.980s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:03:22 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-f7073bbf-8f91-4ad7-b621-7caafb523b8f tempest-VolumeDependencyTests-314886768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-d0c1ba77-e9be-4918-ac3a-f5b7844a4c2c {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:03:22 devstack sudo[106322]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-d0c1ba77-e9be-4918-ac3a-f5b7844a4c2c
Jul 02 20:03:22 devstack sudo[106322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:03:22 devstack sudo[106316]: pam_unix(sudo:session): session closed for user root
Jul 02 20:03:22 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-9ce448b6-b611-4ca6-a835-289add68214a tempest-SnapshotDependencyTests-209878434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ee1e7c38-4615-4c8c-aa16-7b785fcec72e -F qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-ee1e7c38-4615-4c8c-aa16-7b785fcec72e.45c4b501-e62b-455a-b60f-9f3b6657e0c8" returned: 0 in 0.912s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:03:22 devstack cinder-volume[86639]: WARNING cinder.volume.drivers.remotefs [None req-9ce448b6-b611-4ca6-a835-289add68214a tempest-SnapshotDependencyTests-209878434 None] /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-ee1e7c38-4615-4c8c-aa16-7b785fcec72e.45c4b501-e62b-455a-b60f-9f3b6657e0c8 is being set with open permissions: ugo+rw
Jul 02 20:03:22 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-9ce448b6-b611-4ca6-a835-289add68214a tempest-SnapshotDependencyTests-209878434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-ee1e7c38-4615-4c8c-aa16-7b785fcec72e.45c4b501-e62b-455a-b60f-9f3b6657e0c8 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:03:22 devstack sudo[106328]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-ee1e7c38-4615-4c8c-aa16-7b785fcec72e.45c4b501-e62b-455a-b60f-9f3b6657e0c8
Jul 02 20:03:22 devstack sudo[106328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:03:23 devstack sudo[106322]: pam_unix(sudo:session): session closed for user root
Jul 02 20:03:23 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-f7073bbf-8f91-4ad7-b621-7caafb523b8f tempest-VolumeDependencyTests-314886768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-d0c1ba77-e9be-4918-ac3a-f5b7844a4c2c" returned: 0 in 0.843s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:03:23 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-f7073bbf-8f91-4ad7-b621-7caafb523b8f tempest-VolumeDependencyTests-314886768 None] Lock "cinder-quobyte-d0c1ba77-e9be-4918-ac3a-f5b7844a4c2c" released by "delete_volume" :: held 1.871s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 20:03:23 devstack cinder-volume[86639]: DEBUG cinder.quota [None req-f7073bbf-8f91-4ad7-b621-7caafb523b8f tempest-VolumeDependencyTests-314886768 None] Created reservations ['898399e4-4d8e-4ce4-a4a4-1581bd87205a', 'f63f5c78-a2d8-4ec2-b084-1eb0429a1a48', 'e3301b84-6684-49c5-9621-b4ab0dc76172', 'e6fd61a7-3b31-428e-81d1-42d251838dd9'] {{(pid=86639) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 20:03:23 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-f7073bbf-8f91-4ad7-b621-7caafb523b8f tempest-VolumeDependencyTests-314886768 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 20:03:23 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-f7073bbf-8f91-4ad7-b621-7caafb523b8f tempest-VolumeDependencyTests-314886768 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 20:03:23 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-f7073bbf-8f91-4ad7-b621-7caafb523b8f tempest-VolumeDependencyTests-314886768 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 20:03:23 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-f7073bbf-8f91-4ad7-b621-7caafb523b8f tempest-VolumeDependencyTests-314886768 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 20:03:23 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-f7073bbf-8f91-4ad7-b621-7caafb523b8f tempest-VolumeDependencyTests-314886768 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 20:03:23 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-f7073bbf-8f91-4ad7-b621-7caafb523b8f tempest-VolumeDependencyTests-314886768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:03:23 devstack sudo[106331]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e
Jul 02 20:03:23 devstack sudo[106331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:03:23 devstack sudo[106328]: pam_unix(sudo:session): session closed for user root
Jul 02 20:03:23 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-9ce448b6-b611-4ca6-a835-289add68214a tempest-SnapshotDependencyTests-209878434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-ee1e7c38-4615-4c8c-aa16-7b785fcec72e.45c4b501-e62b-455a-b60f-9f3b6657e0c8" returned: 0 in 0.853s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:03:23 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-9ce448b6-b611-4ca6-a835-289add68214a tempest-SnapshotDependencyTests-209878434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-ee1e7c38-4615-4c8c-aa16-7b785fcec72e.info {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:03:23 devstack sudo[106335]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-ee1e7c38-4615-4c8c-aa16-7b785fcec72e.info
Jul 02 20:03:23 devstack sudo[106335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:03:24 devstack sudo[106331]: pam_unix(sudo:session): session closed for user root
Jul 02 20:03:24 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-f7073bbf-8f91-4ad7-b621-7caafb523b8f tempest-VolumeDependencyTests-314886768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e" returned: 0 in 0.880s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:03:24 devstack cinder-volume[86639]: DEBUG cinder.manager [None req-f7073bbf-8f91-4ad7-b621-7caafb523b8f tempest-VolumeDependencyTests-314886768 None] Notifying Schedulers of capabilities ... {{(pid=86639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 20:03:24 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-f7073bbf-8f91-4ad7-b621-7caafb523b8f tempest-VolumeDependencyTests-314886768 None] Deleted volume successfully.
Jul 02 20:03:24 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-f7073bbf-8f91-4ad7-b621-7caafb523b8f tempest-VolumeDependencyTests-314886768 None] Lock "cinder-d0c1ba77-e9be-4918-ac3a-f5b7844a4c2c-delete_volume" released by "delete_volume" :: held 3.050s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 20:03:24 devstack sudo[106335]: pam_unix(sudo:session): session closed for user root
Jul 02 20:03:24 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-9ce448b6-b611-4ca6-a835-289add68214a tempest-SnapshotDependencyTests-209878434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-ee1e7c38-4615-4c8c-aa16-7b785fcec72e.info" returned: 0 in 0.789s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:03:24 devstack cinder-volume[86639]: WARNING cinder.volume.drivers.remotefs [None req-9ce448b6-b611-4ca6-a835-289add68214a tempest-SnapshotDependencyTests-209878434 None] /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-ee1e7c38-4615-4c8c-aa16-7b785fcec72e.info is being set with open permissions: ugo+rw
Jul 02 20:03:24 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-9ce448b6-b611-4ca6-a835-289add68214a tempest-SnapshotDependencyTests-209878434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-ee1e7c38-4615-4c8c-aa16-7b785fcec72e.info {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:03:24 devstack sudo[106340]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-ee1e7c38-4615-4c8c-aa16-7b785fcec72e.info
Jul 02 20:03:24 devstack sudo[106340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:03:25 devstack sudo[106340]: pam_unix(sudo:session): session closed for user root
Jul 02 20:03:25 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-9ce448b6-b611-4ca6-a835-289add68214a tempest-SnapshotDependencyTests-209878434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-ee1e7c38-4615-4c8c-aa16-7b785fcec72e.info" returned: 0 in 0.784s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:03:25 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-9ce448b6-b611-4ca6-a835-289add68214a tempest-SnapshotDependencyTests-209878434 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.557s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 20:03:25 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-9ce448b6-b611-4ca6-a835-289add68214a tempest-SnapshotDependencyTests-209878434 None] Create snapshot completed successfully
Jul 02 20:03:26 devstack cinder-volume[86639]: DEBUG cinder.volume.flows.manager.create_volume [None req-54b756df-c8af-4df7-9414-b09c7281fc6c tempest-SnapshotDependencyTests-209878434 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 20:03:26 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-54b756df-c8af-4df7-9414-b09c7281fc6c tempest-SnapshotDependencyTests-209878434 None] Flow 'volume_create_manager' (1033519a-6074-4d6f-ac30-42415d628e4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 20:03:26 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-54b756df-c8af-4df7-9414-b09c7281fc6c tempest-SnapshotDependencyTests-209878434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bccab7c3-33c6-4ea0-b0f0-10696e1cff0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:03:26 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-54b756df-c8af-4df7-9414-b09c7281fc6c tempest-SnapshotDependencyTests-209878434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bccab7c3-33c6-4ea0-b0f0-10696e1cff0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T18:03:26Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a6df9cb-6c17-4bdf-8f09-f39b9153ecce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d9d95c43ad04c94bc88ff66b0d423fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T18:03:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=45c4b501-e62b-455a-b60f-9f3b6657e0c8,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T18:03:27Z,use_quota=True,user_id='e03529e3708c4847b0fdf19c908a0e91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:03:26 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-54b756df-c8af-4df7-9414-b09c7281fc6c tempest-SnapshotDependencyTests-209878434 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a24a678-196f-4d61-ad26-99c0cf8cf5ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:03:26 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-54b756df-c8af-4df7-9414-b09c7281fc6c tempest-SnapshotDependencyTests-209878434 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a24a678-196f-4d61-ad26-99c0cf8cf5ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:03:26 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-54b756df-c8af-4df7-9414-b09c7281fc6c tempest-SnapshotDependencyTests-209878434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2eb59b67-4f5e-44d4-9bc2-d08f7505abf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:03:26 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-54b756df-c8af-4df7-9414-b09c7281fc6c tempest-SnapshotDependencyTests-209878434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2eb59b67-4f5e-44d4-9bc2-d08f7505abf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '7a6df9cb-6c17-4bdf-8f09-f39b9153ecce', 'volume_name': 'volume-7a6df9cb-6c17-4bdf-8f09-f39b9153ecce', 'volume_size': 1, 'snapshot_id': '45c4b501-e62b-455a-b60f-9f3b6657e0c8'}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:03:26 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-54b756df-c8af-4df7-9414-b09c7281fc6c tempest-SnapshotDependencyTests-209878434 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0951e26d-3866-48c7-ac09-1d3630bb76f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:03:26 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-54b756df-c8af-4df7-9414-b09c7281fc6c tempest-SnapshotDependencyTests-209878434 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0951e26d-3866-48c7-ac09-1d3630bb76f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:03:26 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-54b756df-c8af-4df7-9414-b09c7281fc6c tempest-SnapshotDependencyTests-209878434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5c4da55-5503-4baa-978a-8a9c4124ebfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:03:26 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-54b756df-c8af-4df7-9414-b09c7281fc6c tempest-SnapshotDependencyTests-209878434 None] Volume 7a6df9cb-6c17-4bdf-8f09-f39b9153ecce: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-7a6df9cb-6c17-4bdf-8f09-f39b9153ecce', 'volume_size': 1, 'snapshot_id': '45c4b501-e62b-455a-b60f-9f3b6657e0c8'}
Jul 02 20:03:26 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-54b756df-c8af-4df7-9414-b09c7281fc6c tempest-SnapshotDependencyTests-209878434 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 20:03:26 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-54b756df-c8af-4df7-9414-b09c7281fc6c tempest-SnapshotDependencyTests-209878434 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 20:03:26 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-54b756df-c8af-4df7-9414-b09c7281fc6c tempest-SnapshotDependencyTests-209878434 None] Acquiring lock "cinder-quobyte-45c4b501-e62b-455a-b60f-9f3b6657e0c8-7a6df9cb-6c17-4bdf-8f09-f39b9153ecce" by "_create_volume_from_snapshot" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 20:03:26 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-54b756df-c8af-4df7-9414-b09c7281fc6c tempest-SnapshotDependencyTests-209878434 None] Lock "cinder-quobyte-45c4b501-e62b-455a-b60f-9f3b6657e0c8-7a6df9cb-6c17-4bdf-8f09-f39b9153ecce" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 20:03:26 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-54b756df-c8af-4df7-9414-b09c7281fc6c tempest-SnapshotDependencyTests-209878434 None] Creating volume 7a6df9cb-6c17-4bdf-8f09-f39b9153ecce from snapshot 45c4b501-e62b-455a-b60f-9f3b6657e0c8 {{(pid=86639) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jul 02 20:03:26 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-54b756df-c8af-4df7-9414-b09c7281fc6c tempest-SnapshotDependencyTests-209878434 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 20:03:26 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-54b756df-c8af-4df7-9414-b09c7281fc6c tempest-SnapshotDependencyTests-209878434 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 20:03:26 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-54b756df-c8af-4df7-9414-b09c7281fc6c tempest-SnapshotDependencyTests-209878434 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 20:03:26 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-54b756df-c8af-4df7-9414-b09c7281fc6c tempest-SnapshotDependencyTests-209878434 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 20:03:26 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-54b756df-c8af-4df7-9414-b09c7281fc6c tempest-SnapshotDependencyTests-209878434 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 20:03:26 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-54b756df-c8af-4df7-9414-b09c7281fc6c tempest-SnapshotDependencyTests-209878434 None] Selected osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92 as target Quobyte volume. {{(pid=86639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 20:03:26 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-54b756df-c8af-4df7-9414-b09c7281fc6c tempest-SnapshotDependencyTests-209878434 None] Acquiring lock "cinder-quobyte-7a6df9cb-6c17-4bdf-8f09-f39b9153ecce" by "_copy_volume_from_snapshot" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 20:03:26 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-54b756df-c8af-4df7-9414-b09c7281fc6c tempest-SnapshotDependencyTests-209878434 None] Lock "cinder-quobyte-7a6df9cb-6c17-4bdf-8f09-f39b9153ecce" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 20:03:26 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-54b756df-c8af-4df7-9414-b09c7281fc6c tempest-SnapshotDependencyTests-209878434 None] snapshot: 45c4b501-e62b-455a-b60f-9f3b6657e0c8, volume: 7a6df9cb-6c17-4bdf-8f09-f39b9153ecce,  {{(pid=86639) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jul 02 20:03:27 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-54b756df-c8af-4df7-9414-b09c7281fc6c tempest-SnapshotDependencyTests-209878434 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 20:03:27 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-54b756df-c8af-4df7-9414-b09c7281fc6c tempest-SnapshotDependencyTests-209878434 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 20:03:27 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-54b756df-c8af-4df7-9414-b09c7281fc6c tempest-SnapshotDependencyTests-209878434 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 20:03:27 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-54b756df-c8af-4df7-9414-b09c7281fc6c tempest-SnapshotDependencyTests-209878434 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 20:03:27 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-54b756df-c8af-4df7-9414-b09c7281fc6c tempest-SnapshotDependencyTests-209878434 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 20:03:27 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[70c051c5-882b-45bc-b593-e11523c03044]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 20:03:27 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-54b756df-c8af-4df7-9414-b09c7281fc6c tempest-SnapshotDependencyTests-209878434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-ee1e7c38-4615-4c8c-aa16-7b785fcec72e.45c4b501-e62b-455a-b60f-9f3b6657e0c8 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:03:27 devstack sudo[106343]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-ee1e7c38-4615-4c8c-aa16-7b785fcec72e.45c4b501-e62b-455a-b60f-9f3b6657e0c8
Jul 02 20:03:27 devstack sudo[106343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:03:27 devstack sudo[106343]: pam_unix(sudo:session): session closed for user root
Jul 02 20:03:27 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-54b756df-c8af-4df7-9414-b09c7281fc6c tempest-SnapshotDependencyTests-209878434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-ee1e7c38-4615-4c8c-aa16-7b785fcec72e.45c4b501-e62b-455a-b60f-9f3b6657e0c8" returned: 0 in 0.804s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:03:27 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-54b756df-c8af-4df7-9414-b09c7281fc6c tempest-SnapshotDependencyTests-209878434 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ee1e7c38-4615-4c8c-aa16-7b785fcec72e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86639) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 02 20:03:27 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-54b756df-c8af-4df7-9414-b09c7281fc6c tempest-SnapshotDependencyTests-209878434 None] will copy from snapshot at /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-ee1e7c38-4615-4c8c-aa16-7b785fcec72e {{(pid=86639) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jul 02 20:03:27 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-54b756df-c8af-4df7-9414-b09c7281fc6c tempest-SnapshotDependencyTests-209878434 None] Creating direct copy from snapshot {{(pid=86639) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jul 02 20:03:27 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[efc3c956-3c94-4113-bb43-3e46b0ac90f4]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 20:03:27 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-54b756df-c8af-4df7-9414-b09c7281fc6c tempest-SnapshotDependencyTests-209878434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-ee1e7c38-4615-4c8c-aa16-7b785fcec72e {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:03:27 devstack sudo[106348]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-ee1e7c38-4615-4c8c-aa16-7b785fcec72e
Jul 02 20:03:27 devstack sudo[106348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:03:28 devstack sudo[106348]: pam_unix(sudo:session): session closed for user root
Jul 02 20:03:28 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-54b756df-c8af-4df7-9414-b09c7281fc6c tempest-SnapshotDependencyTests-209878434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-ee1e7c38-4615-4c8c-aa16-7b785fcec72e" returned: 0 in 0.776s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:03:28 devstack cinder-volume[86639]: DEBUG cinder.utils [None req-54b756df-c8af-4df7-9414-b09c7281fc6c tempest-SnapshotDependencyTests-209878434 None] Path /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-7a6df9cb-6c17-4bdf-8f09-f39b9153ecce not found in is_blk_device check {{(pid=86639) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 02 20:03:28 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-54b756df-c8af-4df7-9414-b09c7281fc6c tempest-SnapshotDependencyTests-209878434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-ee1e7c38-4615-4c8c-aa16-7b785fcec72e /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-7a6df9cb-6c17-4bdf-8f09-f39b9153ecce {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:03:28 devstack sudo[106353]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-ee1e7c38-4615-4c8c-aa16-7b785fcec72e /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-7a6df9cb-6c17-4bdf-8f09-f39b9153ecce
Jul 02 20:03:28 devstack sudo[106353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:03:32 devstack cinder-volume[86639]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5d6af0d-5078-45d0-b4c5-e08648c695e7 tempest-VolumeAndVolumeTypeFromImageTest-1200324854 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 20:03:32 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-e5d6af0d-5078-45d0-b4c5-e08648c695e7 tempest-VolumeAndVolumeTypeFromImageTest-1200324854 None] Flow 'volume_create_manager' (ed7520de-4de6-4c00-ab15-de6d97599806) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 20:03:32 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-e5d6af0d-5078-45d0-b4c5-e08648c695e7 tempest-VolumeAndVolumeTypeFromImageTest-1200324854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41427986-8f46-4fb4-a2a2-8e7962add074) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:03:32 devstack cinder-volume[86639]: DEBUG dbcounter [-] [86639] Writing DB stats cinder:SELECT=64,cinder:INSERT=19,cinder:UPDATE=80,cinder:DELETE=9 {{(pid=86639) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 02 20:03:32 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-e5d6af0d-5078-45d0-b4c5-e08648c695e7 tempest-VolumeAndVolumeTypeFromImageTest-1200324854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41427986-8f46-4fb4-a2a2-8e7962add074) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T18:03:32Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc64202d-9f21-4613-9b5d-aae0c40fcb57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d59ee505a3242d691ff38cb95823857',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T18:03:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T18:03:33Z,use_quota=True,user_id='b1f9940dfd8b4d76b95fbb72f910a256',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a35dc6e7-1ac5-4014-9043-4cf6c6342739),volume_type_id=a35dc6e7-1ac5-4014-9043-4cf6c6342739)' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:03:32 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-e5d6af0d-5078-45d0-b4c5-e08648c695e7 tempest-VolumeAndVolumeTypeFromImageTest-1200324854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1898a741-5575-4545-ac99-8f0a0e170052) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:03:32 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-e5d6af0d-5078-45d0-b4c5-e08648c695e7 tempest-VolumeAndVolumeTypeFromImageTest-1200324854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1898a741-5575-4545-ac99-8f0a0e170052) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:03:33 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-e5d6af0d-5078-45d0-b4c5-e08648c695e7 tempest-VolumeAndVolumeTypeFromImageTest-1200324854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f34dd684-57c4-4fc6-b09d-88de7982962c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:03:33 devstack cinder-volume[86639]: DEBUG cinder.image.glance [None req-e5d6af0d-5078-45d0-b4c5-e08648c695e7 tempest-VolumeAndVolumeTypeFromImageTest-1200324854 None] Creating Keystone auth plugin from conf {{(pid=86639) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jul 02 20:03:33 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-e5d6af0d-5078-45d0-b4c5-e08648c695e7 tempest-VolumeAndVolumeTypeFromImageTest-1200324854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f34dd684-57c4-4fc6-b09d-88de7982962c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'dc64202d-9f21-4613-9b5d-aae0c40fcb57', 'volume_name': 'volume-dc64202d-9f21-4613-9b5d-aae0c40fcb57', 'volume_size': 1, 'image_id': '989ff212-215f-4e66-b090-cede39376b77', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/989ff212-215f-4e66-b090-cede39376b77', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '40392eff1a752043ec7ce5ca05f711c7', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '9d59ee505a3242d691ff38cb95823857', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '23ffa73ab3ff3170e0c2c8daa830570b4e6a1a2d01f94c24e7f67ec127de0f36ff1c2e2f6b62d3278d8902adc70f86d0ba0abfdcf2b32576cd1231134832bcfd', 'id': '989ff212-215f-4e66-b090-cede39376b77', 'created_at': datetime.datetime(2026, 7, 2, 18, 3, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 2, 18, 3, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/989ff212-215f-4e66-b090-cede39376b77/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fce84c4a360>}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:03:33 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-e5d6af0d-5078-45d0-b4c5-e08648c695e7 tempest-VolumeAndVolumeTypeFromImageTest-1200324854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f15c378a-427e-4630-b538-a033696b5139) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:03:33 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-e5d6af0d-5078-45d0-b4c5-e08648c695e7 tempest-VolumeAndVolumeTypeFromImageTest-1200324854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f15c378a-427e-4630-b538-a033696b5139) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:03:33 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-e5d6af0d-5078-45d0-b4c5-e08648c695e7 tempest-VolumeAndVolumeTypeFromImageTest-1200324854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a39ff26-e0ed-4f79-90d9-8a4013690813) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:03:33 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-e5d6af0d-5078-45d0-b4c5-e08648c695e7 tempest-VolumeAndVolumeTypeFromImageTest-1200324854 None] Volume dc64202d-9f21-4613-9b5d-aae0c40fcb57: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-dc64202d-9f21-4613-9b5d-aae0c40fcb57', 'volume_size': 1, 'image_id': '989ff212-215f-4e66-b090-cede39376b77', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/989ff212-215f-4e66-b090-cede39376b77', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '40392eff1a752043ec7ce5ca05f711c7', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '9d59ee505a3242d691ff38cb95823857', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '23ffa73ab3ff3170e0c2c8daa830570b4e6a1a2d01f94c24e7f67ec127de0f36ff1c2e2f6b62d3278d8902adc70f86d0ba0abfdcf2b32576cd1231134832bcfd', 'id': '989ff212-215f-4e66-b090-cede39376b77', 'created_at': datetime.datetime(2026, 7, 2, 18, 3, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 2, 18, 3, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/989ff212-215f-4e66-b090-cede39376b77/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fce84c4a360>}
Jul 02 20:03:33 devstack cinder-volume[86639]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5d6af0d-5078-45d0-b4c5-e08648c695e7 tempest-VolumeAndVolumeTypeFromImageTest-1200324854 None] Trying to clone dc64202d-9f21-4613-9b5d-aae0c40fcb57 from image 989ff212-215f-4e66-b090-cede39376b77 at location (None, [{'url': 'file:///opt/stack/data/glance/images/989ff212-215f-4e66-b090-cede39376b77', 'metadata': {}}]). {{(pid=86639) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jul 02 20:03:33 devstack cinder-volume[86639]: DEBUG cinder.image.image_utils [None req-e5d6af0d-5078-45d0-b4c5-e08648c695e7 tempest-VolumeAndVolumeTypeFromImageTest-1200324854 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_989ff212-215f-4e66-b090-cede39376b77_ovd4hfyjdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86639) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jul 02 20:03:33 devstack cinder-volume[86639]: INFO cinder.image.image_utils [None req-e5d6af0d-5078-45d0-b4c5-e08648c695e7 tempest-VolumeAndVolumeTypeFromImageTest-1200324854 None] Image download 0.00 MB at 0.00 MB/s
Jul 02 20:03:33 devstack sudo[106353]: pam_unix(sudo:session): session closed for user root
Jul 02 20:03:33 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-54b756df-c8af-4df7-9414-b09c7281fc6c tempest-SnapshotDependencyTests-209878434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-ee1e7c38-4615-4c8c-aa16-7b785fcec72e /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-7a6df9cb-6c17-4bdf-8f09-f39b9153ecce" returned: 0 in 5.229s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:03:33 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[32a4d851-3ae4-4734-888f-69fca14c79c4]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 20:03:33 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-54b756df-c8af-4df7-9414-b09c7281fc6c tempest-SnapshotDependencyTests-209878434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-ee1e7c38-4615-4c8c-aa16-7b785fcec72e {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:03:33 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fbfc81f-f46a-4e50-bfe0-76b35dd8ecdb]: (4, 'raw') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 20:03:33 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-e5d6af0d-5078-45d0-b4c5-e08648c695e7 tempest-VolumeAndVolumeTypeFromImageTest-1200324854 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_989ff212-215f-4e66-b090-cede39376b77_ovd4hfyjdevstack@QuobyteHD {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:03:33 devstack sudo[106367]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-ee1e7c38-4615-4c8c-aa16-7b785fcec72e
Jul 02 20:03:33 devstack sudo[106367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:03:34 devstack sudo[106368]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_989ff212-215f-4e66-b090-cede39376b77_ovd4hfyjdevstack@QuobyteHD
Jul 02 20:03:34 devstack sudo[106368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:03:34 devstack sudo[106368]: pam_unix(sudo:session): session closed for user root
Jul 02 20:03:34 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-e5d6af0d-5078-45d0-b4c5-e08648c695e7 tempest-VolumeAndVolumeTypeFromImageTest-1200324854 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_989ff212-215f-4e66-b090-cede39376b77_ovd4hfyjdevstack@QuobyteHD" returned: 0 in 0.762s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:03:34 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-e5d6af0d-5078-45d0-b4c5-e08648c695e7 tempest-VolumeAndVolumeTypeFromImageTest-1200324854 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_989ff212-215f-4e66-b090-cede39376b77_ovd4hfyjdevstack@QuobyteHD {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:03:34 devstack sudo[106382]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_989ff212-215f-4e66-b090-cede39376b77_ovd4hfyjdevstack@QuobyteHD
Jul 02 20:03:34 devstack sudo[106382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:03:34 devstack sudo[106367]: pam_unix(sudo:session): session closed for user root
Jul 02 20:03:34 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-54b756df-c8af-4df7-9414-b09c7281fc6c tempest-SnapshotDependencyTests-209878434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-ee1e7c38-4615-4c8c-aa16-7b785fcec72e" returned: 0 in 1.001s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:03:34 devstack cinder-volume[86639]: DEBUG cinder.image.image_utils [None req-54b756df-c8af-4df7-9414-b09c7281fc6c tempest-SnapshotDependencyTests-209878434 None] Image conversion details: src /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-ee1e7c38-4615-4c8c-aa16-7b785fcec72e, size 1024.00 MB, duration 5.23 sec, destination /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-7a6df9cb-6c17-4bdf-8f09-f39b9153ecce {{(pid=86639) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 02 20:03:34 devstack cinder-volume[86639]: INFO cinder.image.image_utils [None req-54b756df-c8af-4df7-9414-b09c7281fc6c tempest-SnapshotDependencyTests-209878434 None] Converted 1024.00 MB image at 195.79 MB/s
Jul 02 20:03:34 devstack cinder-volume[86639]: WARNING cinder.volume.drivers.remotefs [None req-54b756df-c8af-4df7-9414-b09c7281fc6c tempest-SnapshotDependencyTests-209878434 None] /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-7a6df9cb-6c17-4bdf-8f09-f39b9153ecce is being set with open permissions: ugo+rw
Jul 02 20:03:34 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-54b756df-c8af-4df7-9414-b09c7281fc6c tempest-SnapshotDependencyTests-209878434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-7a6df9cb-6c17-4bdf-8f09-f39b9153ecce {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:03:34 devstack sudo[106399]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-7a6df9cb-6c17-4bdf-8f09-f39b9153ecce
Jul 02 20:03:34 devstack sudo[106399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:03:35 devstack sudo[106382]: pam_unix(sudo:session): session closed for user root
Jul 02 20:03:35 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-e5d6af0d-5078-45d0-b4c5-e08648c695e7 tempest-VolumeAndVolumeTypeFromImageTest-1200324854 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_989ff212-215f-4e66-b090-cede39376b77_ovd4hfyjdevstack@QuobyteHD" returned: 1 in 0.803s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:03:35 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-e5d6af0d-5078-45d0-b4c5-e08648c695e7 tempest-VolumeAndVolumeTypeFromImageTest-1200324854 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_989ff212-215f-4e66-b090-cede39376b77_ovd4hfyjdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 02 20:03:35 devstack cinder-volume[86639]: DEBUG cinder.image.image_utils [None req-e5d6af0d-5078-45d0-b4c5-e08648c695e7 tempest-VolumeAndVolumeTypeFromImageTest-1200324854 None] Temporary image 989ff212-215f-4e66-b090-cede39376b77 is fetched for user b1f9940dfd8b4d76b95fbb72f910a256. {{(pid=86639) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jul 02 20:03:35 devstack cinder-volume[86639]: DEBUG dbcounter [-] [86639] Writing DB stats cinder:SELECT=76,cinder:INSERT=21,cinder:UPDATE=80,cinder:DELETE=3 {{(pid=86639) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 02 20:03:35 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[b13fdcfe-edb3-428e-8d03-92592e6f1835]: (4, 'raw') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 20:03:35 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-e5d6af0d-5078-45d0-b4c5-e08648c695e7 tempest-VolumeAndVolumeTypeFromImageTest-1200324854 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_989ff212-215f-4e66-b090-cede39376b77_ovd4hfyjdevstack@QuobyteHD {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:03:35 devstack sudo[106399]: pam_unix(sudo:session): session closed for user root
Jul 02 20:03:35 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-54b756df-c8af-4df7-9414-b09c7281fc6c tempest-SnapshotDependencyTests-209878434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-7a6df9cb-6c17-4bdf-8f09-f39b9153ecce" returned: 0 in 0.676s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:03:35 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-54b756df-c8af-4df7-9414-b09c7281fc6c tempest-SnapshotDependencyTests-209878434 None] Lock "cinder-quobyte-7a6df9cb-6c17-4bdf-8f09-f39b9153ecce" released by "_copy_volume_from_snapshot" :: held 8.598s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 20:03:35 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-54b756df-c8af-4df7-9414-b09c7281fc6c tempest-SnapshotDependencyTests-209878434 None] Lock "cinder-quobyte-45c4b501-e62b-455a-b60f-9f3b6657e0c8-7a6df9cb-6c17-4bdf-8f09-f39b9153ecce" released by "_create_volume_from_snapshot" :: held 8.643s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 20:03:35 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-54b756df-c8af-4df7-9414-b09c7281fc6c tempest-SnapshotDependencyTests-209878434 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.660s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 20:03:35 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-54b756df-c8af-4df7-9414-b09c7281fc6c tempest-SnapshotDependencyTests-209878434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5c4da55-5503-4baa-978a-8a9c4124ebfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a6df9cb-6c17-4bdf-8f09-f39b9153ecce', 'volume_size': 1, 'snapshot_id': '45c4b501-e62b-455a-b60f-9f3b6657e0c8'}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:03:35 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-54b756df-c8af-4df7-9414-b09c7281fc6c tempest-SnapshotDependencyTests-209878434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12722c6a-7a4d-4cc0-80b4-00ca1a5d10aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:03:35 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-54b756df-c8af-4df7-9414-b09c7281fc6c tempest-SnapshotDependencyTests-209878434 None] Volume volume-7a6df9cb-6c17-4bdf-8f09-f39b9153ecce (7a6df9cb-6c17-4bdf-8f09-f39b9153ecce): created successfully
Jul 02 20:03:35 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-54b756df-c8af-4df7-9414-b09c7281fc6c tempest-SnapshotDependencyTests-209878434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12722c6a-7a4d-4cc0-80b4-00ca1a5d10aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:03:35 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-54b756df-c8af-4df7-9414-b09c7281fc6c tempest-SnapshotDependencyTests-209878434 None] Flow 'volume_create_manager' (1033519a-6074-4d6f-ac30-42415d628e4d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 20:03:35 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-54b756df-c8af-4df7-9414-b09c7281fc6c tempest-SnapshotDependencyTests-209878434 None] Created volume successfully.
Jul 02 20:03:35 devstack sudo[106427]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_989ff212-215f-4e66-b090-cede39376b77_ovd4hfyjdevstack@QuobyteHD
Jul 02 20:03:35 devstack sudo[106427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:03:36 devstack sudo[106427]: pam_unix(sudo:session): session closed for user root
Jul 02 20:03:36 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-e5d6af0d-5078-45d0-b4c5-e08648c695e7 tempest-VolumeAndVolumeTypeFromImageTest-1200324854 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_989ff212-215f-4e66-b090-cede39376b77_ovd4hfyjdevstack@QuobyteHD" returned: 0 in 0.814s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:03:36 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-e5d6af0d-5078-45d0-b4c5-e08648c695e7 tempest-VolumeAndVolumeTypeFromImageTest-1200324854 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_989ff212-215f-4e66-b090-cede39376b77_ovd4hfyjdevstack@QuobyteHD {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:03:36 devstack sudo[106431]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_989ff212-215f-4e66-b090-cede39376b77_ovd4hfyjdevstack@QuobyteHD
Jul 02 20:03:36 devstack sudo[106431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:03:36 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-6b907057-d53c-434e-a7e7-e6f836f3a9af tempest-SnapshotDependencyTests-209878434 None] Acquiring lock "cinder-45c4b501-e62b-455a-b60f-9f3b6657e0c8-delete_snapshot" by "delete_snapshot" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 20:03:36 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-6b907057-d53c-434e-a7e7-e6f836f3a9af tempest-SnapshotDependencyTests-209878434 None] Lock "cinder-45c4b501-e62b-455a-b60f-9f3b6657e0c8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 20:03:36 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-6b907057-d53c-434e-a7e7-e6f836f3a9af tempest-SnapshotDependencyTests-209878434 None] Acquiring lock "cinder-quobyte-ee1e7c38-4615-4c8c-aa16-7b785fcec72e" by "delete_snapshot" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 20:03:36 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-6b907057-d53c-434e-a7e7-e6f836f3a9af tempest-SnapshotDependencyTests-209878434 None] Lock "cinder-quobyte-ee1e7c38-4615-4c8c-aa16-7b785fcec72e" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 20:03:36 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-6b907057-d53c-434e-a7e7-e6f836f3a9af tempest-SnapshotDependencyTests-209878434 None] Acquiring lock "cinder-quobyte-45c4b501-e62b-455a-b60f-9f3b6657e0c8" by "_delete_snapshot" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 20:03:36 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-6b907057-d53c-434e-a7e7-e6f836f3a9af tempest-SnapshotDependencyTests-209878434 None] Lock "cinder-quobyte-45c4b501-e62b-455a-b60f-9f3b6657e0c8" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 20:03:36 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-6b907057-d53c-434e-a7e7-e6f836f3a9af tempest-SnapshotDependencyTests-209878434 None] Deleting offline snapshot 45c4b501-e62b-455a-b60f-9f3b6657e0c8 of volume ee1e7c38-4615-4c8c-aa16-7b785fcec72e {{(pid=86639) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 02 20:03:36 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-6b907057-d53c-434e-a7e7-e6f836f3a9af tempest-SnapshotDependencyTests-209878434 None] snapshot_file for this snap is: volume-ee1e7c38-4615-4c8c-aa16-7b785fcec72e.45c4b501-e62b-455a-b60f-9f3b6657e0c8 {{(pid=86639) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 02 20:03:36 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[73b2fd66-37bf-42a5-acd7-cd9aefa8707a]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 20:03:36 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-6b907057-d53c-434e-a7e7-e6f836f3a9af tempest-SnapshotDependencyTests-209878434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-ee1e7c38-4615-4c8c-aa16-7b785fcec72e.45c4b501-e62b-455a-b60f-9f3b6657e0c8 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:03:37 devstack sudo[106433]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-ee1e7c38-4615-4c8c-aa16-7b785fcec72e.45c4b501-e62b-455a-b60f-9f3b6657e0c8
Jul 02 20:03:37 devstack sudo[106433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:03:37 devstack sudo[106431]: pam_unix(sudo:session): session closed for user root
Jul 02 20:03:37 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-e5d6af0d-5078-45d0-b4c5-e08648c695e7 tempest-VolumeAndVolumeTypeFromImageTest-1200324854 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_989ff212-215f-4e66-b090-cede39376b77_ovd4hfyjdevstack@QuobyteHD" returned: 1 in 0.775s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:03:37 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-e5d6af0d-5078-45d0-b4c5-e08648c695e7 tempest-VolumeAndVolumeTypeFromImageTest-1200324854 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_989ff212-215f-4e66-b090-cede39376b77_ovd4hfyjdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 02 20:03:37 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-e5d6af0d-5078-45d0-b4c5-e08648c695e7 tempest-VolumeAndVolumeTypeFromImageTest-1200324854 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 20:03:37 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-e5d6af0d-5078-45d0-b4c5-e08648c695e7 tempest-VolumeAndVolumeTypeFromImageTest-1200324854 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 20:03:37 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-e5d6af0d-5078-45d0-b4c5-e08648c695e7 tempest-VolumeAndVolumeTypeFromImageTest-1200324854 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce906cb830>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T18:03:32Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc64202d-9f21-4613-9b5d-aae0c40fcb57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d59ee505a3242d691ff38cb95823857',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T18:03:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T18:03:33Z,use_quota=True,user_id='b1f9940dfd8b4d76b95fbb72f910a256',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a35dc6e7-1ac5-4014-9043-4cf6c6342739),volume_type_id=a35dc6e7-1ac5-4014-9043-4cf6c6342739)}" {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 20:03:37 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-e5d6af0d-5078-45d0-b4c5-e08648c695e7 tempest-VolumeAndVolumeTypeFromImageTest-1200324854 None] Creating volume dc64202d-9f21-4613-9b5d-aae0c40fcb57 {{(pid=86639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 20:03:37 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-e5d6af0d-5078-45d0-b4c5-e08648c695e7 tempest-VolumeAndVolumeTypeFromImageTest-1200324854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 20:03:37 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-e5d6af0d-5078-45d0-b4c5-e08648c695e7 tempest-VolumeAndVolumeTypeFromImageTest-1200324854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 20:03:37 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-e5d6af0d-5078-45d0-b4c5-e08648c695e7 tempest-VolumeAndVolumeTypeFromImageTest-1200324854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 20:03:37 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-e5d6af0d-5078-45d0-b4c5-e08648c695e7 tempest-VolumeAndVolumeTypeFromImageTest-1200324854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 20:03:37 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-e5d6af0d-5078-45d0-b4c5-e08648c695e7 tempest-VolumeAndVolumeTypeFromImageTest-1200324854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 20:03:37 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-e5d6af0d-5078-45d0-b4c5-e08648c695e7 tempest-VolumeAndVolumeTypeFromImageTest-1200324854 None] Selected osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92 as target Quobyte volume. {{(pid=86639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 20:03:37 devstack cinder-volume[86639]: INFO cinder.volume.drivers.remotefs [None req-e5d6af0d-5078-45d0-b4c5-e08648c695e7 tempest-VolumeAndVolumeTypeFromImageTest-1200324854 None] casted to osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92
Jul 02 20:03:37 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-e5d6af0d-5078-45d0-b4c5-e08648c695e7 tempest-VolumeAndVolumeTypeFromImageTest-1200324854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-dc64202d-9f21-4613-9b5d-aae0c40fcb57 1073741824 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:03:37 devstack sudo[106438]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-dc64202d-9f21-4613-9b5d-aae0c40fcb57 1073741824
Jul 02 20:03:37 devstack sudo[106438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:03:37 devstack sudo[106433]: pam_unix(sudo:session): session closed for user root
Jul 02 20:03:37 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-6b907057-d53c-434e-a7e7-e6f836f3a9af tempest-SnapshotDependencyTests-209878434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-ee1e7c38-4615-4c8c-aa16-7b785fcec72e.45c4b501-e62b-455a-b60f-9f3b6657e0c8" returned: 0 in 0.765s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:03:37 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-6b907057-d53c-434e-a7e7-e6f836f3a9af tempest-SnapshotDependencyTests-209878434 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ee1e7c38-4615-4c8c-aa16-7b785fcec72e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86639) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 02 20:03:37 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[f42b8726-9298-4975-9a07-3291a7f24989]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 20:03:37 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-6b907057-d53c-434e-a7e7-e6f836f3a9af tempest-SnapshotDependencyTests-209878434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-ee1e7c38-4615-4c8c-aa16-7b785fcec72e {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:03:37 devstack sudo[106443]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-ee1e7c38-4615-4c8c-aa16-7b785fcec72e
Jul 02 20:03:37 devstack sudo[106443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:03:38 devstack sudo[106438]: pam_unix(sudo:session): session closed for user root
Jul 02 20:03:38 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-e5d6af0d-5078-45d0-b4c5-e08648c695e7 tempest-VolumeAndVolumeTypeFromImageTest-1200324854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-dc64202d-9f21-4613-9b5d-aae0c40fcb57 1073741824" returned: 0 in 0.913s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:03:38 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-e5d6af0d-5078-45d0-b4c5-e08648c695e7 tempest-VolumeAndVolumeTypeFromImageTest-1200324854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-dc64202d-9f21-4613-9b5d-aae0c40fcb57 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:03:38 devstack sudo[106448]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-dc64202d-9f21-4613-9b5d-aae0c40fcb57
Jul 02 20:03:38 devstack sudo[106448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:03:38 devstack sudo[106443]: pam_unix(sudo:session): session closed for user root
Jul 02 20:03:38 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-6b907057-d53c-434e-a7e7-e6f836f3a9af tempest-SnapshotDependencyTests-209878434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-ee1e7c38-4615-4c8c-aa16-7b785fcec72e" returned: 0 in 0.832s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:03:38 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-6b907057-d53c-434e-a7e7-e6f836f3a9af tempest-SnapshotDependencyTests-209878434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-ee1e7c38-4615-4c8c-aa16-7b785fcec72e.45c4b501-e62b-455a-b60f-9f3b6657e0c8 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:03:38 devstack sudo[106453]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-ee1e7c38-4615-4c8c-aa16-7b785fcec72e.45c4b501-e62b-455a-b60f-9f3b6657e0c8
Jul 02 20:03:38 devstack sudo[106453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:03:38 devstack sudo[106448]: pam_unix(sudo:session): session closed for user root
Jul 02 20:03:38 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-e5d6af0d-5078-45d0-b4c5-e08648c695e7 tempest-VolumeAndVolumeTypeFromImageTest-1200324854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-dc64202d-9f21-4613-9b5d-aae0c40fcb57" returned: 0 in 0.663s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:03:38 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-e5d6af0d-5078-45d0-b4c5-e08648c695e7 tempest-VolumeAndVolumeTypeFromImageTest-1200324854 None] <== create_volume: return (1625ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'} {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 20:03:38 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-e5d6af0d-5078-45d0-b4c5-e08648c695e7 tempest-VolumeAndVolumeTypeFromImageTest-1200324854 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.627s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 20:03:38 devstack cinder-volume[86639]: DEBUG cinder.volume.volume_utils [None req-e5d6af0d-5078-45d0-b4c5-e08648c695e7 tempest-VolumeAndVolumeTypeFromImageTest-1200324854 None] Attempting download of 989ff212-215f-4e66-b090-cede39376b77 ((None, [{'url': 'file:///opt/stack/data/glance/images/989ff212-215f-4e66-b090-cede39376b77', 'metadata': {}}])) to volume dc64202d-9f21-4613-9b5d-aae0c40fcb57. {{(pid=86639) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jul 02 20:03:38 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[d04ee70e-134b-439f-bb0a-f937781f3afb]: (4, 'raw') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 20:03:38 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-e5d6af0d-5078-45d0-b4c5-e08648c695e7 tempest-VolumeAndVolumeTypeFromImageTest-1200324854 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_989ff212-215f-4e66-b090-cede39376b77_ywqv__yl {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:03:38 devstack sudo[106456]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_989ff212-215f-4e66-b090-cede39376b77_ywqv__yl
Jul 02 20:03:38 devstack sudo[106456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:03:39 devstack sudo[106453]: pam_unix(sudo:session): session closed for user root
Jul 02 20:03:39 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-6b907057-d53c-434e-a7e7-e6f836f3a9af tempest-SnapshotDependencyTests-209878434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-ee1e7c38-4615-4c8c-aa16-7b785fcec72e.45c4b501-e62b-455a-b60f-9f3b6657e0c8" returned: 0 in 0.795s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:03:39 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-6b907057-d53c-434e-a7e7-e6f836f3a9af tempest-SnapshotDependencyTests-209878434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-ee1e7c38-4615-4c8c-aa16-7b785fcec72e.45c4b501-e62b-455a-b60f-9f3b6657e0c8 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:03:39 devstack sudo[106461]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-ee1e7c38-4615-4c8c-aa16-7b785fcec72e.45c4b501-e62b-455a-b60f-9f3b6657e0c8
Jul 02 20:03:39 devstack sudo[106461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:03:39 devstack sudo[106456]: pam_unix(sudo:session): session closed for user root
Jul 02 20:03:39 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-e5d6af0d-5078-45d0-b4c5-e08648c695e7 tempest-VolumeAndVolumeTypeFromImageTest-1200324854 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_989ff212-215f-4e66-b090-cede39376b77_ywqv__yl" returned: 0 in 0.778s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:03:39 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-e5d6af0d-5078-45d0-b4c5-e08648c695e7 tempest-VolumeAndVolumeTypeFromImageTest-1200324854 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_989ff212-215f-4e66-b090-cede39376b77_ywqv__yl {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:03:39 devstack sudo[106465]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_989ff212-215f-4e66-b090-cede39376b77_ywqv__yl
Jul 02 20:03:39 devstack sudo[106465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:03:40 devstack sudo[106461]: pam_unix(sudo:session): session closed for user root
Jul 02 20:03:40 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-6b907057-d53c-434e-a7e7-e6f836f3a9af tempest-SnapshotDependencyTests-209878434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-ee1e7c38-4615-4c8c-aa16-7b785fcec72e.45c4b501-e62b-455a-b60f-9f3b6657e0c8" returned: 0 in 0.720s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:03:40 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-6b907057-d53c-434e-a7e7-e6f836f3a9af tempest-SnapshotDependencyTests-209878434 None] Lock "cinder-quobyte-45c4b501-e62b-455a-b60f-9f3b6657e0c8" released by "_delete_snapshot" :: held 3.220s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 20:03:40 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-6b907057-d53c-434e-a7e7-e6f836f3a9af tempest-SnapshotDependencyTests-209878434 None] Lock "cinder-quobyte-ee1e7c38-4615-4c8c-aa16-7b785fcec72e" released by "delete_snapshot" :: held 3.248s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 20:03:40 devstack cinder-volume[86639]: DEBUG cinder.quota [None req-6b907057-d53c-434e-a7e7-e6f836f3a9af tempest-SnapshotDependencyTests-209878434 None] Created reservations ['cd0d0193-df2b-46ae-92a4-0c0634d5fa60', '713e801e-c297-44ac-a5de-d3e35c84637c', 'b73b531d-9c68-4f2d-811b-2cdf7c8674fb', '7a9a3a8a-bd97-4c91-9ed4-74e1d406bfd4'] {{(pid=86639) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 20:03:40 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-6b907057-d53c-434e-a7e7-e6f836f3a9af tempest-SnapshotDependencyTests-209878434 None] Delete snapshot completed successfully.
Jul 02 20:03:40 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-6b907057-d53c-434e-a7e7-e6f836f3a9af tempest-SnapshotDependencyTests-209878434 None] Lock "cinder-45c4b501-e62b-455a-b60f-9f3b6657e0c8-delete_snapshot" released by "delete_snapshot" :: held 3.414s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 20:03:40 devstack sudo[106465]: pam_unix(sudo:session): session closed for user root
Jul 02 20:03:40 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-e5d6af0d-5078-45d0-b4c5-e08648c695e7 tempest-VolumeAndVolumeTypeFromImageTest-1200324854 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_989ff212-215f-4e66-b090-cede39376b77_ywqv__yl" returned: 1 in 0.768s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:03:40 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-e5d6af0d-5078-45d0-b4c5-e08648c695e7 tempest-VolumeAndVolumeTypeFromImageTest-1200324854 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_989ff212-215f-4e66-b090-cede39376b77_ywqv__yl' failed. Not Retrying. {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 02 20:03:40 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b245295-f167-4dbf-934d-087ce9b57792]: (4, 'raw') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 20:03:40 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-e5d6af0d-5078-45d0-b4c5-e08648c695e7 tempest-VolumeAndVolumeTypeFromImageTest-1200324854 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_989ff212-215f-4e66-b090-cede39376b77_ovd4hfyjdevstack@QuobyteHD {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:03:40 devstack sudo[106472]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_989ff212-215f-4e66-b090-cede39376b77_ovd4hfyjdevstack@QuobyteHD
Jul 02 20:03:40 devstack sudo[106472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:03:41 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-b08e1d83-944b-40c1-95df-e57865f0bfd7 tempest-SnapshotDependencyTests-209878434 None] Acquiring lock "cinder-ee1e7c38-4615-4c8c-aa16-7b785fcec72e-delete_volume" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 20:03:41 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-b08e1d83-944b-40c1-95df-e57865f0bfd7 tempest-SnapshotDependencyTests-209878434 None] Lock "cinder-ee1e7c38-4615-4c8c-aa16-7b785fcec72e-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 20:03:41 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-b08e1d83-944b-40c1-95df-e57865f0bfd7 tempest-SnapshotDependencyTests-209878434 None] Acquiring lock "cinder-quobyte-ee1e7c38-4615-4c8c-aa16-7b785fcec72e" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 20:03:41 devstack sudo[106472]: pam_unix(sudo:session): session closed for user root
Jul 02 20:03:41 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-e5d6af0d-5078-45d0-b4c5-e08648c695e7 tempest-VolumeAndVolumeTypeFromImageTest-1200324854 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_989ff212-215f-4e66-b090-cede39376b77_ovd4hfyjdevstack@QuobyteHD" returned: 0 in 0.794s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:03:41 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-e5d6af0d-5078-45d0-b4c5-e08648c695e7 tempest-VolumeAndVolumeTypeFromImageTest-1200324854 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_989ff212-215f-4e66-b090-cede39376b77_ovd4hfyjdevstack@QuobyteHD {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:03:41 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-b08e1d83-944b-40c1-95df-e57865f0bfd7 tempest-SnapshotDependencyTests-209878434 None] Lock "cinder-quobyte-ee1e7c38-4615-4c8c-aa16-7b785fcec72e" acquired by "delete_volume" :: waited 0.027s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 20:03:41 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3e6af15-3ebc-4255-b084-48cb886d9aab]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 20:03:41 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-b08e1d83-944b-40c1-95df-e57865f0bfd7 tempest-SnapshotDependencyTests-209878434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-ee1e7c38-4615-4c8c-aa16-7b785fcec72e {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:03:41 devstack sudo[106476]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_989ff212-215f-4e66-b090-cede39376b77_ovd4hfyjdevstack@QuobyteHD
Jul 02 20:03:41 devstack sudo[106476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:03:41 devstack sudo[106477]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-ee1e7c38-4615-4c8c-aa16-7b785fcec72e
Jul 02 20:03:41 devstack sudo[106477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:03:41 devstack cinder-volume[86639]: DEBUG oslo_service.periodic_task [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86639) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 02 20:03:41 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 20:03:41 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 20:03:41 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 20:03:41 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 20:03:41 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 20:03:41 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:03:41 devstack sudo[106480]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e
Jul 02 20:03:41 devstack sudo[106480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:03:42 devstack sudo[106476]: pam_unix(sudo:session): session closed for user root
Jul 02 20:03:42 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-e5d6af0d-5078-45d0-b4c5-e08648c695e7 tempest-VolumeAndVolumeTypeFromImageTest-1200324854 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_989ff212-215f-4e66-b090-cede39376b77_ovd4hfyjdevstack@QuobyteHD" returned: 1 in 0.818s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:03:42 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-e5d6af0d-5078-45d0-b4c5-e08648c695e7 tempest-VolumeAndVolumeTypeFromImageTest-1200324854 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_989ff212-215f-4e66-b090-cede39376b77_ovd4hfyjdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 02 20:03:42 devstack cinder-volume[86639]: DEBUG cinder.image.image_utils [None req-e5d6af0d-5078-45d0-b4c5-e08648c695e7 tempest-VolumeAndVolumeTypeFromImageTest-1200324854 None] 989ff212-215f-4e66-b090-cede39376b77 was raw, converting to raw {{(pid=86639) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jul 02 20:03:42 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-e5d6af0d-5078-45d0-b4c5-e08648c695e7 tempest-VolumeAndVolumeTypeFromImageTest-1200324854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_989ff212-215f-4e66-b090-cede39376b77_ovd4hfyjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-dc64202d-9f21-4613-9b5d-aae0c40fcb57 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:03:42 devstack sudo[106488]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_989ff212-215f-4e66-b090-cede39376b77_ovd4hfyjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-dc64202d-9f21-4613-9b5d-aae0c40fcb57
Jul 02 20:03:42 devstack sudo[106488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:03:42 devstack sudo[106477]: pam_unix(sudo:session): session closed for user root
Jul 02 20:03:42 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-b08e1d83-944b-40c1-95df-e57865f0bfd7 tempest-SnapshotDependencyTests-209878434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-ee1e7c38-4615-4c8c-aa16-7b785fcec72e" returned: 0 in 0.820s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:03:42 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-b08e1d83-944b-40c1-95df-e57865f0bfd7 tempest-SnapshotDependencyTests-209878434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-ee1e7c38-4615-4c8c-aa16-7b785fcec72e {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:03:42 devstack sudo[106490]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-ee1e7c38-4615-4c8c-aa16-7b785fcec72e
Jul 02 20:03:42 devstack sudo[106490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:03:42 devstack sudo[106480]: pam_unix(sudo:session): session closed for user root
Jul 02 20:03:42 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e" returned: 0 in 0.710s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:03:42 devstack cinder-volume[86639]: DEBUG cinder.manager [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] Notifying Schedulers of capabilities ... {{(pid=86639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 20:03:42 devstack cinder-volume[86639]: DEBUG oslo_service.periodic_task [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] Running periodic task VolumeManager._thread_info {{(pid=86639) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 02 20:03:42 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] thread count: 28 {{(pid=86639) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 02 20:03:42 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] thread info: [<_MainThread(MainThread, started 140525261275264)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 140525150678016)>, <Thread(Thread-3 (stat_writer), started daemon 140525150025920)>, <Thread(Rabbit-heartbeat, started daemon 140525150500864)>, <Thread(Thread-5 (_runner), started daemon 140525149847296)>, <Thread(Thread-7 (_runner), started daemon 140525149863424)>, <Thread(fd_logger, started daemon 140525146589376)>, <Thread(privsep_reader, started daemon 140525144562432)>, <Thread(tpool_thread_0, started daemon 140525137151680)>, <Thread(tpool_thread_1, started daemon 140525128758976)>, <Thread(tpool_thread_2, started daemon 140525120349888)>, <Thread(tpool_thread_3, started daemon 140525111940800)>, <Thread(tpool_thread_4, started daemon 140525103531712)>, <Thread(tpool_thread_5, started daemon 140525095122624)>, <Thread(tpool_thread_6, started daemon 140525086713536)>, <Thread(tpool_thread_7, started daemon 140525078304448)>, <Thread(tpool_thread_8, started daemon 140525069895360)>, <Thread(tpool_thread_9, started daemon 140525061486272)>, <Thread(tpool_thread_10, started daemon 140525053077184)>, <Thread(tpool_thread_11, started daemon 140525044668096)>, <Thread(tpool_thread_12, started daemon 140525036259008)>, <Thread(tpool_thread_13, started daemon 140525027849920)>, <Thread(tpool_thread_14, started daemon 140525019440832)>, <Thread(tpool_thread_15, started daemon 140525011031744)>, <Thread(tpool_thread_16, started daemon 140525002622656)>, <Thread(tpool_thread_17, started daemon 140524994213568)>, <Thread(tpool_thread_18, started daemon 140524985804480)>, <Thread(tpool_thread_19, started daemon 140524977395392)>] {{(pid=86639) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 02 20:03:42 devstack sudo[106490]: pam_unix(sudo:session): session closed for user root
Jul 02 20:03:42 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-b08e1d83-944b-40c1-95df-e57865f0bfd7 tempest-SnapshotDependencyTests-209878434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-ee1e7c38-4615-4c8c-aa16-7b785fcec72e" returned: 0 in 0.700s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:03:42 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-b08e1d83-944b-40c1-95df-e57865f0bfd7 tempest-SnapshotDependencyTests-209878434 None] Lock "cinder-quobyte-ee1e7c38-4615-4c8c-aa16-7b785fcec72e" released by "delete_volume" :: held 1.588s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 20:03:42 devstack sudo[106488]: pam_unix(sudo:session): session closed for user root
Jul 02 20:03:42 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-e5d6af0d-5078-45d0-b4c5-e08648c695e7 tempest-VolumeAndVolumeTypeFromImageTest-1200324854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_989ff212-215f-4e66-b090-cede39376b77_ovd4hfyjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-dc64202d-9f21-4613-9b5d-aae0c40fcb57" returned: 0 in 0.813s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:03:42 devstack cinder-volume[86639]: DEBUG cinder.image.image_utils [None req-e5d6af0d-5078-45d0-b4c5-e08648c695e7 tempest-VolumeAndVolumeTypeFromImageTest-1200324854 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_989ff212-215f-4e66-b090-cede39376b77_ovd4hfyjdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-dc64202d-9f21-4613-9b5d-aae0c40fcb57 {{(pid=86639) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 02 20:03:42 devstack cinder-volume[86639]: INFO cinder.image.image_utils [None req-e5d6af0d-5078-45d0-b4c5-e08648c695e7 tempest-VolumeAndVolumeTypeFromImageTest-1200324854 None] Converted 0.00 MB image at 0.00 MB/s
Jul 02 20:03:42 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-e5d6af0d-5078-45d0-b4c5-e08648c695e7 tempest-VolumeAndVolumeTypeFromImageTest-1200324854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-dc64202d-9f21-4613-9b5d-aae0c40fcb57 1G {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:03:42 devstack sudo[106497]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-dc64202d-9f21-4613-9b5d-aae0c40fcb57 1G
Jul 02 20:03:42 devstack sudo[106497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:03:42 devstack cinder-volume[86639]: DEBUG cinder.quota [None req-b08e1d83-944b-40c1-95df-e57865f0bfd7 tempest-SnapshotDependencyTests-209878434 None] Created reservations ['ad15bfc7-6988-4c40-9cac-c26f4b4b9c33', '8485f6b7-4846-43d4-a478-adce2af7cff0', '6efe90d7-e84d-455e-abab-d0caa6fad131', 'ee34b278-5916-42aa-9af5-be1227d85d03'] {{(pid=86639) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 20:03:42 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-b08e1d83-944b-40c1-95df-e57865f0bfd7 tempest-SnapshotDependencyTests-209878434 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 20:03:42 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-b08e1d83-944b-40c1-95df-e57865f0bfd7 tempest-SnapshotDependencyTests-209878434 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 20:03:42 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-b08e1d83-944b-40c1-95df-e57865f0bfd7 tempest-SnapshotDependencyTests-209878434 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 20:03:42 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-b08e1d83-944b-40c1-95df-e57865f0bfd7 tempest-SnapshotDependencyTests-209878434 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 20:03:42 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-b08e1d83-944b-40c1-95df-e57865f0bfd7 tempest-SnapshotDependencyTests-209878434 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 20:03:42 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-b08e1d83-944b-40c1-95df-e57865f0bfd7 tempest-SnapshotDependencyTests-209878434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:03:42 devstack sudo[106499]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e
Jul 02 20:03:42 devstack sudo[106499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:03:43 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-2897a845-a7e2-4616-8469-760abeb1e1c4 tempest-SnapshotDependencyTests-209878434 None] Acquiring lock "cinder-7a6df9cb-6c17-4bdf-8f09-f39b9153ecce-delete_volume" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 20:03:43 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-2897a845-a7e2-4616-8469-760abeb1e1c4 tempest-SnapshotDependencyTests-209878434 None] Lock "cinder-7a6df9cb-6c17-4bdf-8f09-f39b9153ecce-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 20:03:43 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-2897a845-a7e2-4616-8469-760abeb1e1c4 tempest-SnapshotDependencyTests-209878434 None] Acquiring lock "cinder-quobyte-7a6df9cb-6c17-4bdf-8f09-f39b9153ecce" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 20:03:43 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-2897a845-a7e2-4616-8469-760abeb1e1c4 tempest-SnapshotDependencyTests-209878434 None] Lock "cinder-quobyte-7a6df9cb-6c17-4bdf-8f09-f39b9153ecce" acquired by "delete_volume" :: waited 0.025s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 20:03:43 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[605e63e1-7c27-4039-8e50-aa838e00c40b]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 20:03:43 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-2897a845-a7e2-4616-8469-760abeb1e1c4 tempest-SnapshotDependencyTests-209878434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-7a6df9cb-6c17-4bdf-8f09-f39b9153ecce {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:03:43 devstack sudo[106499]: pam_unix(sudo:session): session closed for user root
Jul 02 20:03:43 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-b08e1d83-944b-40c1-95df-e57865f0bfd7 tempest-SnapshotDependencyTests-209878434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e" returned: 0 in 0.699s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:03:43 devstack cinder-volume[86639]: DEBUG cinder.manager [None req-b08e1d83-944b-40c1-95df-e57865f0bfd7 tempest-SnapshotDependencyTests-209878434 None] Notifying Schedulers of capabilities ... {{(pid=86639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 20:03:43 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-b08e1d83-944b-40c1-95df-e57865f0bfd7 tempest-SnapshotDependencyTests-209878434 None] Deleted volume successfully.
Jul 02 20:03:43 devstack sudo[106497]: pam_unix(sudo:session): session closed for user root
Jul 02 20:03:43 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-e5d6af0d-5078-45d0-b4c5-e08648c695e7 tempest-VolumeAndVolumeTypeFromImageTest-1200324854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-dc64202d-9f21-4613-9b5d-aae0c40fcb57 1G" returned: 0 in 0.839s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:03:43 devstack sudo[106505]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-7a6df9cb-6c17-4bdf-8f09-f39b9153ecce
Jul 02 20:03:43 devstack sudo[106505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:03:43 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-b08e1d83-944b-40c1-95df-e57865f0bfd7 tempest-SnapshotDependencyTests-209878434 None] Lock "cinder-ee1e7c38-4615-4c8c-aa16-7b785fcec72e-delete_volume" released by "delete_volume" :: held 2.595s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 20:03:43 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[404fbfeb-2e63-437e-9bef-9f6f47dad07f]: (4, 'raw') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 20:03:43 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-e5d6af0d-5078-45d0-b4c5-e08648c695e7 tempest-VolumeAndVolumeTypeFromImageTest-1200324854 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-dc64202d-9f21-4613-9b5d-aae0c40fcb57 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:03:43 devstack sudo[106507]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-dc64202d-9f21-4613-9b5d-aae0c40fcb57
Jul 02 20:03:43 devstack sudo[106507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:03:44 devstack sudo[106505]: pam_unix(sudo:session): session closed for user root
Jul 02 20:03:44 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-2897a845-a7e2-4616-8469-760abeb1e1c4 tempest-SnapshotDependencyTests-209878434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-7a6df9cb-6c17-4bdf-8f09-f39b9153ecce" returned: 0 in 0.858s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:03:44 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-2897a845-a7e2-4616-8469-760abeb1e1c4 tempest-SnapshotDependencyTests-209878434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-7a6df9cb-6c17-4bdf-8f09-f39b9153ecce {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:03:44 devstack sudo[106515]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-7a6df9cb-6c17-4bdf-8f09-f39b9153ecce
Jul 02 20:03:44 devstack sudo[106515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:03:44 devstack sudo[106507]: pam_unix(sudo:session): session closed for user root
Jul 02 20:03:44 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-e5d6af0d-5078-45d0-b4c5-e08648c695e7 tempest-VolumeAndVolumeTypeFromImageTest-1200324854 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-dc64202d-9f21-4613-9b5d-aae0c40fcb57" returned: 0 in 0.792s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:03:44 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-e5d6af0d-5078-45d0-b4c5-e08648c695e7 tempest-VolumeAndVolumeTypeFromImageTest-1200324854 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-dc64202d-9f21-4613-9b5d-aae0c40fcb57 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:03:44 devstack sudo[106517]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-dc64202d-9f21-4613-9b5d-aae0c40fcb57
Jul 02 20:03:44 devstack sudo[106517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:03:45 devstack sudo[106515]: pam_unix(sudo:session): session closed for user root
Jul 02 20:03:45 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-2897a845-a7e2-4616-8469-760abeb1e1c4 tempest-SnapshotDependencyTests-209878434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-7a6df9cb-6c17-4bdf-8f09-f39b9153ecce" returned: 0 in 0.680s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:03:45 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-2897a845-a7e2-4616-8469-760abeb1e1c4 tempest-SnapshotDependencyTests-209878434 None] Lock "cinder-quobyte-7a6df9cb-6c17-4bdf-8f09-f39b9153ecce" released by "delete_volume" :: held 1.591s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 20:03:45 devstack cinder-volume[86639]: DEBUG cinder.quota [None req-2897a845-a7e2-4616-8469-760abeb1e1c4 tempest-SnapshotDependencyTests-209878434 None] Created reservations ['11dd16b0-72fd-4806-85fa-7fc5acfd5a8a', '7cbed97f-f28e-4190-a833-46b0686f4dcc', 'c2b0e23e-0f7e-402d-a421-b253edab10c6', '336aa432-50db-41e4-a44c-916a757acf04'] {{(pid=86639) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 20:03:45 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-2897a845-a7e2-4616-8469-760abeb1e1c4 tempest-SnapshotDependencyTests-209878434 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 20:03:45 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-2897a845-a7e2-4616-8469-760abeb1e1c4 tempest-SnapshotDependencyTests-209878434 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 20:03:45 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-2897a845-a7e2-4616-8469-760abeb1e1c4 tempest-SnapshotDependencyTests-209878434 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 20:03:45 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-2897a845-a7e2-4616-8469-760abeb1e1c4 tempest-SnapshotDependencyTests-209878434 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 20:03:45 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-2897a845-a7e2-4616-8469-760abeb1e1c4 tempest-SnapshotDependencyTests-209878434 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 20:03:45 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-2897a845-a7e2-4616-8469-760abeb1e1c4 tempest-SnapshotDependencyTests-209878434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:03:45 devstack sudo[106523]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e
Jul 02 20:03:45 devstack sudo[106523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:03:45 devstack sudo[106517]: pam_unix(sudo:session): session closed for user root
Jul 02 20:03:45 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-e5d6af0d-5078-45d0-b4c5-e08648c695e7 tempest-VolumeAndVolumeTypeFromImageTest-1200324854 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-dc64202d-9f21-4613-9b5d-aae0c40fcb57" returned: 1 in 0.765s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:03:45 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-e5d6af0d-5078-45d0-b4c5-e08648c695e7 tempest-VolumeAndVolumeTypeFromImageTest-1200324854 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-dc64202d-9f21-4613-9b5d-aae0c40fcb57' failed. Not Retrying. {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 02 20:03:45 devstack cinder-volume[86639]: DEBUG cinder.volume.volume_utils [None req-e5d6af0d-5078-45d0-b4c5-e08648c695e7 tempest-VolumeAndVolumeTypeFromImageTest-1200324854 None] Downloaded image 989ff212-215f-4e66-b090-cede39376b77 ((None, [{'url': 'file:///opt/stack/data/glance/images/989ff212-215f-4e66-b090-cede39376b77', 'metadata': {}}])) to volume dc64202d-9f21-4613-9b5d-aae0c40fcb57 successfully. {{(pid=86639) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jul 02 20:03:45 devstack cinder-volume[86639]: DEBUG cinder.image.image_utils [None req-e5d6af0d-5078-45d0-b4c5-e08648c695e7 tempest-VolumeAndVolumeTypeFromImageTest-1200324854 None] Temporary image 989ff212-215f-4e66-b090-cede39376b77 for user b1f9940dfd8b4d76b95fbb72f910a256 is deleted. {{(pid=86639) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jul 02 20:03:45 devstack cinder-volume[86639]: DEBUG cinder.volume.volume_utils [None req-e5d6af0d-5078-45d0-b4c5-e08648c695e7 tempest-VolumeAndVolumeTypeFromImageTest-1200324854 None] Marking volume dc64202d-9f21-4613-9b5d-aae0c40fcb57 as bootable. {{(pid=86639) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jul 02 20:03:45 devstack cinder-volume[86639]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5d6af0d-5078-45d0-b4c5-e08648c695e7 tempest-VolumeAndVolumeTypeFromImageTest-1200324854 None] Copying metadata from image 989ff212-215f-4e66-b090-cede39376b77 to dc64202d-9f21-4613-9b5d-aae0c40fcb57. {{(pid=86639) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jul 02 20:03:45 devstack cinder-volume[86639]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5d6af0d-5078-45d0-b4c5-e08648c695e7 tempest-VolumeAndVolumeTypeFromImageTest-1200324854 None] Creating volume glance metadata for volume dc64202d-9f21-4613-9b5d-aae0c40fcb57 backed by image 989ff212-215f-4e66-b090-cede39376b77 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '989ff212-215f-4e66-b090-cede39376b77', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '40392eff1a752043ec7ce5ca05f711c7', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86639) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jul 02 20:03:45 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-e5d6af0d-5078-45d0-b4c5-e08648c695e7 tempest-VolumeAndVolumeTypeFromImageTest-1200324854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a39ff26-e0ed-4f79-90d9-8a4013690813) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc64202d-9f21-4613-9b5d-aae0c40fcb57', 'volume_size': 1, 'image_id': '989ff212-215f-4e66-b090-cede39376b77', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/989ff212-215f-4e66-b090-cede39376b77', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '40392eff1a752043ec7ce5ca05f711c7', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '9d59ee505a3242d691ff38cb95823857', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '23ffa73ab3ff3170e0c2c8daa830570b4e6a1a2d01f94c24e7f67ec127de0f36ff1c2e2f6b62d3278d8902adc70f86d0ba0abfdcf2b32576cd1231134832bcfd', 'id': '989ff212-215f-4e66-b090-cede39376b77', 'created_at': datetime.datetime(2026, 7, 2, 18, 3, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 2, 18, 3, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/989ff212-215f-4e66-b090-cede39376b77/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fce84c4a360>}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:03:45 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-e5d6af0d-5078-45d0-b4c5-e08648c695e7 tempest-VolumeAndVolumeTypeFromImageTest-1200324854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b7ca9ea-4be0-4692-b2c1-e0267c207e2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:03:45 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-e5d6af0d-5078-45d0-b4c5-e08648c695e7 tempest-VolumeAndVolumeTypeFromImageTest-1200324854 None] Volume volume-dc64202d-9f21-4613-9b5d-aae0c40fcb57 (dc64202d-9f21-4613-9b5d-aae0c40fcb57): created successfully
Jul 02 20:03:45 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-e5d6af0d-5078-45d0-b4c5-e08648c695e7 tempest-VolumeAndVolumeTypeFromImageTest-1200324854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b7ca9ea-4be0-4692-b2c1-e0267c207e2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:03:45 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-e5d6af0d-5078-45d0-b4c5-e08648c695e7 tempest-VolumeAndVolumeTypeFromImageTest-1200324854 None] Flow 'volume_create_manager' (ed7520de-4de6-4c00-ab15-de6d97599806) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 20:03:45 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-e5d6af0d-5078-45d0-b4c5-e08648c695e7 tempest-VolumeAndVolumeTypeFromImageTest-1200324854 None] Created volume successfully.
Jul 02 20:03:45 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-74e5a90b-8dd0-48b1-adda-d568372c0474 tempest-VolumeAndVolumeTypeFromImageTest-1200324854 None] Acquiring lock "cinder-dc64202d-9f21-4613-9b5d-aae0c40fcb57-delete_volume" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 20:03:45 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-74e5a90b-8dd0-48b1-adda-d568372c0474 tempest-VolumeAndVolumeTypeFromImageTest-1200324854 None] Lock "cinder-dc64202d-9f21-4613-9b5d-aae0c40fcb57-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 20:03:45 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-74e5a90b-8dd0-48b1-adda-d568372c0474 tempest-VolumeAndVolumeTypeFromImageTest-1200324854 None] Acquiring lock "cinder-quobyte-dc64202d-9f21-4613-9b5d-aae0c40fcb57" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 20:03:45 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-74e5a90b-8dd0-48b1-adda-d568372c0474 tempest-VolumeAndVolumeTypeFromImageTest-1200324854 None] Lock "cinder-quobyte-dc64202d-9f21-4613-9b5d-aae0c40fcb57" acquired by "delete_volume" :: waited 0.019s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 20:03:45 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9bb67dc-0e8f-4fda-bf3f-ead39d83a081]: (4, 'raw') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 20:03:45 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-74e5a90b-8dd0-48b1-adda-d568372c0474 tempest-VolumeAndVolumeTypeFromImageTest-1200324854 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-dc64202d-9f21-4613-9b5d-aae0c40fcb57 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:03:46 devstack sudo[106523]: pam_unix(sudo:session): session closed for user root
Jul 02 20:03:46 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-2897a845-a7e2-4616-8469-760abeb1e1c4 tempest-SnapshotDependencyTests-209878434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e" returned: 0 in 0.768s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:03:46 devstack cinder-volume[86639]: DEBUG cinder.manager [None req-2897a845-a7e2-4616-8469-760abeb1e1c4 tempest-SnapshotDependencyTests-209878434 None] Notifying Schedulers of capabilities ... {{(pid=86639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 20:03:46 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-2897a845-a7e2-4616-8469-760abeb1e1c4 tempest-SnapshotDependencyTests-209878434 None] Deleted volume successfully.
Jul 02 20:03:46 devstack sudo[106526]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-dc64202d-9f21-4613-9b5d-aae0c40fcb57
Jul 02 20:03:46 devstack sudo[106526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:03:46 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-2897a845-a7e2-4616-8469-760abeb1e1c4 tempest-SnapshotDependencyTests-209878434 None] Lock "cinder-7a6df9cb-6c17-4bdf-8f09-f39b9153ecce-delete_volume" released by "delete_volume" :: held 2.597s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 20:03:46 devstack sudo[106526]: pam_unix(sudo:session): session closed for user root
Jul 02 20:03:46 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-74e5a90b-8dd0-48b1-adda-d568372c0474 tempest-VolumeAndVolumeTypeFromImageTest-1200324854 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-dc64202d-9f21-4613-9b5d-aae0c40fcb57" returned: 0 in 0.857s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:03:46 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-74e5a90b-8dd0-48b1-adda-d568372c0474 tempest-VolumeAndVolumeTypeFromImageTest-1200324854 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-dc64202d-9f21-4613-9b5d-aae0c40fcb57 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:03:46 devstack sudo[106530]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-dc64202d-9f21-4613-9b5d-aae0c40fcb57
Jul 02 20:03:46 devstack sudo[106530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:03:47 devstack sudo[106530]: pam_unix(sudo:session): session closed for user root
Jul 02 20:03:47 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-74e5a90b-8dd0-48b1-adda-d568372c0474 tempest-VolumeAndVolumeTypeFromImageTest-1200324854 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-dc64202d-9f21-4613-9b5d-aae0c40fcb57" returned: 1 in 0.837s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:03:47 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-74e5a90b-8dd0-48b1-adda-d568372c0474 tempest-VolumeAndVolumeTypeFromImageTest-1200324854 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-dc64202d-9f21-4613-9b5d-aae0c40fcb57' failed. Not Retrying. {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 02 20:03:47 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-74e5a90b-8dd0-48b1-adda-d568372c0474 tempest-VolumeAndVolumeTypeFromImageTest-1200324854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-dc64202d-9f21-4613-9b5d-aae0c40fcb57 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:03:47 devstack sudo[106536]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-dc64202d-9f21-4613-9b5d-aae0c40fcb57
Jul 02 20:03:47 devstack sudo[106536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:03:48 devstack sudo[106536]: pam_unix(sudo:session): session closed for user root
Jul 02 20:03:48 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-74e5a90b-8dd0-48b1-adda-d568372c0474 tempest-VolumeAndVolumeTypeFromImageTest-1200324854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-dc64202d-9f21-4613-9b5d-aae0c40fcb57" returned: 0 in 0.684s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:03:48 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-74e5a90b-8dd0-48b1-adda-d568372c0474 tempest-VolumeAndVolumeTypeFromImageTest-1200324854 None] Lock "cinder-quobyte-dc64202d-9f21-4613-9b5d-aae0c40fcb57" released by "delete_volume" :: held 2.499s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 20:03:48 devstack cinder-volume[86639]: WARNING cinder.quota [None req-74e5a90b-8dd0-48b1-adda-d568372c0474 tempest-VolumeAndVolumeTypeFromImageTest-1200324854 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota.
Jul 02 20:03:48 devstack cinder-volume[86639]: WARNING cinder.quota [None req-74e5a90b-8dd0-48b1-adda-d568372c0474 tempest-VolumeAndVolumeTypeFromImageTest-1200324854 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota.
Jul 02 20:03:48 devstack cinder-volume[86639]: DEBUG cinder.quota [None req-74e5a90b-8dd0-48b1-adda-d568372c0474 tempest-VolumeAndVolumeTypeFromImageTest-1200324854 None] Created reservations ['80490168-8b6b-4afe-9c38-530d42a7a55e', '1370c226-a3fe-449a-a575-5afffd1bfa12', 'a31ee37b-458c-4118-a523-8c12ea45224c', '7e40c11b-92db-4eef-88ff-d4a34be0e75b'] {{(pid=86639) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 20:03:48 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-74e5a90b-8dd0-48b1-adda-d568372c0474 tempest-VolumeAndVolumeTypeFromImageTest-1200324854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 20:03:48 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-74e5a90b-8dd0-48b1-adda-d568372c0474 tempest-VolumeAndVolumeTypeFromImageTest-1200324854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 20:03:48 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-74e5a90b-8dd0-48b1-adda-d568372c0474 tempest-VolumeAndVolumeTypeFromImageTest-1200324854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 20:03:48 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-74e5a90b-8dd0-48b1-adda-d568372c0474 tempest-VolumeAndVolumeTypeFromImageTest-1200324854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 20:03:48 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-74e5a90b-8dd0-48b1-adda-d568372c0474 tempest-VolumeAndVolumeTypeFromImageTest-1200324854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 20:03:48 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-74e5a90b-8dd0-48b1-adda-d568372c0474 tempest-VolumeAndVolumeTypeFromImageTest-1200324854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:03:48 devstack sudo[106540]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e
Jul 02 20:03:48 devstack sudo[106540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:03:49 devstack sudo[106540]: pam_unix(sudo:session): session closed for user root
Jul 02 20:03:49 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-74e5a90b-8dd0-48b1-adda-d568372c0474 tempest-VolumeAndVolumeTypeFromImageTest-1200324854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e" returned: 0 in 0.731s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:03:49 devstack cinder-volume[86639]: DEBUG cinder.manager [None req-74e5a90b-8dd0-48b1-adda-d568372c0474 tempest-VolumeAndVolumeTypeFromImageTest-1200324854 None] Notifying Schedulers of capabilities ... {{(pid=86639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 20:03:49 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-74e5a90b-8dd0-48b1-adda-d568372c0474 tempest-VolumeAndVolumeTypeFromImageTest-1200324854 None] Deleted volume successfully.
Jul 02 20:03:49 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-74e5a90b-8dd0-48b1-adda-d568372c0474 tempest-VolumeAndVolumeTypeFromImageTest-1200324854 None] Lock "cinder-dc64202d-9f21-4613-9b5d-aae0c40fcb57-delete_volume" released by "delete_volume" :: held 3.514s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 20:03:53 devstack cinder-volume[86639]: DEBUG cinder.volume.flows.manager.create_volume [None req-354186a2-2d37-48b9-9fbd-946a48ffd26d tempest-CreateVolumesFromImageTest-1867995240 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 20:03:53 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-354186a2-2d37-48b9-9fbd-946a48ffd26d tempest-CreateVolumesFromImageTest-1867995240 None] Flow 'volume_create_manager' (c3ffab12-02e5-42d7-9b99-50d1ae50336c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 20:03:53 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-354186a2-2d37-48b9-9fbd-946a48ffd26d tempest-CreateVolumesFromImageTest-1867995240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e9e7377-836b-4234-b0d7-84e54fc7ba0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:03:53 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-354186a2-2d37-48b9-9fbd-946a48ffd26d tempest-CreateVolumesFromImageTest-1867995240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e9e7377-836b-4234-b0d7-84e54fc7ba0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T18:03:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-833610666',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31525b11-d367-4462-b37f-5d77cc097493,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8a101d5a8964ec0ae9ce21ee68ccc61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T18:03:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T18:03:54Z,use_quota=True,user_id='e62e3696b33e4c619fd0005390e8451f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:03:53 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-354186a2-2d37-48b9-9fbd-946a48ffd26d tempest-CreateVolumesFromImageTest-1867995240 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45a7d649-4700-485a-8475-93d7e787181d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:03:53 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-354186a2-2d37-48b9-9fbd-946a48ffd26d tempest-CreateVolumesFromImageTest-1867995240 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45a7d649-4700-485a-8475-93d7e787181d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:03:53 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-354186a2-2d37-48b9-9fbd-946a48ffd26d tempest-CreateVolumesFromImageTest-1867995240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (835d0f66-6a7b-4da3-93cf-51cfa656f542) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:03:53 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-354186a2-2d37-48b9-9fbd-946a48ffd26d tempest-CreateVolumesFromImageTest-1867995240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (835d0f66-6a7b-4da3-93cf-51cfa656f542) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '31525b11-d367-4462-b37f-5d77cc097493', 'volume_name': 'volume-31525b11-d367-4462-b37f-5d77cc097493', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:03:53 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-354186a2-2d37-48b9-9fbd-946a48ffd26d tempest-CreateVolumesFromImageTest-1867995240 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (661e2f57-c303-4b4a-a921-f0e9e98bd0db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:03:54 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-354186a2-2d37-48b9-9fbd-946a48ffd26d tempest-CreateVolumesFromImageTest-1867995240 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (661e2f57-c303-4b4a-a921-f0e9e98bd0db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:03:54 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-354186a2-2d37-48b9-9fbd-946a48ffd26d tempest-CreateVolumesFromImageTest-1867995240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d038356-b044-4fff-93d3-19b5bf5dd853) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:03:54 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-354186a2-2d37-48b9-9fbd-946a48ffd26d tempest-CreateVolumesFromImageTest-1867995240 None] Volume 31525b11-d367-4462-b37f-5d77cc097493: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-31525b11-d367-4462-b37f-5d77cc097493', 'volume_size': 1}
Jul 02 20:03:54 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-354186a2-2d37-48b9-9fbd-946a48ffd26d tempest-CreateVolumesFromImageTest-1867995240 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 20:03:54 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-354186a2-2d37-48b9-9fbd-946a48ffd26d tempest-CreateVolumesFromImageTest-1867995240 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 20:03:54 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-354186a2-2d37-48b9-9fbd-946a48ffd26d tempest-CreateVolumesFromImageTest-1867995240 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce906cb830>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T18:03:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-833610666',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31525b11-d367-4462-b37f-5d77cc097493,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8a101d5a8964ec0ae9ce21ee68ccc61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T18:03:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T18:03:54Z,use_quota=True,user_id='e62e3696b33e4c619fd0005390e8451f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)}" {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 20:03:54 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-354186a2-2d37-48b9-9fbd-946a48ffd26d tempest-CreateVolumesFromImageTest-1867995240 None] Creating volume 31525b11-d367-4462-b37f-5d77cc097493 {{(pid=86639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 20:03:54 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-354186a2-2d37-48b9-9fbd-946a48ffd26d tempest-CreateVolumesFromImageTest-1867995240 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 20:03:54 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-354186a2-2d37-48b9-9fbd-946a48ffd26d tempest-CreateVolumesFromImageTest-1867995240 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 20:03:54 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-354186a2-2d37-48b9-9fbd-946a48ffd26d tempest-CreateVolumesFromImageTest-1867995240 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 20:03:54 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-354186a2-2d37-48b9-9fbd-946a48ffd26d tempest-CreateVolumesFromImageTest-1867995240 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 20:03:54 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-354186a2-2d37-48b9-9fbd-946a48ffd26d tempest-CreateVolumesFromImageTest-1867995240 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 20:03:54 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-354186a2-2d37-48b9-9fbd-946a48ffd26d tempest-CreateVolumesFromImageTest-1867995240 None] Selected osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92 as target Quobyte volume. {{(pid=86639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 20:03:54 devstack cinder-volume[86639]: INFO cinder.volume.drivers.remotefs [None req-354186a2-2d37-48b9-9fbd-946a48ffd26d tempest-CreateVolumesFromImageTest-1867995240 None] casted to osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92
Jul 02 20:03:54 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-354186a2-2d37-48b9-9fbd-946a48ffd26d tempest-CreateVolumesFromImageTest-1867995240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-31525b11-d367-4462-b37f-5d77cc097493 1073741824 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:03:54 devstack sudo[106548]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-31525b11-d367-4462-b37f-5d77cc097493 1073741824
Jul 02 20:03:54 devstack sudo[106548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:03:54 devstack cinder-volume[86639]: DEBUG cinder.volume.flows.manager.create_volume [None req-087bfa37-4b74-4304-8e37-e958150fcb34 tempest-CreateVolumesFromImageTest-1867995240 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 20:03:54 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-087bfa37-4b74-4304-8e37-e958150fcb34 tempest-CreateVolumesFromImageTest-1867995240 None] Flow 'volume_create_manager' (22e32f53-22f0-494f-a81a-61a24f2903e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 20:03:54 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-087bfa37-4b74-4304-8e37-e958150fcb34 tempest-CreateVolumesFromImageTest-1867995240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (582d9dee-693f-4dcf-a9d1-295294c47d05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:03:54 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-087bfa37-4b74-4304-8e37-e958150fcb34 tempest-CreateVolumesFromImageTest-1867995240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (582d9dee-693f-4dcf-a9d1-295294c47d05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T18:03:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1828455436',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5afb4018-b7dc-4d6b-9a6f-45ede4ff0866,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8a101d5a8964ec0ae9ce21ee68ccc61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T18:03:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T18:03:54Z,use_quota=True,user_id='e62e3696b33e4c619fd0005390e8451f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:03:54 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-087bfa37-4b74-4304-8e37-e958150fcb34 tempest-CreateVolumesFromImageTest-1867995240 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22a4c431-b0f6-4748-86f1-a68a21c1bf06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:03:54 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-087bfa37-4b74-4304-8e37-e958150fcb34 tempest-CreateVolumesFromImageTest-1867995240 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22a4c431-b0f6-4748-86f1-a68a21c1bf06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:03:54 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-087bfa37-4b74-4304-8e37-e958150fcb34 tempest-CreateVolumesFromImageTest-1867995240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73439646-de93-4952-a3f5-99e6166fe4a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:03:54 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-087bfa37-4b74-4304-8e37-e958150fcb34 tempest-CreateVolumesFromImageTest-1867995240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73439646-de93-4952-a3f5-99e6166fe4a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5afb4018-b7dc-4d6b-9a6f-45ede4ff0866', 'volume_name': 'volume-5afb4018-b7dc-4d6b-9a6f-45ede4ff0866', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:03:54 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-087bfa37-4b74-4304-8e37-e958150fcb34 tempest-CreateVolumesFromImageTest-1867995240 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11e6286e-1223-44c9-b22e-cd25a9c2f463) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:03:54 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-087bfa37-4b74-4304-8e37-e958150fcb34 tempest-CreateVolumesFromImageTest-1867995240 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11e6286e-1223-44c9-b22e-cd25a9c2f463) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:03:54 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-087bfa37-4b74-4304-8e37-e958150fcb34 tempest-CreateVolumesFromImageTest-1867995240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7be47a91-18ef-44eb-8ba2-4eef2da38f56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:03:54 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-087bfa37-4b74-4304-8e37-e958150fcb34 tempest-CreateVolumesFromImageTest-1867995240 None] Volume 5afb4018-b7dc-4d6b-9a6f-45ede4ff0866: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5afb4018-b7dc-4d6b-9a6f-45ede4ff0866', 'volume_size': 1}
Jul 02 20:03:54 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-087bfa37-4b74-4304-8e37-e958150fcb34 tempest-CreateVolumesFromImageTest-1867995240 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 20:03:54 devstack cinder-volume[86639]: DEBUG cinder.volume.flows.manager.create_volume [None req-742f10da-4f2d-48ae-ae0e-11c005382922 tempest-CreateVolumesFromImageTest-1867995240 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 20:03:54 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-742f10da-4f2d-48ae-ae0e-11c005382922 tempest-CreateVolumesFromImageTest-1867995240 None] Flow 'volume_create_manager' (fbf8cfdf-07ed-4552-af5a-42df0b41c184) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 20:03:54 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-742f10da-4f2d-48ae-ae0e-11c005382922 tempest-CreateVolumesFromImageTest-1867995240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06b8897c-cff1-414c-977a-1e63f2e98673) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:03:54 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-742f10da-4f2d-48ae-ae0e-11c005382922 tempest-CreateVolumesFromImageTest-1867995240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06b8897c-cff1-414c-977a-1e63f2e98673) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T18:03:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2044693337',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebdaac90-85fd-4264-9193-aa8e9eb927fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8a101d5a8964ec0ae9ce21ee68ccc61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T18:03:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T18:03:55Z,use_quota=True,user_id='e62e3696b33e4c619fd0005390e8451f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:03:54 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-742f10da-4f2d-48ae-ae0e-11c005382922 tempest-CreateVolumesFromImageTest-1867995240 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa53233c-4dab-4b4a-be5f-8d275b94659c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:03:54 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-742f10da-4f2d-48ae-ae0e-11c005382922 tempest-CreateVolumesFromImageTest-1867995240 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa53233c-4dab-4b4a-be5f-8d275b94659c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:03:54 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-742f10da-4f2d-48ae-ae0e-11c005382922 tempest-CreateVolumesFromImageTest-1867995240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f194a8cc-a000-4454-8ec6-d0eb0dc91c8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:03:54 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-742f10da-4f2d-48ae-ae0e-11c005382922 tempest-CreateVolumesFromImageTest-1867995240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f194a8cc-a000-4454-8ec6-d0eb0dc91c8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ebdaac90-85fd-4264-9193-aa8e9eb927fd', 'volume_name': 'volume-ebdaac90-85fd-4264-9193-aa8e9eb927fd', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:03:54 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-742f10da-4f2d-48ae-ae0e-11c005382922 tempest-CreateVolumesFromImageTest-1867995240 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (094d1708-a36e-4307-8bf2-e639e9c95505) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:03:54 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-742f10da-4f2d-48ae-ae0e-11c005382922 tempest-CreateVolumesFromImageTest-1867995240 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (094d1708-a36e-4307-8bf2-e639e9c95505) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:03:54 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-742f10da-4f2d-48ae-ae0e-11c005382922 tempest-CreateVolumesFromImageTest-1867995240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e81feca-ddf9-4ebd-b25e-be03ff3b3e02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:03:54 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-742f10da-4f2d-48ae-ae0e-11c005382922 tempest-CreateVolumesFromImageTest-1867995240 None] Volume ebdaac90-85fd-4264-9193-aa8e9eb927fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ebdaac90-85fd-4264-9193-aa8e9eb927fd', 'volume_size': 1}
Jul 02 20:03:54 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-742f10da-4f2d-48ae-ae0e-11c005382922 tempest-CreateVolumesFromImageTest-1867995240 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 20:03:55 devstack sudo[106548]: pam_unix(sudo:session): session closed for user root
Jul 02 20:03:55 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-354186a2-2d37-48b9-9fbd-946a48ffd26d tempest-CreateVolumesFromImageTest-1867995240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-31525b11-d367-4462-b37f-5d77cc097493 1073741824" returned: 0 in 1.086s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:03:55 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-354186a2-2d37-48b9-9fbd-946a48ffd26d tempest-CreateVolumesFromImageTest-1867995240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-31525b11-d367-4462-b37f-5d77cc097493 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:03:55 devstack sudo[106557]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-31525b11-d367-4462-b37f-5d77cc097493
Jul 02 20:03:55 devstack sudo[106557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:03:55 devstack cinder-volume[86639]: DEBUG cinder.volume.flows.manager.create_volume [None req-d1c43dd0-7940-4fdb-906c-4bfccbde2416 tempest-CreateVolumesFromImageTest-1867995240 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 20:03:55 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-d1c43dd0-7940-4fdb-906c-4bfccbde2416 tempest-CreateVolumesFromImageTest-1867995240 None] Flow 'volume_create_manager' (177ca309-1f24-46e1-b6ce-696d611abb74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 20:03:55 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-d1c43dd0-7940-4fdb-906c-4bfccbde2416 tempest-CreateVolumesFromImageTest-1867995240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00418b8a-4aaa-47b8-96e9-cc4f2389e702) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:03:55 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-d1c43dd0-7940-4fdb-906c-4bfccbde2416 tempest-CreateVolumesFromImageTest-1867995240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00418b8a-4aaa-47b8-96e9-cc4f2389e702) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T18:03:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1660037592',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64047065-3df1-4988-977e-e8de44849615,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8a101d5a8964ec0ae9ce21ee68ccc61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T18:03:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T18:03:55Z,use_quota=True,user_id='e62e3696b33e4c619fd0005390e8451f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:03:55 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-d1c43dd0-7940-4fdb-906c-4bfccbde2416 tempest-CreateVolumesFromImageTest-1867995240 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5f7af0a-2ead-4d01-85cd-cfe2b867f54b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:03:55 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-d1c43dd0-7940-4fdb-906c-4bfccbde2416 tempest-CreateVolumesFromImageTest-1867995240 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5f7af0a-2ead-4d01-85cd-cfe2b867f54b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:03:55 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-d1c43dd0-7940-4fdb-906c-4bfccbde2416 tempest-CreateVolumesFromImageTest-1867995240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b74ad08-31d4-426e-8ca8-a4b437d09129) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:03:55 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-d1c43dd0-7940-4fdb-906c-4bfccbde2416 tempest-CreateVolumesFromImageTest-1867995240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b74ad08-31d4-426e-8ca8-a4b437d09129) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '64047065-3df1-4988-977e-e8de44849615', 'volume_name': 'volume-64047065-3df1-4988-977e-e8de44849615', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:03:55 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-d1c43dd0-7940-4fdb-906c-4bfccbde2416 tempest-CreateVolumesFromImageTest-1867995240 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27c1f985-b323-4e14-889e-1bbad6edc191) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:03:55 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-d1c43dd0-7940-4fdb-906c-4bfccbde2416 tempest-CreateVolumesFromImageTest-1867995240 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27c1f985-b323-4e14-889e-1bbad6edc191) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:03:55 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-d1c43dd0-7940-4fdb-906c-4bfccbde2416 tempest-CreateVolumesFromImageTest-1867995240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7201475d-a52a-4c91-8515-e04d3705749a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:03:55 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-d1c43dd0-7940-4fdb-906c-4bfccbde2416 tempest-CreateVolumesFromImageTest-1867995240 None] Volume 64047065-3df1-4988-977e-e8de44849615: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-64047065-3df1-4988-977e-e8de44849615', 'volume_size': 1}
Jul 02 20:03:55 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-d1c43dd0-7940-4fdb-906c-4bfccbde2416 tempest-CreateVolumesFromImageTest-1867995240 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 20:03:55 devstack cinder-volume[86639]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5293416-5c39-4c25-a29a-fbe4febd106d tempest-CreateVolumesFromImageTest-1867995240 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 20:03:55 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-e5293416-5c39-4c25-a29a-fbe4febd106d tempest-CreateVolumesFromImageTest-1867995240 None] Flow 'volume_create_manager' (e058a838-5761-4eff-be14-3bac7ea5225c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 20:03:55 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-e5293416-5c39-4c25-a29a-fbe4febd106d tempest-CreateVolumesFromImageTest-1867995240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5695533-4f3d-4525-86eb-3dfcc12519da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:03:55 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-e5293416-5c39-4c25-a29a-fbe4febd106d tempest-CreateVolumesFromImageTest-1867995240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5695533-4f3d-4525-86eb-3dfcc12519da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T18:03:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-105987753',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6a7ccb8-b61e-4ff4-8dff-934547ee5fa9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8a101d5a8964ec0ae9ce21ee68ccc61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T18:03:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T18:03:56Z,use_quota=True,user_id='e62e3696b33e4c619fd0005390e8451f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:03:55 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-e5293416-5c39-4c25-a29a-fbe4febd106d tempest-CreateVolumesFromImageTest-1867995240 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0ec9aba-9ae5-47e7-a236-81c9f38990e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:03:55 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-e5293416-5c39-4c25-a29a-fbe4febd106d tempest-CreateVolumesFromImageTest-1867995240 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0ec9aba-9ae5-47e7-a236-81c9f38990e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:03:55 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-e5293416-5c39-4c25-a29a-fbe4febd106d tempest-CreateVolumesFromImageTest-1867995240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd3bbef1-d6be-4a1e-beee-17a8b37af292) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:03:55 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-e5293416-5c39-4c25-a29a-fbe4febd106d tempest-CreateVolumesFromImageTest-1867995240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd3bbef1-d6be-4a1e-beee-17a8b37af292) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a6a7ccb8-b61e-4ff4-8dff-934547ee5fa9', 'volume_name': 'volume-a6a7ccb8-b61e-4ff4-8dff-934547ee5fa9', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:03:55 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-e5293416-5c39-4c25-a29a-fbe4febd106d tempest-CreateVolumesFromImageTest-1867995240 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (576a631b-cfae-4096-a7ea-a12b26f8cf83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:03:55 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-e5293416-5c39-4c25-a29a-fbe4febd106d tempest-CreateVolumesFromImageTest-1867995240 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (576a631b-cfae-4096-a7ea-a12b26f8cf83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:03:55 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-e5293416-5c39-4c25-a29a-fbe4febd106d tempest-CreateVolumesFromImageTest-1867995240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b38227f-79a3-4e7d-97a1-33ed77b3f01d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:03:55 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-e5293416-5c39-4c25-a29a-fbe4febd106d tempest-CreateVolumesFromImageTest-1867995240 None] Volume a6a7ccb8-b61e-4ff4-8dff-934547ee5fa9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a6a7ccb8-b61e-4ff4-8dff-934547ee5fa9', 'volume_size': 1}
Jul 02 20:03:55 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-e5293416-5c39-4c25-a29a-fbe4febd106d tempest-CreateVolumesFromImageTest-1867995240 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 20:03:55 devstack sudo[106557]: pam_unix(sudo:session): session closed for user root
Jul 02 20:03:55 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-354186a2-2d37-48b9-9fbd-946a48ffd26d tempest-CreateVolumesFromImageTest-1867995240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-31525b11-d367-4462-b37f-5d77cc097493" returned: 0 in 0.825s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:03:55 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-354186a2-2d37-48b9-9fbd-946a48ffd26d tempest-CreateVolumesFromImageTest-1867995240 None] <== create_volume: return (1964ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'} {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 20:03:55 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-354186a2-2d37-48b9-9fbd-946a48ffd26d tempest-CreateVolumesFromImageTest-1867995240 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.967s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 20:03:55 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-087bfa37-4b74-4304-8e37-e958150fcb34 tempest-CreateVolumesFromImageTest-1867995240 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.529s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 20:03:55 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-087bfa37-4b74-4304-8e37-e958150fcb34 tempest-CreateVolumesFromImageTest-1867995240 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce906cb830>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T18:03:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1828455436',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5afb4018-b7dc-4d6b-9a6f-45ede4ff0866,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8a101d5a8964ec0ae9ce21ee68ccc61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T18:03:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T18:03:54Z,use_quota=True,user_id='e62e3696b33e4c619fd0005390e8451f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)}" {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 20:03:55 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-087bfa37-4b74-4304-8e37-e958150fcb34 tempest-CreateVolumesFromImageTest-1867995240 None] Creating volume 5afb4018-b7dc-4d6b-9a6f-45ede4ff0866 {{(pid=86639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 20:03:55 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-087bfa37-4b74-4304-8e37-e958150fcb34 tempest-CreateVolumesFromImageTest-1867995240 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 20:03:55 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-087bfa37-4b74-4304-8e37-e958150fcb34 tempest-CreateVolumesFromImageTest-1867995240 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 20:03:55 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-087bfa37-4b74-4304-8e37-e958150fcb34 tempest-CreateVolumesFromImageTest-1867995240 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 20:03:55 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-087bfa37-4b74-4304-8e37-e958150fcb34 tempest-CreateVolumesFromImageTest-1867995240 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 20:03:55 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-087bfa37-4b74-4304-8e37-e958150fcb34 tempest-CreateVolumesFromImageTest-1867995240 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 20:03:55 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-087bfa37-4b74-4304-8e37-e958150fcb34 tempest-CreateVolumesFromImageTest-1867995240 None] Selected osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92 as target Quobyte volume. {{(pid=86639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 20:03:55 devstack cinder-volume[86639]: INFO cinder.volume.drivers.remotefs [None req-087bfa37-4b74-4304-8e37-e958150fcb34 tempest-CreateVolumesFromImageTest-1867995240 None] casted to osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92
Jul 02 20:03:55 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-087bfa37-4b74-4304-8e37-e958150fcb34 tempest-CreateVolumesFromImageTest-1867995240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-5afb4018-b7dc-4d6b-9a6f-45ede4ff0866 1073741824 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:03:56 devstack sudo[106560]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-5afb4018-b7dc-4d6b-9a6f-45ede4ff0866 1073741824
Jul 02 20:03:56 devstack sudo[106560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:03:56 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-354186a2-2d37-48b9-9fbd-946a48ffd26d tempest-CreateVolumesFromImageTest-1867995240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d038356-b044-4fff-93d3-19b5bf5dd853) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31525b11-d367-4462-b37f-5d77cc097493', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:03:56 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-354186a2-2d37-48b9-9fbd-946a48ffd26d tempest-CreateVolumesFromImageTest-1867995240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05097f13-5a74-499d-816a-36fdc139f450) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:03:56 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-354186a2-2d37-48b9-9fbd-946a48ffd26d tempest-CreateVolumesFromImageTest-1867995240 None] Volume volume-31525b11-d367-4462-b37f-5d77cc097493 (31525b11-d367-4462-b37f-5d77cc097493): created successfully
Jul 02 20:03:56 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-354186a2-2d37-48b9-9fbd-946a48ffd26d tempest-CreateVolumesFromImageTest-1867995240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05097f13-5a74-499d-816a-36fdc139f450) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:03:56 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-354186a2-2d37-48b9-9fbd-946a48ffd26d tempest-CreateVolumesFromImageTest-1867995240 None] Flow 'volume_create_manager' (c3ffab12-02e5-42d7-9b99-50d1ae50336c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 20:03:56 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-354186a2-2d37-48b9-9fbd-946a48ffd26d tempest-CreateVolumesFromImageTest-1867995240 None] Created volume successfully.
Jul 02 20:03:56 devstack sudo[106560]: pam_unix(sudo:session): session closed for user root
Jul 02 20:03:56 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-087bfa37-4b74-4304-8e37-e958150fcb34 tempest-CreateVolumesFromImageTest-1867995240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-5afb4018-b7dc-4d6b-9a6f-45ede4ff0866 1073741824" returned: 0 in 0.841s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:03:56 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-087bfa37-4b74-4304-8e37-e958150fcb34 tempest-CreateVolumesFromImageTest-1867995240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-5afb4018-b7dc-4d6b-9a6f-45ede4ff0866 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:03:56 devstack sudo[106566]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-5afb4018-b7dc-4d6b-9a6f-45ede4ff0866
Jul 02 20:03:56 devstack sudo[106566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:03:57 devstack sudo[106566]: pam_unix(sudo:session): session closed for user root
Jul 02 20:03:57 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-087bfa37-4b74-4304-8e37-e958150fcb34 tempest-CreateVolumesFromImageTest-1867995240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-5afb4018-b7dc-4d6b-9a6f-45ede4ff0866" returned: 0 in 0.624s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:03:57 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-087bfa37-4b74-4304-8e37-e958150fcb34 tempest-CreateVolumesFromImageTest-1867995240 None] <== create_volume: return (1509ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'} {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 20:03:57 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-087bfa37-4b74-4304-8e37-e958150fcb34 tempest-CreateVolumesFromImageTest-1867995240 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.512s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 20:03:57 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-742f10da-4f2d-48ae-ae0e-11c005382922 tempest-CreateVolumesFromImageTest-1867995240 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.575s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 20:03:57 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-742f10da-4f2d-48ae-ae0e-11c005382922 tempest-CreateVolumesFromImageTest-1867995240 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce906cb830>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T18:03:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2044693337',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebdaac90-85fd-4264-9193-aa8e9eb927fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8a101d5a8964ec0ae9ce21ee68ccc61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T18:03:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T18:03:55Z,use_quota=True,user_id='e62e3696b33e4c619fd0005390e8451f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)}" {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 20:03:57 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-742f10da-4f2d-48ae-ae0e-11c005382922 tempest-CreateVolumesFromImageTest-1867995240 None] Creating volume ebdaac90-85fd-4264-9193-aa8e9eb927fd {{(pid=86639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 20:03:57 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-742f10da-4f2d-48ae-ae0e-11c005382922 tempest-CreateVolumesFromImageTest-1867995240 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 20:03:57 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-742f10da-4f2d-48ae-ae0e-11c005382922 tempest-CreateVolumesFromImageTest-1867995240 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 20:03:57 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-742f10da-4f2d-48ae-ae0e-11c005382922 tempest-CreateVolumesFromImageTest-1867995240 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 20:03:57 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-742f10da-4f2d-48ae-ae0e-11c005382922 tempest-CreateVolumesFromImageTest-1867995240 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 20:03:57 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-742f10da-4f2d-48ae-ae0e-11c005382922 tempest-CreateVolumesFromImageTest-1867995240 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 20:03:57 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-742f10da-4f2d-48ae-ae0e-11c005382922 tempest-CreateVolumesFromImageTest-1867995240 None] Selected osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92 as target Quobyte volume. {{(pid=86639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 20:03:57 devstack cinder-volume[86639]: INFO cinder.volume.drivers.remotefs [None req-742f10da-4f2d-48ae-ae0e-11c005382922 tempest-CreateVolumesFromImageTest-1867995240 None] casted to osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92
Jul 02 20:03:57 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-742f10da-4f2d-48ae-ae0e-11c005382922 tempest-CreateVolumesFromImageTest-1867995240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-ebdaac90-85fd-4264-9193-aa8e9eb927fd 1073741824 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:03:57 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-087bfa37-4b74-4304-8e37-e958150fcb34 tempest-CreateVolumesFromImageTest-1867995240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7be47a91-18ef-44eb-8ba2-4eef2da38f56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5afb4018-b7dc-4d6b-9a6f-45ede4ff0866', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:03:57 devstack sudo[106569]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-ebdaac90-85fd-4264-9193-aa8e9eb927fd 1073741824
Jul 02 20:03:57 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-087bfa37-4b74-4304-8e37-e958150fcb34 tempest-CreateVolumesFromImageTest-1867995240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a38e8e7e-fb0a-45c4-be31-75eaad76b747) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:03:57 devstack sudo[106569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:03:57 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-087bfa37-4b74-4304-8e37-e958150fcb34 tempest-CreateVolumesFromImageTest-1867995240 None] Volume volume-5afb4018-b7dc-4d6b-9a6f-45ede4ff0866 (5afb4018-b7dc-4d6b-9a6f-45ede4ff0866): created successfully
Jul 02 20:03:57 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-087bfa37-4b74-4304-8e37-e958150fcb34 tempest-CreateVolumesFromImageTest-1867995240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a38e8e7e-fb0a-45c4-be31-75eaad76b747) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:03:57 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-087bfa37-4b74-4304-8e37-e958150fcb34 tempest-CreateVolumesFromImageTest-1867995240 None] Flow 'volume_create_manager' (22e32f53-22f0-494f-a81a-61a24f2903e4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 20:03:57 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-087bfa37-4b74-4304-8e37-e958150fcb34 tempest-CreateVolumesFromImageTest-1867995240 None] Created volume successfully.
Jul 02 20:03:58 devstack sudo[106569]: pam_unix(sudo:session): session closed for user root
Jul 02 20:03:58 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-742f10da-4f2d-48ae-ae0e-11c005382922 tempest-CreateVolumesFromImageTest-1867995240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-ebdaac90-85fd-4264-9193-aa8e9eb927fd 1073741824" returned: 0 in 0.813s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:03:58 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-742f10da-4f2d-48ae-ae0e-11c005382922 tempest-CreateVolumesFromImageTest-1867995240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-ebdaac90-85fd-4264-9193-aa8e9eb927fd {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:03:58 devstack sudo[106575]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-ebdaac90-85fd-4264-9193-aa8e9eb927fd
Jul 02 20:03:58 devstack sudo[106575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:03:59 devstack sudo[106575]: pam_unix(sudo:session): session closed for user root
Jul 02 20:03:59 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-742f10da-4f2d-48ae-ae0e-11c005382922 tempest-CreateVolumesFromImageTest-1867995240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-ebdaac90-85fd-4264-9193-aa8e9eb927fd" returned: 0 in 0.709s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:03:59 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-742f10da-4f2d-48ae-ae0e-11c005382922 tempest-CreateVolumesFromImageTest-1867995240 None] <== create_volume: return (1562ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'} {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 20:03:59 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-742f10da-4f2d-48ae-ae0e-11c005382922 tempest-CreateVolumesFromImageTest-1867995240 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.566s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 20:03:59 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-d1c43dd0-7940-4fdb-906c-4bfccbde2416 tempest-CreateVolumesFromImageTest-1867995240 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.668s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 20:03:59 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-d1c43dd0-7940-4fdb-906c-4bfccbde2416 tempest-CreateVolumesFromImageTest-1867995240 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce906cb830>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T18:03:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1660037592',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64047065-3df1-4988-977e-e8de44849615,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8a101d5a8964ec0ae9ce21ee68ccc61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T18:03:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T18:03:55Z,use_quota=True,user_id='e62e3696b33e4c619fd0005390e8451f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)}" {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 20:03:59 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-d1c43dd0-7940-4fdb-906c-4bfccbde2416 tempest-CreateVolumesFromImageTest-1867995240 None] Creating volume 64047065-3df1-4988-977e-e8de44849615 {{(pid=86639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 20:03:59 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-d1c43dd0-7940-4fdb-906c-4bfccbde2416 tempest-CreateVolumesFromImageTest-1867995240 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 20:03:59 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-d1c43dd0-7940-4fdb-906c-4bfccbde2416 tempest-CreateVolumesFromImageTest-1867995240 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 20:03:59 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-d1c43dd0-7940-4fdb-906c-4bfccbde2416 tempest-CreateVolumesFromImageTest-1867995240 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 20:03:59 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-d1c43dd0-7940-4fdb-906c-4bfccbde2416 tempest-CreateVolumesFromImageTest-1867995240 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 20:03:59 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-d1c43dd0-7940-4fdb-906c-4bfccbde2416 tempest-CreateVolumesFromImageTest-1867995240 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 20:03:59 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-d1c43dd0-7940-4fdb-906c-4bfccbde2416 tempest-CreateVolumesFromImageTest-1867995240 None] Selected osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92 as target Quobyte volume. {{(pid=86639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 20:03:59 devstack cinder-volume[86639]: INFO cinder.volume.drivers.remotefs [None req-d1c43dd0-7940-4fdb-906c-4bfccbde2416 tempest-CreateVolumesFromImageTest-1867995240 None] casted to osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92
Jul 02 20:03:59 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-d1c43dd0-7940-4fdb-906c-4bfccbde2416 tempest-CreateVolumesFromImageTest-1867995240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-64047065-3df1-4988-977e-e8de44849615 1073741824 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:03:59 devstack sudo[106578]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-64047065-3df1-4988-977e-e8de44849615 1073741824
Jul 02 20:03:59 devstack sudo[106578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:03:59 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-742f10da-4f2d-48ae-ae0e-11c005382922 tempest-CreateVolumesFromImageTest-1867995240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e81feca-ddf9-4ebd-b25e-be03ff3b3e02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ebdaac90-85fd-4264-9193-aa8e9eb927fd', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:03:59 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-742f10da-4f2d-48ae-ae0e-11c005382922 tempest-CreateVolumesFromImageTest-1867995240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f935886-e560-49b8-adce-029782ef6120) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:03:59 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-742f10da-4f2d-48ae-ae0e-11c005382922 tempest-CreateVolumesFromImageTest-1867995240 None] Volume volume-ebdaac90-85fd-4264-9193-aa8e9eb927fd (ebdaac90-85fd-4264-9193-aa8e9eb927fd): created successfully
Jul 02 20:03:59 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-742f10da-4f2d-48ae-ae0e-11c005382922 tempest-CreateVolumesFromImageTest-1867995240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f935886-e560-49b8-adce-029782ef6120) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:03:59 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-742f10da-4f2d-48ae-ae0e-11c005382922 tempest-CreateVolumesFromImageTest-1867995240 None] Flow 'volume_create_manager' (fbf8cfdf-07ed-4552-af5a-42df0b41c184) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 20:03:59 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-742f10da-4f2d-48ae-ae0e-11c005382922 tempest-CreateVolumesFromImageTest-1867995240 None] Created volume successfully.
Jul 02 20:03:59 devstack sudo[106578]: pam_unix(sudo:session): session closed for user root
Jul 02 20:03:59 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-d1c43dd0-7940-4fdb-906c-4bfccbde2416 tempest-CreateVolumesFromImageTest-1867995240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-64047065-3df1-4988-977e-e8de44849615 1073741824" returned: 0 in 0.865s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:03:59 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-d1c43dd0-7940-4fdb-906c-4bfccbde2416 tempest-CreateVolumesFromImageTest-1867995240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-64047065-3df1-4988-977e-e8de44849615 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:04:00 devstack sudo[106584]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-64047065-3df1-4988-977e-e8de44849615
Jul 02 20:04:00 devstack sudo[106584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:04:00 devstack sudo[106584]: pam_unix(sudo:session): session closed for user root
Jul 02 20:04:00 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-d1c43dd0-7940-4fdb-906c-4bfccbde2416 tempest-CreateVolumesFromImageTest-1867995240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-64047065-3df1-4988-977e-e8de44849615" returned: 0 in 0.664s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:04:00 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-d1c43dd0-7940-4fdb-906c-4bfccbde2416 tempest-CreateVolumesFromImageTest-1867995240 None] <== create_volume: return (1572ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'} {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 20:04:00 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-d1c43dd0-7940-4fdb-906c-4bfccbde2416 tempest-CreateVolumesFromImageTest-1867995240 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.576s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 20:04:00 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-e5293416-5c39-4c25-a29a-fbe4febd106d tempest-CreateVolumesFromImageTest-1867995240 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.792s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 20:04:00 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-e5293416-5c39-4c25-a29a-fbe4febd106d tempest-CreateVolumesFromImageTest-1867995240 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce906cb830>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T18:03:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-105987753',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6a7ccb8-b61e-4ff4-8dff-934547ee5fa9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8a101d5a8964ec0ae9ce21ee68ccc61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T18:03:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T18:03:56Z,use_quota=True,user_id='e62e3696b33e4c619fd0005390e8451f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)}" {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 20:04:00 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-e5293416-5c39-4c25-a29a-fbe4febd106d tempest-CreateVolumesFromImageTest-1867995240 None] Creating volume a6a7ccb8-b61e-4ff4-8dff-934547ee5fa9 {{(pid=86639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 20:04:00 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-e5293416-5c39-4c25-a29a-fbe4febd106d tempest-CreateVolumesFromImageTest-1867995240 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 20:04:00 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-e5293416-5c39-4c25-a29a-fbe4febd106d tempest-CreateVolumesFromImageTest-1867995240 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 20:04:00 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-e5293416-5c39-4c25-a29a-fbe4febd106d tempest-CreateVolumesFromImageTest-1867995240 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 20:04:00 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-e5293416-5c39-4c25-a29a-fbe4febd106d tempest-CreateVolumesFromImageTest-1867995240 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 20:04:00 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-e5293416-5c39-4c25-a29a-fbe4febd106d tempest-CreateVolumesFromImageTest-1867995240 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 20:04:00 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-e5293416-5c39-4c25-a29a-fbe4febd106d tempest-CreateVolumesFromImageTest-1867995240 None] Selected osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92 as target Quobyte volume. {{(pid=86639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 20:04:00 devstack cinder-volume[86639]: INFO cinder.volume.drivers.remotefs [None req-e5293416-5c39-4c25-a29a-fbe4febd106d tempest-CreateVolumesFromImageTest-1867995240 None] casted to osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92
Jul 02 20:04:00 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-e5293416-5c39-4c25-a29a-fbe4febd106d tempest-CreateVolumesFromImageTest-1867995240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-a6a7ccb8-b61e-4ff4-8dff-934547ee5fa9 1073741824 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:04:00 devstack sudo[106587]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-a6a7ccb8-b61e-4ff4-8dff-934547ee5fa9 1073741824
Jul 02 20:04:00 devstack sudo[106587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:04:00 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-d1c43dd0-7940-4fdb-906c-4bfccbde2416 tempest-CreateVolumesFromImageTest-1867995240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7201475d-a52a-4c91-8515-e04d3705749a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-64047065-3df1-4988-977e-e8de44849615', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:04:00 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-d1c43dd0-7940-4fdb-906c-4bfccbde2416 tempest-CreateVolumesFromImageTest-1867995240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2e15734-4b66-4fd7-8a8d-d9b29bdf61ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:04:00 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-d1c43dd0-7940-4fdb-906c-4bfccbde2416 tempest-CreateVolumesFromImageTest-1867995240 None] Volume volume-64047065-3df1-4988-977e-e8de44849615 (64047065-3df1-4988-977e-e8de44849615): created successfully
Jul 02 20:04:00 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-d1c43dd0-7940-4fdb-906c-4bfccbde2416 tempest-CreateVolumesFromImageTest-1867995240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2e15734-4b66-4fd7-8a8d-d9b29bdf61ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:04:00 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-d1c43dd0-7940-4fdb-906c-4bfccbde2416 tempest-CreateVolumesFromImageTest-1867995240 None] Flow 'volume_create_manager' (177ca309-1f24-46e1-b6ce-696d611abb74) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 20:04:00 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-d1c43dd0-7940-4fdb-906c-4bfccbde2416 tempest-CreateVolumesFromImageTest-1867995240 None] Created volume successfully.
Jul 02 20:04:01 devstack sudo[106587]: pam_unix(sudo:session): session closed for user root
Jul 02 20:04:01 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-e5293416-5c39-4c25-a29a-fbe4febd106d tempest-CreateVolumesFromImageTest-1867995240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-a6a7ccb8-b61e-4ff4-8dff-934547ee5fa9 1073741824" returned: 0 in 0.865s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:04:01 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-e5293416-5c39-4c25-a29a-fbe4febd106d tempest-CreateVolumesFromImageTest-1867995240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-a6a7ccb8-b61e-4ff4-8dff-934547ee5fa9 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:04:01 devstack sudo[106592]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-a6a7ccb8-b61e-4ff4-8dff-934547ee5fa9
Jul 02 20:04:01 devstack sudo[106592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:04:02 devstack sudo[106592]: pam_unix(sudo:session): session closed for user root
Jul 02 20:04:02 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-e5293416-5c39-4c25-a29a-fbe4febd106d tempest-CreateVolumesFromImageTest-1867995240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-a6a7ccb8-b61e-4ff4-8dff-934547ee5fa9" returned: 0 in 0.687s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:04:02 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-e5293416-5c39-4c25-a29a-fbe4febd106d tempest-CreateVolumesFromImageTest-1867995240 None] <== create_volume: return (1590ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'} {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 20:04:02 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-e5293416-5c39-4c25-a29a-fbe4febd106d tempest-CreateVolumesFromImageTest-1867995240 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.594s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 20:04:02 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-e5293416-5c39-4c25-a29a-fbe4febd106d tempest-CreateVolumesFromImageTest-1867995240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b38227f-79a3-4e7d-97a1-33ed77b3f01d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6a7ccb8-b61e-4ff4-8dff-934547ee5fa9', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:04:02 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-e5293416-5c39-4c25-a29a-fbe4febd106d tempest-CreateVolumesFromImageTest-1867995240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36744bd4-1718-448e-b58d-6709a63e473f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:04:02 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-e5293416-5c39-4c25-a29a-fbe4febd106d tempest-CreateVolumesFromImageTest-1867995240 None] Volume volume-a6a7ccb8-b61e-4ff4-8dff-934547ee5fa9 (a6a7ccb8-b61e-4ff4-8dff-934547ee5fa9): created successfully
Jul 02 20:04:02 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-e5293416-5c39-4c25-a29a-fbe4febd106d tempest-CreateVolumesFromImageTest-1867995240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36744bd4-1718-448e-b58d-6709a63e473f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:04:02 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-e5293416-5c39-4c25-a29a-fbe4febd106d tempest-CreateVolumesFromImageTest-1867995240 None] Flow 'volume_create_manager' (e058a838-5761-4eff-be14-3bac7ea5225c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 20:04:02 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-e5293416-5c39-4c25-a29a-fbe4febd106d tempest-CreateVolumesFromImageTest-1867995240 None] Created volume successfully.
Jul 02 20:04:03 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-9791a665-b025-4c5b-9e55-7615f17e38bf tempest-CreateVolumesFromImageTest-1867995240 None] Acquiring lock "cinder-a6a7ccb8-b61e-4ff4-8dff-934547ee5fa9-delete_volume" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 20:04:03 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-9791a665-b025-4c5b-9e55-7615f17e38bf tempest-CreateVolumesFromImageTest-1867995240 None] Lock "cinder-a6a7ccb8-b61e-4ff4-8dff-934547ee5fa9-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 20:04:03 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-9791a665-b025-4c5b-9e55-7615f17e38bf tempest-CreateVolumesFromImageTest-1867995240 None] Acquiring lock "cinder-quobyte-a6a7ccb8-b61e-4ff4-8dff-934547ee5fa9" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 20:04:03 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-9791a665-b025-4c5b-9e55-7615f17e38bf tempest-CreateVolumesFromImageTest-1867995240 None] Lock "cinder-quobyte-a6a7ccb8-b61e-4ff4-8dff-934547ee5fa9" acquired by "delete_volume" :: waited 0.016s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 20:04:03 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[14be09f4-5ddd-41ea-942f-b999d39e1494]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 20:04:03 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-9791a665-b025-4c5b-9e55-7615f17e38bf tempest-CreateVolumesFromImageTest-1867995240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-a6a7ccb8-b61e-4ff4-8dff-934547ee5fa9 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:04:03 devstack sudo[106595]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-a6a7ccb8-b61e-4ff4-8dff-934547ee5fa9
Jul 02 20:04:03 devstack sudo[106595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:04:04 devstack sudo[106595]: pam_unix(sudo:session): session closed for user root
Jul 02 20:04:04 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-9791a665-b025-4c5b-9e55-7615f17e38bf tempest-CreateVolumesFromImageTest-1867995240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-a6a7ccb8-b61e-4ff4-8dff-934547ee5fa9" returned: 0 in 0.794s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:04:04 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-9791a665-b025-4c5b-9e55-7615f17e38bf tempest-CreateVolumesFromImageTest-1867995240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-a6a7ccb8-b61e-4ff4-8dff-934547ee5fa9 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:04:04 devstack sudo[106601]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-a6a7ccb8-b61e-4ff4-8dff-934547ee5fa9
Jul 02 20:04:04 devstack sudo[106601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:04:04 devstack sudo[106601]: pam_unix(sudo:session): session closed for user root
Jul 02 20:04:05 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-9791a665-b025-4c5b-9e55-7615f17e38bf tempest-CreateVolumesFromImageTest-1867995240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-a6a7ccb8-b61e-4ff4-8dff-934547ee5fa9" returned: 0 in 0.667s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:04:05 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-9791a665-b025-4c5b-9e55-7615f17e38bf tempest-CreateVolumesFromImageTest-1867995240 None] Lock "cinder-quobyte-a6a7ccb8-b61e-4ff4-8dff-934547ee5fa9" released by "delete_volume" :: held 1.502s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 20:04:05 devstack cinder-volume[86639]: DEBUG cinder.quota [None req-9791a665-b025-4c5b-9e55-7615f17e38bf tempest-CreateVolumesFromImageTest-1867995240 None] Created reservations ['0fc6df3c-e716-4d95-8a79-c0f0b86dac7a', '6dfb9c8e-ed4e-42a7-abaa-b971ab9065cd', 'be866d46-9b5b-4bd5-b145-e9bdfaf6443e', 'f1469be0-aec6-4a9a-b98c-3bbb00fe7675'] {{(pid=86639) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 20:04:05 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-9791a665-b025-4c5b-9e55-7615f17e38bf tempest-CreateVolumesFromImageTest-1867995240 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 20:04:05 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-9791a665-b025-4c5b-9e55-7615f17e38bf tempest-CreateVolumesFromImageTest-1867995240 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 20:04:05 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-9791a665-b025-4c5b-9e55-7615f17e38bf tempest-CreateVolumesFromImageTest-1867995240 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 20:04:05 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-9791a665-b025-4c5b-9e55-7615f17e38bf tempest-CreateVolumesFromImageTest-1867995240 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 20:04:05 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-9791a665-b025-4c5b-9e55-7615f17e38bf tempest-CreateVolumesFromImageTest-1867995240 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 20:04:05 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-9791a665-b025-4c5b-9e55-7615f17e38bf tempest-CreateVolumesFromImageTest-1867995240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:04:05 devstack sudo[106604]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e
Jul 02 20:04:05 devstack sudo[106604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:04:05 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-9ac50d71-528c-4600-b3d1-f5c2ce1dbd1c tempest-CreateVolumesFromImageTest-1867995240 None] Acquiring lock "cinder-64047065-3df1-4988-977e-e8de44849615-delete_volume" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 20:04:05 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-9ac50d71-528c-4600-b3d1-f5c2ce1dbd1c tempest-CreateVolumesFromImageTest-1867995240 None] Lock "cinder-64047065-3df1-4988-977e-e8de44849615-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 20:04:05 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-9ac50d71-528c-4600-b3d1-f5c2ce1dbd1c tempest-CreateVolumesFromImageTest-1867995240 None] Acquiring lock "cinder-quobyte-64047065-3df1-4988-977e-e8de44849615" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 20:04:05 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-9ac50d71-528c-4600-b3d1-f5c2ce1dbd1c tempest-CreateVolumesFromImageTest-1867995240 None] Lock "cinder-quobyte-64047065-3df1-4988-977e-e8de44849615" acquired by "delete_volume" :: waited 0.018s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 20:04:05 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[75b74e8b-a201-4646-b99c-d15dcf1a3a95]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 20:04:05 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-9ac50d71-528c-4600-b3d1-f5c2ce1dbd1c tempest-CreateVolumesFromImageTest-1867995240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-64047065-3df1-4988-977e-e8de44849615 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:04:05 devstack sudo[106604]: pam_unix(sudo:session): session closed for user root
Jul 02 20:04:05 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-9791a665-b025-4c5b-9e55-7615f17e38bf tempest-CreateVolumesFromImageTest-1867995240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e" returned: 0 in 0.684s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:04:05 devstack cinder-volume[86639]: DEBUG cinder.manager [None req-9791a665-b025-4c5b-9e55-7615f17e38bf tempest-CreateVolumesFromImageTest-1867995240 None] Notifying Schedulers of capabilities ... {{(pid=86639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 20:04:05 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-9791a665-b025-4c5b-9e55-7615f17e38bf tempest-CreateVolumesFromImageTest-1867995240 None] Deleted volume successfully.
Jul 02 20:04:05 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-9791a665-b025-4c5b-9e55-7615f17e38bf tempest-CreateVolumesFromImageTest-1867995240 None] Lock "cinder-a6a7ccb8-b61e-4ff4-8dff-934547ee5fa9-delete_volume" released by "delete_volume" :: held 2.386s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 20:04:05 devstack sudo[106607]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-64047065-3df1-4988-977e-e8de44849615
Jul 02 20:04:05 devstack sudo[106607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:04:06 devstack sudo[106607]: pam_unix(sudo:session): session closed for user root
Jul 02 20:04:06 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-9ac50d71-528c-4600-b3d1-f5c2ce1dbd1c tempest-CreateVolumesFromImageTest-1867995240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-64047065-3df1-4988-977e-e8de44849615" returned: 0 in 0.854s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:04:06 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-9ac50d71-528c-4600-b3d1-f5c2ce1dbd1c tempest-CreateVolumesFromImageTest-1867995240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-64047065-3df1-4988-977e-e8de44849615 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:04:06 devstack sudo[106612]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-64047065-3df1-4988-977e-e8de44849615
Jul 02 20:04:06 devstack sudo[106612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:04:07 devstack sudo[106612]: pam_unix(sudo:session): session closed for user root
Jul 02 20:04:07 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-9ac50d71-528c-4600-b3d1-f5c2ce1dbd1c tempest-CreateVolumesFromImageTest-1867995240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-64047065-3df1-4988-977e-e8de44849615" returned: 0 in 0.673s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:04:07 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-9ac50d71-528c-4600-b3d1-f5c2ce1dbd1c tempest-CreateVolumesFromImageTest-1867995240 None] Lock "cinder-quobyte-64047065-3df1-4988-977e-e8de44849615" released by "delete_volume" :: held 1.574s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 20:04:07 devstack cinder-volume[86639]: DEBUG cinder.quota [None req-9ac50d71-528c-4600-b3d1-f5c2ce1dbd1c tempest-CreateVolumesFromImageTest-1867995240 None] Created reservations ['c6eb05f0-d045-4d0f-8151-7d7d71b9a8ec', '13cde33c-0fe4-474d-989f-e67c1427c99f', 'cc566eaf-16a1-408e-ab93-b384d74e50be', '1e68cc96-794c-453b-aac6-419f1f8bb287'] {{(pid=86639) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 20:04:07 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-9ac50d71-528c-4600-b3d1-f5c2ce1dbd1c tempest-CreateVolumesFromImageTest-1867995240 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 20:04:07 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-9ac50d71-528c-4600-b3d1-f5c2ce1dbd1c tempest-CreateVolumesFromImageTest-1867995240 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 20:04:07 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-9ac50d71-528c-4600-b3d1-f5c2ce1dbd1c tempest-CreateVolumesFromImageTest-1867995240 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 20:04:07 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-9ac50d71-528c-4600-b3d1-f5c2ce1dbd1c tempest-CreateVolumesFromImageTest-1867995240 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 20:04:07 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-9ac50d71-528c-4600-b3d1-f5c2ce1dbd1c tempest-CreateVolumesFromImageTest-1867995240 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 20:04:07 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-9ac50d71-528c-4600-b3d1-f5c2ce1dbd1c tempest-CreateVolumesFromImageTest-1867995240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:04:07 devstack sudo[106615]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e
Jul 02 20:04:07 devstack sudo[106615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:04:07 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-92925d30-4ae0-48d8-aa31-fc94d81491ec tempest-CreateVolumesFromImageTest-1867995240 None] Acquiring lock "cinder-ebdaac90-85fd-4264-9193-aa8e9eb927fd-delete_volume" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 20:04:07 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-92925d30-4ae0-48d8-aa31-fc94d81491ec tempest-CreateVolumesFromImageTest-1867995240 None] Lock "cinder-ebdaac90-85fd-4264-9193-aa8e9eb927fd-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 20:04:07 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-92925d30-4ae0-48d8-aa31-fc94d81491ec tempest-CreateVolumesFromImageTest-1867995240 None] Acquiring lock "cinder-quobyte-ebdaac90-85fd-4264-9193-aa8e9eb927fd" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 20:04:07 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-92925d30-4ae0-48d8-aa31-fc94d81491ec tempest-CreateVolumesFromImageTest-1867995240 None] Lock "cinder-quobyte-ebdaac90-85fd-4264-9193-aa8e9eb927fd" acquired by "delete_volume" :: waited 0.015s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 20:04:08 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[9594be66-e051-4b67-bb2e-bd2f7fc55ec0]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 20:04:08 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-92925d30-4ae0-48d8-aa31-fc94d81491ec tempest-CreateVolumesFromImageTest-1867995240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-ebdaac90-85fd-4264-9193-aa8e9eb927fd {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:04:08 devstack sudo[106618]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-ebdaac90-85fd-4264-9193-aa8e9eb927fd
Jul 02 20:04:08 devstack sudo[106618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:04:08 devstack sudo[106615]: pam_unix(sudo:session): session closed for user root
Jul 02 20:04:08 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-9ac50d71-528c-4600-b3d1-f5c2ce1dbd1c tempest-CreateVolumesFromImageTest-1867995240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e" returned: 0 in 0.729s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:04:08 devstack cinder-volume[86639]: DEBUG cinder.manager [None req-9ac50d71-528c-4600-b3d1-f5c2ce1dbd1c tempest-CreateVolumesFromImageTest-1867995240 None] Notifying Schedulers of capabilities ... {{(pid=86639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 20:04:08 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-9ac50d71-528c-4600-b3d1-f5c2ce1dbd1c tempest-CreateVolumesFromImageTest-1867995240 None] Deleted volume successfully.
Jul 02 20:04:08 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-9ac50d71-528c-4600-b3d1-f5c2ce1dbd1c tempest-CreateVolumesFromImageTest-1867995240 None] Lock "cinder-64047065-3df1-4988-977e-e8de44849615-delete_volume" released by "delete_volume" :: held 2.535s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 20:04:08 devstack sudo[106618]: pam_unix(sudo:session): session closed for user root
Jul 02 20:04:08 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-92925d30-4ae0-48d8-aa31-fc94d81491ec tempest-CreateVolumesFromImageTest-1867995240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-ebdaac90-85fd-4264-9193-aa8e9eb927fd" returned: 0 in 0.779s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:04:08 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-92925d30-4ae0-48d8-aa31-fc94d81491ec tempest-CreateVolumesFromImageTest-1867995240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-ebdaac90-85fd-4264-9193-aa8e9eb927fd {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:04:08 devstack sudo[106623]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-ebdaac90-85fd-4264-9193-aa8e9eb927fd
Jul 02 20:04:08 devstack sudo[106623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:04:09 devstack sudo[106623]: pam_unix(sudo:session): session closed for user root
Jul 02 20:04:09 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-92925d30-4ae0-48d8-aa31-fc94d81491ec tempest-CreateVolumesFromImageTest-1867995240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-ebdaac90-85fd-4264-9193-aa8e9eb927fd" returned: 0 in 0.700s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:04:09 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-92925d30-4ae0-48d8-aa31-fc94d81491ec tempest-CreateVolumesFromImageTest-1867995240 None] Lock "cinder-quobyte-ebdaac90-85fd-4264-9193-aa8e9eb927fd" released by "delete_volume" :: held 1.525s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 20:04:09 devstack cinder-volume[86639]: DEBUG cinder.quota [None req-92925d30-4ae0-48d8-aa31-fc94d81491ec tempest-CreateVolumesFromImageTest-1867995240 None] Created reservations ['f8906ea4-6cf7-4315-a893-d28fca9ef77c', 'b21a0c1e-23a7-4274-ab17-f2cb4d627a63', 'adb69e7e-ad2d-4064-b0f5-95f26d7a8c77', 'b8e44920-1a1b-4044-b10f-e16e4404daff'] {{(pid=86639) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 20:04:09 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-92925d30-4ae0-48d8-aa31-fc94d81491ec tempest-CreateVolumesFromImageTest-1867995240 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 20:04:09 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-92925d30-4ae0-48d8-aa31-fc94d81491ec tempest-CreateVolumesFromImageTest-1867995240 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 20:04:09 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-92925d30-4ae0-48d8-aa31-fc94d81491ec tempest-CreateVolumesFromImageTest-1867995240 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 20:04:09 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-92925d30-4ae0-48d8-aa31-fc94d81491ec tempest-CreateVolumesFromImageTest-1867995240 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 20:04:09 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-92925d30-4ae0-48d8-aa31-fc94d81491ec tempest-CreateVolumesFromImageTest-1867995240 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 20:04:09 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-92925d30-4ae0-48d8-aa31-fc94d81491ec tempest-CreateVolumesFromImageTest-1867995240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:04:09 devstack sudo[106626]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e
Jul 02 20:04:09 devstack sudo[106626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:04:10 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-b9704d84-4e38-4d95-bee6-c33783526507 tempest-CreateVolumesFromImageTest-1867995240 None] Acquiring lock "cinder-5afb4018-b7dc-4d6b-9a6f-45ede4ff0866-delete_volume" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 20:04:10 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-b9704d84-4e38-4d95-bee6-c33783526507 tempest-CreateVolumesFromImageTest-1867995240 None] Lock "cinder-5afb4018-b7dc-4d6b-9a6f-45ede4ff0866-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 20:04:10 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-b9704d84-4e38-4d95-bee6-c33783526507 tempest-CreateVolumesFromImageTest-1867995240 None] Acquiring lock "cinder-quobyte-5afb4018-b7dc-4d6b-9a6f-45ede4ff0866" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 20:04:10 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-b9704d84-4e38-4d95-bee6-c33783526507 tempest-CreateVolumesFromImageTest-1867995240 None] Lock "cinder-quobyte-5afb4018-b7dc-4d6b-9a6f-45ede4ff0866" acquired by "delete_volume" :: waited 0.019s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 20:04:10 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[d48c66ef-153e-4e4e-828e-f71cd7341fa9]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 20:04:10 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-b9704d84-4e38-4d95-bee6-c33783526507 tempest-CreateVolumesFromImageTest-1867995240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-5afb4018-b7dc-4d6b-9a6f-45ede4ff0866 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:04:10 devstack sudo[106626]: pam_unix(sudo:session): session closed for user root
Jul 02 20:04:10 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-92925d30-4ae0-48d8-aa31-fc94d81491ec tempest-CreateVolumesFromImageTest-1867995240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e" returned: 0 in 0.647s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:04:10 devstack cinder-volume[86639]: DEBUG cinder.manager [None req-92925d30-4ae0-48d8-aa31-fc94d81491ec tempest-CreateVolumesFromImageTest-1867995240 None] Notifying Schedulers of capabilities ... {{(pid=86639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 20:04:10 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-92925d30-4ae0-48d8-aa31-fc94d81491ec tempest-CreateVolumesFromImageTest-1867995240 None] Deleted volume successfully.
Jul 02 20:04:10 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-92925d30-4ae0-48d8-aa31-fc94d81491ec tempest-CreateVolumesFromImageTest-1867995240 None] Lock "cinder-ebdaac90-85fd-4264-9193-aa8e9eb927fd-delete_volume" released by "delete_volume" :: held 2.378s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 20:04:10 devstack sudo[106629]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-5afb4018-b7dc-4d6b-9a6f-45ede4ff0866
Jul 02 20:04:10 devstack sudo[106629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:04:11 devstack sudo[106629]: pam_unix(sudo:session): session closed for user root
Jul 02 20:04:11 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-b9704d84-4e38-4d95-bee6-c33783526507 tempest-CreateVolumesFromImageTest-1867995240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-5afb4018-b7dc-4d6b-9a6f-45ede4ff0866" returned: 0 in 0.838s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:04:11 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-b9704d84-4e38-4d95-bee6-c33783526507 tempest-CreateVolumesFromImageTest-1867995240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-5afb4018-b7dc-4d6b-9a6f-45ede4ff0866 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:04:11 devstack sudo[106634]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-5afb4018-b7dc-4d6b-9a6f-45ede4ff0866
Jul 02 20:04:11 devstack sudo[106634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:04:11 devstack sudo[106634]: pam_unix(sudo:session): session closed for user root
Jul 02 20:04:11 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-b9704d84-4e38-4d95-bee6-c33783526507 tempest-CreateVolumesFromImageTest-1867995240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-5afb4018-b7dc-4d6b-9a6f-45ede4ff0866" returned: 0 in 0.685s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:04:11 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-b9704d84-4e38-4d95-bee6-c33783526507 tempest-CreateVolumesFromImageTest-1867995240 None] Lock "cinder-quobyte-5afb4018-b7dc-4d6b-9a6f-45ede4ff0866" released by "delete_volume" :: held 1.562s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 20:04:11 devstack cinder-volume[86639]: DEBUG cinder.quota [None req-b9704d84-4e38-4d95-bee6-c33783526507 tempest-CreateVolumesFromImageTest-1867995240 None] Created reservations ['8f1af392-d8f8-4332-89ea-4d4f1222a37c', '8a0d4fd3-a75c-4162-90fc-ca093bf9ce55', '06f71c9a-e4d7-457d-85cf-e2d8e163e662', 'a638a378-3d32-4d71-b94b-e0515488de58'] {{(pid=86639) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 20:04:11 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-b9704d84-4e38-4d95-bee6-c33783526507 tempest-CreateVolumesFromImageTest-1867995240 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 20:04:11 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-b9704d84-4e38-4d95-bee6-c33783526507 tempest-CreateVolumesFromImageTest-1867995240 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 20:04:11 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-b9704d84-4e38-4d95-bee6-c33783526507 tempest-CreateVolumesFromImageTest-1867995240 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 20:04:11 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-b9704d84-4e38-4d95-bee6-c33783526507 tempest-CreateVolumesFromImageTest-1867995240 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 20:04:11 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-b9704d84-4e38-4d95-bee6-c33783526507 tempest-CreateVolumesFromImageTest-1867995240 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 20:04:11 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-b9704d84-4e38-4d95-bee6-c33783526507 tempest-CreateVolumesFromImageTest-1867995240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:04:11 devstack sudo[106637]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e
Jul 02 20:04:11 devstack sudo[106637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:04:12 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-609d4943-2883-4308-87ac-6b470b937dd5 tempest-CreateVolumesFromImageTest-1867995240 None] Acquiring lock "cinder-31525b11-d367-4462-b37f-5d77cc097493-delete_volume" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 20:04:12 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-609d4943-2883-4308-87ac-6b470b937dd5 tempest-CreateVolumesFromImageTest-1867995240 None] Lock "cinder-31525b11-d367-4462-b37f-5d77cc097493-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 20:04:12 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-609d4943-2883-4308-87ac-6b470b937dd5 tempest-CreateVolumesFromImageTest-1867995240 None] Acquiring lock "cinder-quobyte-31525b11-d367-4462-b37f-5d77cc097493" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 20:04:12 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-609d4943-2883-4308-87ac-6b470b937dd5 tempest-CreateVolumesFromImageTest-1867995240 None] Lock "cinder-quobyte-31525b11-d367-4462-b37f-5d77cc097493" acquired by "delete_volume" :: waited 0.018s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 20:04:12 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2cb9375-dff1-4d39-8c69-43fb8494c84f]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 20:04:12 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-609d4943-2883-4308-87ac-6b470b937dd5 tempest-CreateVolumesFromImageTest-1867995240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-31525b11-d367-4462-b37f-5d77cc097493 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:04:12 devstack sudo[106640]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-31525b11-d367-4462-b37f-5d77cc097493
Jul 02 20:04:12 devstack sudo[106640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:04:12 devstack sudo[106637]: pam_unix(sudo:session): session closed for user root
Jul 02 20:04:12 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-b9704d84-4e38-4d95-bee6-c33783526507 tempest-CreateVolumesFromImageTest-1867995240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e" returned: 0 in 0.719s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:04:12 devstack cinder-volume[86639]: DEBUG cinder.manager [None req-b9704d84-4e38-4d95-bee6-c33783526507 tempest-CreateVolumesFromImageTest-1867995240 None] Notifying Schedulers of capabilities ... {{(pid=86639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 20:04:12 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-b9704d84-4e38-4d95-bee6-c33783526507 tempest-CreateVolumesFromImageTest-1867995240 None] Deleted volume successfully.
Jul 02 20:04:12 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-b9704d84-4e38-4d95-bee6-c33783526507 tempest-CreateVolumesFromImageTest-1867995240 None] Lock "cinder-5afb4018-b7dc-4d6b-9a6f-45ede4ff0866-delete_volume" released by "delete_volume" :: held 2.481s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 20:04:13 devstack sudo[106640]: pam_unix(sudo:session): session closed for user root
Jul 02 20:04:13 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-609d4943-2883-4308-87ac-6b470b937dd5 tempest-CreateVolumesFromImageTest-1867995240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-31525b11-d367-4462-b37f-5d77cc097493" returned: 0 in 0.764s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:04:13 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-609d4943-2883-4308-87ac-6b470b937dd5 tempest-CreateVolumesFromImageTest-1867995240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-31525b11-d367-4462-b37f-5d77cc097493 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:04:13 devstack sudo[106645]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-31525b11-d367-4462-b37f-5d77cc097493
Jul 02 20:04:13 devstack sudo[106645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:04:13 devstack sudo[106645]: pam_unix(sudo:session): session closed for user root
Jul 02 20:04:13 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-609d4943-2883-4308-87ac-6b470b937dd5 tempest-CreateVolumesFromImageTest-1867995240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-31525b11-d367-4462-b37f-5d77cc097493" returned: 0 in 0.726s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:04:13 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-609d4943-2883-4308-87ac-6b470b937dd5 tempest-CreateVolumesFromImageTest-1867995240 None] Lock "cinder-quobyte-31525b11-d367-4462-b37f-5d77cc097493" released by "delete_volume" :: held 1.539s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 20:04:14 devstack cinder-volume[86639]: DEBUG cinder.quota [None req-609d4943-2883-4308-87ac-6b470b937dd5 tempest-CreateVolumesFromImageTest-1867995240 None] Created reservations ['f0ee3f80-6035-459b-8142-3d8b9ccb9209', '3a1c34e1-73dc-49a0-9848-93d11f555a96', 'b289994c-02f8-41b5-a24b-d41007af5738', 'c0d30f8f-355e-49d7-8264-292c61e74557'] {{(pid=86639) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 20:04:14 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-609d4943-2883-4308-87ac-6b470b937dd5 tempest-CreateVolumesFromImageTest-1867995240 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 20:04:14 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-609d4943-2883-4308-87ac-6b470b937dd5 tempest-CreateVolumesFromImageTest-1867995240 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 20:04:14 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-609d4943-2883-4308-87ac-6b470b937dd5 tempest-CreateVolumesFromImageTest-1867995240 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 20:04:14 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-609d4943-2883-4308-87ac-6b470b937dd5 tempest-CreateVolumesFromImageTest-1867995240 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 20:04:14 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-609d4943-2883-4308-87ac-6b470b937dd5 tempest-CreateVolumesFromImageTest-1867995240 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 20:04:14 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-609d4943-2883-4308-87ac-6b470b937dd5 tempest-CreateVolumesFromImageTest-1867995240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:04:14 devstack sudo[106649]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e
Jul 02 20:04:14 devstack sudo[106649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:04:15 devstack sudo[106649]: pam_unix(sudo:session): session closed for user root
Jul 02 20:04:15 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-609d4943-2883-4308-87ac-6b470b937dd5 tempest-CreateVolumesFromImageTest-1867995240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e" returned: 0 in 0.810s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:04:15 devstack cinder-volume[86639]: DEBUG cinder.manager [None req-609d4943-2883-4308-87ac-6b470b937dd5 tempest-CreateVolumesFromImageTest-1867995240 None] Notifying Schedulers of capabilities ... {{(pid=86639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 20:04:15 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-609d4943-2883-4308-87ac-6b470b937dd5 tempest-CreateVolumesFromImageTest-1867995240 None] Deleted volume successfully.
Jul 02 20:04:15 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-609d4943-2883-4308-87ac-6b470b937dd5 tempest-CreateVolumesFromImageTest-1867995240 None] Lock "cinder-31525b11-d367-4462-b37f-5d77cc097493-delete_volume" released by "delete_volume" :: held 2.661s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 20:04:24 devstack cinder-volume[86639]: DEBUG dbcounter [-] [86639] Writing DB stats cinder:UPDATE=85,cinder:DELETE=6,cinder:SELECT=70,cinder:INSERT=28 {{(pid=86639) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 02 20:04:25 devstack cinder-volume[86639]: DEBUG dbcounter [-] [86639] Writing DB stats cinder:SELECT=55,cinder:INSERT=24,cinder:UPDATE=95,cinder:DELETE=9 {{(pid=86639) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 02 20:04:27 devstack cinder-volume[86639]: DEBUG cinder.volume.flows.manager.create_volume [None req-5294ee67-66c2-432a-8159-c8930842a771 tempest-CinderUnicodeTest-1101475161 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 20:04:27 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-5294ee67-66c2-432a-8159-c8930842a771 tempest-CinderUnicodeTest-1101475161 None] Flow 'volume_create_manager' (20e4efb8-caa9-470e-adb1-a3e79a9f920c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 20:04:27 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-5294ee67-66c2-432a-8159-c8930842a771 tempest-CinderUnicodeTest-1101475161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b6b6e5f-aef0-4882-8166-85463a421aae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:04:27 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-5294ee67-66c2-432a-8159-c8930842a771 tempest-CinderUnicodeTest-1101475161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b6b6e5f-aef0-4882-8166-85463a421aae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T18:04:27Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34ec6bc0-000f-4c69-b004-41e91e29566a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59e2fda238d34363b7dc273cbafc8320',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T18:04:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T18:04:27Z,use_quota=True,user_id='8412d7ea508d47578a31135eadf8ea5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:04:27 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-5294ee67-66c2-432a-8159-c8930842a771 tempest-CinderUnicodeTest-1101475161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2df872bb-e957-4b3f-8b2d-6693f0716ccb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:04:27 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-5294ee67-66c2-432a-8159-c8930842a771 tempest-CinderUnicodeTest-1101475161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2df872bb-e957-4b3f-8b2d-6693f0716ccb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:04:27 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-5294ee67-66c2-432a-8159-c8930842a771 tempest-CinderUnicodeTest-1101475161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (221d1776-10e8-49d2-b827-6bf3cd5a965b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:04:27 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-5294ee67-66c2-432a-8159-c8930842a771 tempest-CinderUnicodeTest-1101475161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (221d1776-10e8-49d2-b827-6bf3cd5a965b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '34ec6bc0-000f-4c69-b004-41e91e29566a', 'volume_name': 'volume-34ec6bc0-000f-4c69-b004-41e91e29566a', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:04:27 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-5294ee67-66c2-432a-8159-c8930842a771 tempest-CinderUnicodeTest-1101475161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73303f50-ff7a-4712-8e63-3c9493bd324b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:04:27 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-5294ee67-66c2-432a-8159-c8930842a771 tempest-CinderUnicodeTest-1101475161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73303f50-ff7a-4712-8e63-3c9493bd324b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:04:27 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-5294ee67-66c2-432a-8159-c8930842a771 tempest-CinderUnicodeTest-1101475161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3fef553-cd00-4151-a112-5df3f0a74270) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:04:27 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-5294ee67-66c2-432a-8159-c8930842a771 tempest-CinderUnicodeTest-1101475161 None] Volume 34ec6bc0-000f-4c69-b004-41e91e29566a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-34ec6bc0-000f-4c69-b004-41e91e29566a', 'volume_size': 1}
Jul 02 20:04:27 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-5294ee67-66c2-432a-8159-c8930842a771 tempest-CinderUnicodeTest-1101475161 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 20:04:27 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-5294ee67-66c2-432a-8159-c8930842a771 tempest-CinderUnicodeTest-1101475161 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 20:04:27 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-5294ee67-66c2-432a-8159-c8930842a771 tempest-CinderUnicodeTest-1101475161 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce906cb830>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T18:04:27Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34ec6bc0-000f-4c69-b004-41e91e29566a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59e2fda238d34363b7dc273cbafc8320',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T18:04:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T18:04:27Z,use_quota=True,user_id='8412d7ea508d47578a31135eadf8ea5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)}" {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 20:04:27 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-5294ee67-66c2-432a-8159-c8930842a771 tempest-CinderUnicodeTest-1101475161 None] Creating volume 34ec6bc0-000f-4c69-b004-41e91e29566a {{(pid=86639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 20:04:27 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-5294ee67-66c2-432a-8159-c8930842a771 tempest-CinderUnicodeTest-1101475161 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 20:04:27 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-5294ee67-66c2-432a-8159-c8930842a771 tempest-CinderUnicodeTest-1101475161 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 20:04:27 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-5294ee67-66c2-432a-8159-c8930842a771 tempest-CinderUnicodeTest-1101475161 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 20:04:27 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-5294ee67-66c2-432a-8159-c8930842a771 tempest-CinderUnicodeTest-1101475161 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 20:04:27 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-5294ee67-66c2-432a-8159-c8930842a771 tempest-CinderUnicodeTest-1101475161 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 20:04:27 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-5294ee67-66c2-432a-8159-c8930842a771 tempest-CinderUnicodeTest-1101475161 None] Selected osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92 as target Quobyte volume. {{(pid=86639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 20:04:27 devstack cinder-volume[86639]: INFO cinder.volume.drivers.remotefs [None req-5294ee67-66c2-432a-8159-c8930842a771 tempest-CinderUnicodeTest-1101475161 None] casted to osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92
Jul 02 20:04:27 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-5294ee67-66c2-432a-8159-c8930842a771 tempest-CinderUnicodeTest-1101475161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-34ec6bc0-000f-4c69-b004-41e91e29566a 1073741824 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:04:27 devstack cinder-volume[86639]: DEBUG cinder.volume.flows.manager.create_volume [None req-89ef9808-9ce6-487d-9e6b-47c664165dde tempest-CreateVolumesFromImageTest-5083140 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 20:04:27 devstack sudo[106689]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-34ec6bc0-000f-4c69-b004-41e91e29566a 1073741824
Jul 02 20:04:27 devstack sudo[106689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:04:27 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-89ef9808-9ce6-487d-9e6b-47c664165dde tempest-CreateVolumesFromImageTest-5083140 None] Flow 'volume_create_manager' (5d073ba5-01bd-4c1a-b7b7-a6590d543717) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 20:04:27 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-89ef9808-9ce6-487d-9e6b-47c664165dde tempest-CreateVolumesFromImageTest-5083140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03c64b36-27f1-423d-a42f-15514de94c09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:04:27 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-89ef9808-9ce6-487d-9e6b-47c664165dde tempest-CreateVolumesFromImageTest-5083140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03c64b36-27f1-423d-a42f-15514de94c09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T18:04:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-659892572',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=028322ce-d9b7-45d6-84d2-d01de4808af1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8845934471604a91a853a5ef56c1099d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T18:04:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T18:04:27Z,use_quota=True,user_id='7f9781a1c6da4ebb85f228d5ed285ebe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:04:27 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-89ef9808-9ce6-487d-9e6b-47c664165dde tempest-CreateVolumesFromImageTest-5083140 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7efb410-397d-42af-ae77-983c5577c029) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:04:27 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-89ef9808-9ce6-487d-9e6b-47c664165dde tempest-CreateVolumesFromImageTest-5083140 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7efb410-397d-42af-ae77-983c5577c029) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:04:27 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-89ef9808-9ce6-487d-9e6b-47c664165dde tempest-CreateVolumesFromImageTest-5083140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2935bf01-6629-4cc8-9e69-23b4ff5e9346) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:04:27 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-89ef9808-9ce6-487d-9e6b-47c664165dde tempest-CreateVolumesFromImageTest-5083140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2935bf01-6629-4cc8-9e69-23b4ff5e9346) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '028322ce-d9b7-45d6-84d2-d01de4808af1', 'volume_name': 'volume-028322ce-d9b7-45d6-84d2-d01de4808af1', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:04:27 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-89ef9808-9ce6-487d-9e6b-47c664165dde tempest-CreateVolumesFromImageTest-5083140 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92e50a4e-d427-4ff1-b88e-5e330c363540) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:04:27 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-89ef9808-9ce6-487d-9e6b-47c664165dde tempest-CreateVolumesFromImageTest-5083140 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92e50a4e-d427-4ff1-b88e-5e330c363540) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:04:27 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-89ef9808-9ce6-487d-9e6b-47c664165dde tempest-CreateVolumesFromImageTest-5083140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67d0dfd1-d6a0-4e2e-985b-352b9dc27010) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:04:27 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-89ef9808-9ce6-487d-9e6b-47c664165dde tempest-CreateVolumesFromImageTest-5083140 None] Volume 028322ce-d9b7-45d6-84d2-d01de4808af1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-028322ce-d9b7-45d6-84d2-d01de4808af1', 'volume_size': 1}
Jul 02 20:04:27 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-89ef9808-9ce6-487d-9e6b-47c664165dde tempest-CreateVolumesFromImageTest-5083140 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 20:04:27 devstack cinder-volume[86639]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e530538-b153-4b96-8f4b-ee7890cc28de tempest-CreateVolumesFromImageTest-5083140 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 20:04:27 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-9e530538-b153-4b96-8f4b-ee7890cc28de tempest-CreateVolumesFromImageTest-5083140 None] Flow 'volume_create_manager' (e1317904-d155-4ef6-91ef-c84f53208825) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 20:04:27 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-9e530538-b153-4b96-8f4b-ee7890cc28de tempest-CreateVolumesFromImageTest-5083140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d99fe75c-59f8-4f9a-a435-5ba680fad027) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:04:27 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-9e530538-b153-4b96-8f4b-ee7890cc28de tempest-CreateVolumesFromImageTest-5083140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d99fe75c-59f8-4f9a-a435-5ba680fad027) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T18:04:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-956105174',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=453fcf9c-db7a-442f-a64d-59dfc5d1428c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8845934471604a91a853a5ef56c1099d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T18:04:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T18:04:27Z,use_quota=True,user_id='7f9781a1c6da4ebb85f228d5ed285ebe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:04:27 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-9e530538-b153-4b96-8f4b-ee7890cc28de tempest-CreateVolumesFromImageTest-5083140 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (953c7a43-6e7b-41f3-89ab-d08f9e52035a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:04:27 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-9e530538-b153-4b96-8f4b-ee7890cc28de tempest-CreateVolumesFromImageTest-5083140 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (953c7a43-6e7b-41f3-89ab-d08f9e52035a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:04:27 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-9e530538-b153-4b96-8f4b-ee7890cc28de tempest-CreateVolumesFromImageTest-5083140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (442f89d4-b289-4aa7-ba8d-62c0f0b9970f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:04:27 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-9e530538-b153-4b96-8f4b-ee7890cc28de tempest-CreateVolumesFromImageTest-5083140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (442f89d4-b289-4aa7-ba8d-62c0f0b9970f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '453fcf9c-db7a-442f-a64d-59dfc5d1428c', 'volume_name': 'volume-453fcf9c-db7a-442f-a64d-59dfc5d1428c', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:04:27 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-9e530538-b153-4b96-8f4b-ee7890cc28de tempest-CreateVolumesFromImageTest-5083140 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92f357ff-b6f7-47e7-94df-9deceacea91f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:04:27 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-9e530538-b153-4b96-8f4b-ee7890cc28de tempest-CreateVolumesFromImageTest-5083140 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92f357ff-b6f7-47e7-94df-9deceacea91f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:04:27 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-9e530538-b153-4b96-8f4b-ee7890cc28de tempest-CreateVolumesFromImageTest-5083140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6562f1df-3610-4336-96e6-1709e96e099f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:04:27 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-9e530538-b153-4b96-8f4b-ee7890cc28de tempest-CreateVolumesFromImageTest-5083140 None] Volume 453fcf9c-db7a-442f-a64d-59dfc5d1428c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-453fcf9c-db7a-442f-a64d-59dfc5d1428c', 'volume_size': 1}
Jul 02 20:04:27 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-9e530538-b153-4b96-8f4b-ee7890cc28de tempest-CreateVolumesFromImageTest-5083140 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 20:04:27 devstack cinder-volume[86639]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5cb1768-1eac-44b2-a85b-0e9b2c823219 tempest-CreateVolumesFromSnapshotTest-1127395155 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 20:04:27 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-f5cb1768-1eac-44b2-a85b-0e9b2c823219 tempest-CreateVolumesFromSnapshotTest-1127395155 None] Flow 'volume_create_manager' (f2b415b1-1409-4e8a-a38c-0350a8a44eb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 20:04:27 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-f5cb1768-1eac-44b2-a85b-0e9b2c823219 tempest-CreateVolumesFromSnapshotTest-1127395155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42f55faa-43ad-4167-a4dc-bda5190f7e3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:04:28 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-f5cb1768-1eac-44b2-a85b-0e9b2c823219 tempest-CreateVolumesFromSnapshotTest-1127395155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42f55faa-43ad-4167-a4dc-bda5190f7e3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T18:04:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-30201440',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5522fb92-c1a5-4cf1-b383-71c8a54a3b48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfffcb664c3f4b49b07a3412c1642700',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T18:04:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T18:04:28Z,use_quota=True,user_id='ca1bd1389a844499a1f59dc320b608a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:04:28 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-f5cb1768-1eac-44b2-a85b-0e9b2c823219 tempest-CreateVolumesFromSnapshotTest-1127395155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70ce2dd8-8568-4eff-a287-ff5b2f174f2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:04:28 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-f5cb1768-1eac-44b2-a85b-0e9b2c823219 tempest-CreateVolumesFromSnapshotTest-1127395155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70ce2dd8-8568-4eff-a287-ff5b2f174f2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:04:28 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-f5cb1768-1eac-44b2-a85b-0e9b2c823219 tempest-CreateVolumesFromSnapshotTest-1127395155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80c2f865-b292-4d22-a045-fae2a9f2ac4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:04:28 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-f5cb1768-1eac-44b2-a85b-0e9b2c823219 tempest-CreateVolumesFromSnapshotTest-1127395155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80c2f865-b292-4d22-a045-fae2a9f2ac4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5522fb92-c1a5-4cf1-b383-71c8a54a3b48', 'volume_name': 'volume-5522fb92-c1a5-4cf1-b383-71c8a54a3b48', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:04:28 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-f5cb1768-1eac-44b2-a85b-0e9b2c823219 tempest-CreateVolumesFromSnapshotTest-1127395155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21b52bcf-d1d3-48c8-bde2-9745fbeb13d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:04:28 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-f5cb1768-1eac-44b2-a85b-0e9b2c823219 tempest-CreateVolumesFromSnapshotTest-1127395155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21b52bcf-d1d3-48c8-bde2-9745fbeb13d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:04:28 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-f5cb1768-1eac-44b2-a85b-0e9b2c823219 tempest-CreateVolumesFromSnapshotTest-1127395155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4762b0e3-7a97-4ed6-8baf-03162cd47113) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:04:28 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-f5cb1768-1eac-44b2-a85b-0e9b2c823219 tempest-CreateVolumesFromSnapshotTest-1127395155 None] Volume 5522fb92-c1a5-4cf1-b383-71c8a54a3b48: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5522fb92-c1a5-4cf1-b383-71c8a54a3b48', 'volume_size': 1}
Jul 02 20:04:28 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-f5cb1768-1eac-44b2-a85b-0e9b2c823219 tempest-CreateVolumesFromSnapshotTest-1127395155 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 20:04:28 devstack cinder-volume[86639]: DEBUG cinder.volume.flows.manager.create_volume [None req-2977c3c2-cd92-4a3b-9436-6929d122a5dd tempest-CreateVolumesFromImageTest-5083140 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 20:04:28 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-2977c3c2-cd92-4a3b-9436-6929d122a5dd tempest-CreateVolumesFromImageTest-5083140 None] Flow 'volume_create_manager' (6e2db8f2-f6a2-4e68-ba2a-bbcb8d03b32a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 20:04:28 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-2977c3c2-cd92-4a3b-9436-6929d122a5dd tempest-CreateVolumesFromImageTest-5083140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14c788bd-db2e-4898-86a9-9d2861d402e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:04:28 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-2977c3c2-cd92-4a3b-9436-6929d122a5dd tempest-CreateVolumesFromImageTest-5083140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14c788bd-db2e-4898-86a9-9d2861d402e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T18:04:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1681264195',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f95f8e3a-352c-4e29-b397-b42f830d5636,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8845934471604a91a853a5ef56c1099d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T18:04:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T18:04:28Z,use_quota=True,user_id='7f9781a1c6da4ebb85f228d5ed285ebe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:04:28 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-2977c3c2-cd92-4a3b-9436-6929d122a5dd tempest-CreateVolumesFromImageTest-5083140 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c833b63-1344-475f-b074-ce71cbb622eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:04:28 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-2977c3c2-cd92-4a3b-9436-6929d122a5dd tempest-CreateVolumesFromImageTest-5083140 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c833b63-1344-475f-b074-ce71cbb622eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:04:28 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-2977c3c2-cd92-4a3b-9436-6929d122a5dd tempest-CreateVolumesFromImageTest-5083140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (842ae95a-6229-4238-adf2-68ff733f255c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:04:28 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-2977c3c2-cd92-4a3b-9436-6929d122a5dd tempest-CreateVolumesFromImageTest-5083140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (842ae95a-6229-4238-adf2-68ff733f255c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f95f8e3a-352c-4e29-b397-b42f830d5636', 'volume_name': 'volume-f95f8e3a-352c-4e29-b397-b42f830d5636', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:04:28 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-2977c3c2-cd92-4a3b-9436-6929d122a5dd tempest-CreateVolumesFromImageTest-5083140 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac2ba2d9-bf2e-4db2-b0a0-e3ccd2ad5e03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:04:28 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-2977c3c2-cd92-4a3b-9436-6929d122a5dd tempest-CreateVolumesFromImageTest-5083140 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac2ba2d9-bf2e-4db2-b0a0-e3ccd2ad5e03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:04:28 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-2977c3c2-cd92-4a3b-9436-6929d122a5dd tempest-CreateVolumesFromImageTest-5083140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59c508cf-2539-44aa-93e1-98e796edddea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:04:28 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-2977c3c2-cd92-4a3b-9436-6929d122a5dd tempest-CreateVolumesFromImageTest-5083140 None] Volume f95f8e3a-352c-4e29-b397-b42f830d5636: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f95f8e3a-352c-4e29-b397-b42f830d5636', 'volume_size': 1}
Jul 02 20:04:28 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-2977c3c2-cd92-4a3b-9436-6929d122a5dd tempest-CreateVolumesFromImageTest-5083140 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 20:04:28 devstack cinder-volume[86639]: DEBUG cinder.volume.flows.manager.create_volume [None req-8bf329f5-c647-4d11-a082-23d187d083bd tempest-CreateVolumesFromImageTest-5083140 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 20:04:28 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-8bf329f5-c647-4d11-a082-23d187d083bd tempest-CreateVolumesFromImageTest-5083140 None] Flow 'volume_create_manager' (2d13ce6c-9faf-422a-b075-e327bb302d84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 20:04:28 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-8bf329f5-c647-4d11-a082-23d187d083bd tempest-CreateVolumesFromImageTest-5083140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5743a3c0-606f-42c9-869e-4396bc92cd15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:04:28 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-8bf329f5-c647-4d11-a082-23d187d083bd tempest-CreateVolumesFromImageTest-5083140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5743a3c0-606f-42c9-869e-4396bc92cd15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T18:04:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-535631295',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b671d890-7e05-4b2a-bdb3-9a90e23364dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8845934471604a91a853a5ef56c1099d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T18:04:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T18:04:28Z,use_quota=True,user_id='7f9781a1c6da4ebb85f228d5ed285ebe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:04:28 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-8bf329f5-c647-4d11-a082-23d187d083bd tempest-CreateVolumesFromImageTest-5083140 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ed5747e-12b5-4a9d-9261-e0dc3a7c1ce2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:04:28 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-8bf329f5-c647-4d11-a082-23d187d083bd tempest-CreateVolumesFromImageTest-5083140 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ed5747e-12b5-4a9d-9261-e0dc3a7c1ce2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:04:28 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-8bf329f5-c647-4d11-a082-23d187d083bd tempest-CreateVolumesFromImageTest-5083140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56b34e9b-855b-4da0-bb60-142189bad8d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:04:28 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-8bf329f5-c647-4d11-a082-23d187d083bd tempest-CreateVolumesFromImageTest-5083140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56b34e9b-855b-4da0-bb60-142189bad8d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b671d890-7e05-4b2a-bdb3-9a90e23364dd', 'volume_name': 'volume-b671d890-7e05-4b2a-bdb3-9a90e23364dd', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:04:28 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-8bf329f5-c647-4d11-a082-23d187d083bd tempest-CreateVolumesFromImageTest-5083140 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (400864d8-dea7-4179-9a7d-cc66c693ba08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:04:28 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-8bf329f5-c647-4d11-a082-23d187d083bd tempest-CreateVolumesFromImageTest-5083140 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (400864d8-dea7-4179-9a7d-cc66c693ba08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:04:28 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-8bf329f5-c647-4d11-a082-23d187d083bd tempest-CreateVolumesFromImageTest-5083140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ef8b93d-09f7-493f-8a71-23a0bc455b18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:04:28 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-8bf329f5-c647-4d11-a082-23d187d083bd tempest-CreateVolumesFromImageTest-5083140 None] Volume b671d890-7e05-4b2a-bdb3-9a90e23364dd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b671d890-7e05-4b2a-bdb3-9a90e23364dd', 'volume_size': 1}
Jul 02 20:04:28 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-8bf329f5-c647-4d11-a082-23d187d083bd tempest-CreateVolumesFromImageTest-5083140 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 20:04:28 devstack sudo[106689]: pam_unix(sudo:session): session closed for user root
Jul 02 20:04:28 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-5294ee67-66c2-432a-8159-c8930842a771 tempest-CinderUnicodeTest-1101475161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-34ec6bc0-000f-4c69-b004-41e91e29566a 1073741824" returned: 0 in 1.311s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:04:28 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-5294ee67-66c2-432a-8159-c8930842a771 tempest-CinderUnicodeTest-1101475161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-34ec6bc0-000f-4c69-b004-41e91e29566a {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:04:28 devstack sudo[106695]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-34ec6bc0-000f-4c69-b004-41e91e29566a
Jul 02 20:04:28 devstack sudo[106695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:04:28 devstack cinder-volume[86639]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f41f7b0-6764-4adb-93bc-1c1236f7615f tempest-CreateVolumesFromImageTest-5083140 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 20:04:29 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-4f41f7b0-6764-4adb-93bc-1c1236f7615f tempest-CreateVolumesFromImageTest-5083140 None] Flow 'volume_create_manager' (73394acf-e595-4cf9-90a4-e6610a775c8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 20:04:29 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-4f41f7b0-6764-4adb-93bc-1c1236f7615f tempest-CreateVolumesFromImageTest-5083140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8bf0998-5b4e-457f-a249-a81d87c322d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:04:29 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-4f41f7b0-6764-4adb-93bc-1c1236f7615f tempest-CreateVolumesFromImageTest-5083140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8bf0998-5b4e-457f-a249-a81d87c322d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T18:04:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-394025160',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0183b9f-efa8-4207-8ebd-b41532a4eab4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8845934471604a91a853a5ef56c1099d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T18:04:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T18:04:29Z,use_quota=True,user_id='7f9781a1c6da4ebb85f228d5ed285ebe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:04:29 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-4f41f7b0-6764-4adb-93bc-1c1236f7615f tempest-CreateVolumesFromImageTest-5083140 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ca0cf04-5132-452d-840e-117ff70fb1ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:04:29 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-4f41f7b0-6764-4adb-93bc-1c1236f7615f tempest-CreateVolumesFromImageTest-5083140 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ca0cf04-5132-452d-840e-117ff70fb1ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:04:29 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-4f41f7b0-6764-4adb-93bc-1c1236f7615f tempest-CreateVolumesFromImageTest-5083140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c114916-eca8-423a-8e16-465d48f3c681) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:04:29 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-4f41f7b0-6764-4adb-93bc-1c1236f7615f tempest-CreateVolumesFromImageTest-5083140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c114916-eca8-423a-8e16-465d48f3c681) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b0183b9f-efa8-4207-8ebd-b41532a4eab4', 'volume_name': 'volume-b0183b9f-efa8-4207-8ebd-b41532a4eab4', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:04:29 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-4f41f7b0-6764-4adb-93bc-1c1236f7615f tempest-CreateVolumesFromImageTest-5083140 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e98fd5f-66a0-46a0-81ff-9b5d7d5f282b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:04:29 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-4f41f7b0-6764-4adb-93bc-1c1236f7615f tempest-CreateVolumesFromImageTest-5083140 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e98fd5f-66a0-46a0-81ff-9b5d7d5f282b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:04:29 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-4f41f7b0-6764-4adb-93bc-1c1236f7615f tempest-CreateVolumesFromImageTest-5083140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54762552-02ee-48d6-a4e3-51e3d776a27c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:04:29 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-4f41f7b0-6764-4adb-93bc-1c1236f7615f tempest-CreateVolumesFromImageTest-5083140 None] Volume b0183b9f-efa8-4207-8ebd-b41532a4eab4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b0183b9f-efa8-4207-8ebd-b41532a4eab4', 'volume_size': 1}
Jul 02 20:04:29 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-4f41f7b0-6764-4adb-93bc-1c1236f7615f tempest-CreateVolumesFromImageTest-5083140 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 20:04:29 devstack sudo[106695]: pam_unix(sudo:session): session closed for user root
Jul 02 20:04:29 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-5294ee67-66c2-432a-8159-c8930842a771 tempest-CinderUnicodeTest-1101475161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-34ec6bc0-000f-4c69-b004-41e91e29566a" returned: 0 in 0.692s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:04:29 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-5294ee67-66c2-432a-8159-c8930842a771 tempest-CinderUnicodeTest-1101475161 None] <== create_volume: return (2083ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'} {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 20:04:29 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-5294ee67-66c2-432a-8159-c8930842a771 tempest-CinderUnicodeTest-1101475161 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.087s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 20:04:29 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-89ef9808-9ce6-487d-9e6b-47c664165dde tempest-CreateVolumesFromImageTest-5083140 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.843s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 20:04:29 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-89ef9808-9ce6-487d-9e6b-47c664165dde tempest-CreateVolumesFromImageTest-5083140 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce906cb830>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T18:04:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-659892572',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=028322ce-d9b7-45d6-84d2-d01de4808af1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8845934471604a91a853a5ef56c1099d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T18:04:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T18:04:27Z,use_quota=True,user_id='7f9781a1c6da4ebb85f228d5ed285ebe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)}" {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 20:04:29 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-89ef9808-9ce6-487d-9e6b-47c664165dde tempest-CreateVolumesFromImageTest-5083140 None] Creating volume 028322ce-d9b7-45d6-84d2-d01de4808af1 {{(pid=86639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 20:04:29 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-89ef9808-9ce6-487d-9e6b-47c664165dde tempest-CreateVolumesFromImageTest-5083140 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 20:04:29 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-89ef9808-9ce6-487d-9e6b-47c664165dde tempest-CreateVolumesFromImageTest-5083140 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 20:04:29 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-89ef9808-9ce6-487d-9e6b-47c664165dde tempest-CreateVolumesFromImageTest-5083140 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 20:04:29 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-89ef9808-9ce6-487d-9e6b-47c664165dde tempest-CreateVolumesFromImageTest-5083140 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 20:04:29 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-89ef9808-9ce6-487d-9e6b-47c664165dde tempest-CreateVolumesFromImageTest-5083140 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 20:04:29 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-89ef9808-9ce6-487d-9e6b-47c664165dde tempest-CreateVolumesFromImageTest-5083140 None] Selected osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92 as target Quobyte volume. {{(pid=86639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 20:04:29 devstack cinder-volume[86639]: INFO cinder.volume.drivers.remotefs [None req-89ef9808-9ce6-487d-9e6b-47c664165dde tempest-CreateVolumesFromImageTest-5083140 None] casted to osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92
Jul 02 20:04:29 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-89ef9808-9ce6-487d-9e6b-47c664165dde tempest-CreateVolumesFromImageTest-5083140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-028322ce-d9b7-45d6-84d2-d01de4808af1 1073741824 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:04:29 devstack sudo[106698]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-028322ce-d9b7-45d6-84d2-d01de4808af1 1073741824
Jul 02 20:04:29 devstack sudo[106698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:04:29 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-5294ee67-66c2-432a-8159-c8930842a771 tempest-CinderUnicodeTest-1101475161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3fef553-cd00-4151-a112-5df3f0a74270) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-34ec6bc0-000f-4c69-b004-41e91e29566a', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:04:29 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-5294ee67-66c2-432a-8159-c8930842a771 tempest-CinderUnicodeTest-1101475161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12806b0f-4819-4602-811f-b0e8c986319e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:04:29 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-5294ee67-66c2-432a-8159-c8930842a771 tempest-CinderUnicodeTest-1101475161 None] Volume volume-34ec6bc0-000f-4c69-b004-41e91e29566a (34ec6bc0-000f-4c69-b004-41e91e29566a): created successfully
Jul 02 20:04:29 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-5294ee67-66c2-432a-8159-c8930842a771 tempest-CinderUnicodeTest-1101475161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12806b0f-4819-4602-811f-b0e8c986319e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:04:29 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-5294ee67-66c2-432a-8159-c8930842a771 tempest-CinderUnicodeTest-1101475161 None] Flow 'volume_create_manager' (20e4efb8-caa9-470e-adb1-a3e79a9f920c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 20:04:29 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-5294ee67-66c2-432a-8159-c8930842a771 tempest-CinderUnicodeTest-1101475161 None] Created volume successfully.
Jul 02 20:04:30 devstack sudo[106698]: pam_unix(sudo:session): session closed for user root
Jul 02 20:04:30 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-89ef9808-9ce6-487d-9e6b-47c664165dde tempest-CreateVolumesFromImageTest-5083140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-028322ce-d9b7-45d6-84d2-d01de4808af1 1073741824" returned: 0 in 1.018s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:04:30 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-89ef9808-9ce6-487d-9e6b-47c664165dde tempest-CreateVolumesFromImageTest-5083140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-028322ce-d9b7-45d6-84d2-d01de4808af1 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:04:30 devstack sudo[106704]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-028322ce-d9b7-45d6-84d2-d01de4808af1
Jul 02 20:04:30 devstack sudo[106704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:04:30 devstack cinder-volume[86639]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4ad002b-8225-4104-a017-b40fb01c3c61 tempest-CinderUnicodeTest-1101475161 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 20:04:30 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-f4ad002b-8225-4104-a017-b40fb01c3c61 tempest-CinderUnicodeTest-1101475161 None] Flow 'volume_create_manager' (f96a52de-4146-4cc1-a8ed-12e2cc710303) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 20:04:30 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-f4ad002b-8225-4104-a017-b40fb01c3c61 tempest-CinderUnicodeTest-1101475161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a52698a-c66b-43ae-bf39-1ad07a9ee67d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:04:30 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-f4ad002b-8225-4104-a017-b40fb01c3c61 tempest-CinderUnicodeTest-1101475161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a52698a-c66b-43ae-bf39-1ad07a9ee67d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T18:04:30Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1599466203',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=757d373a-a944-4ace-8acb-8929b8f3ffc5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59e2fda238d34363b7dc273cbafc8320',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T18:04:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T18:04:31Z,use_quota=True,user_id='8412d7ea508d47578a31135eadf8ea5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:04:30 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-f4ad002b-8225-4104-a017-b40fb01c3c61 tempest-CinderUnicodeTest-1101475161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e650313a-0e21-4119-926f-851b84c04d5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:04:30 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-f4ad002b-8225-4104-a017-b40fb01c3c61 tempest-CinderUnicodeTest-1101475161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e650313a-0e21-4119-926f-851b84c04d5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:04:30 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-f4ad002b-8225-4104-a017-b40fb01c3c61 tempest-CinderUnicodeTest-1101475161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e081cb6-5d35-483d-9e38-94a3f0b33072) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:04:30 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-f4ad002b-8225-4104-a017-b40fb01c3c61 tempest-CinderUnicodeTest-1101475161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e081cb6-5d35-483d-9e38-94a3f0b33072) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '757d373a-a944-4ace-8acb-8929b8f3ffc5', 'volume_name': 'volume-757d373a-a944-4ace-8acb-8929b8f3ffc5', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:04:30 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-f4ad002b-8225-4104-a017-b40fb01c3c61 tempest-CinderUnicodeTest-1101475161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef53852f-7e9a-46a1-953d-4512e4e0c9c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:04:30 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-f4ad002b-8225-4104-a017-b40fb01c3c61 tempest-CinderUnicodeTest-1101475161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef53852f-7e9a-46a1-953d-4512e4e0c9c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:04:30 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-f4ad002b-8225-4104-a017-b40fb01c3c61 tempest-CinderUnicodeTest-1101475161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbfd75f6-77f2-46eb-975e-bb84803e0e10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:04:30 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-f4ad002b-8225-4104-a017-b40fb01c3c61 tempest-CinderUnicodeTest-1101475161 None] Volume 757d373a-a944-4ace-8acb-8929b8f3ffc5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-757d373a-a944-4ace-8acb-8929b8f3ffc5', 'volume_size': 1}
Jul 02 20:04:30 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-f4ad002b-8225-4104-a017-b40fb01c3c61 tempest-CinderUnicodeTest-1101475161 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 20:04:31 devstack sudo[106704]: pam_unix(sudo:session): session closed for user root
Jul 02 20:04:31 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-89ef9808-9ce6-487d-9e6b-47c664165dde tempest-CreateVolumesFromImageTest-5083140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-028322ce-d9b7-45d6-84d2-d01de4808af1" returned: 0 in 0.718s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:04:31 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-89ef9808-9ce6-487d-9e6b-47c664165dde tempest-CreateVolumesFromImageTest-5083140 None] <== create_volume: return (1802ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'} {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 20:04:31 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-89ef9808-9ce6-487d-9e6b-47c664165dde tempest-CreateVolumesFromImageTest-5083140 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.804s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 20:04:31 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-9e530538-b153-4b96-8f4b-ee7890cc28de tempest-CreateVolumesFromImageTest-5083140 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.515s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 20:04:31 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-9e530538-b153-4b96-8f4b-ee7890cc28de tempest-CreateVolumesFromImageTest-5083140 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce906cb830>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T18:04:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-956105174',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=453fcf9c-db7a-442f-a64d-59dfc5d1428c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8845934471604a91a853a5ef56c1099d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T18:04:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T18:04:27Z,use_quota=True,user_id='7f9781a1c6da4ebb85f228d5ed285ebe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)}" {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 20:04:31 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-9e530538-b153-4b96-8f4b-ee7890cc28de tempest-CreateVolumesFromImageTest-5083140 None] Creating volume 453fcf9c-db7a-442f-a64d-59dfc5d1428c {{(pid=86639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 20:04:31 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-9e530538-b153-4b96-8f4b-ee7890cc28de tempest-CreateVolumesFromImageTest-5083140 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 20:04:31 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-9e530538-b153-4b96-8f4b-ee7890cc28de tempest-CreateVolumesFromImageTest-5083140 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 20:04:31 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-9e530538-b153-4b96-8f4b-ee7890cc28de tempest-CreateVolumesFromImageTest-5083140 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 20:04:31 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-9e530538-b153-4b96-8f4b-ee7890cc28de tempest-CreateVolumesFromImageTest-5083140 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 20:04:31 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-9e530538-b153-4b96-8f4b-ee7890cc28de tempest-CreateVolumesFromImageTest-5083140 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 20:04:31 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-9e530538-b153-4b96-8f4b-ee7890cc28de tempest-CreateVolumesFromImageTest-5083140 None] Selected osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92 as target Quobyte volume. {{(pid=86639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 20:04:31 devstack cinder-volume[86639]: INFO cinder.volume.drivers.remotefs [None req-9e530538-b153-4b96-8f4b-ee7890cc28de tempest-CreateVolumesFromImageTest-5083140 None] casted to osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92
Jul 02 20:04:31 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-9e530538-b153-4b96-8f4b-ee7890cc28de tempest-CreateVolumesFromImageTest-5083140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-453fcf9c-db7a-442f-a64d-59dfc5d1428c 1073741824 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:04:31 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-89ef9808-9ce6-487d-9e6b-47c664165dde tempest-CreateVolumesFromImageTest-5083140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67d0dfd1-d6a0-4e2e-985b-352b9dc27010) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-028322ce-d9b7-45d6-84d2-d01de4808af1', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:04:31 devstack sudo[106707]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-453fcf9c-db7a-442f-a64d-59dfc5d1428c 1073741824
Jul 02 20:04:31 devstack sudo[106707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:04:31 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-89ef9808-9ce6-487d-9e6b-47c664165dde tempest-CreateVolumesFromImageTest-5083140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94533b07-d51d-47b1-96e6-51a30d50ec74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:04:31 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-89ef9808-9ce6-487d-9e6b-47c664165dde tempest-CreateVolumesFromImageTest-5083140 None] Volume volume-028322ce-d9b7-45d6-84d2-d01de4808af1 (028322ce-d9b7-45d6-84d2-d01de4808af1): created successfully
Jul 02 20:04:31 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-89ef9808-9ce6-487d-9e6b-47c664165dde tempest-CreateVolumesFromImageTest-5083140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94533b07-d51d-47b1-96e6-51a30d50ec74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:04:31 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-89ef9808-9ce6-487d-9e6b-47c664165dde tempest-CreateVolumesFromImageTest-5083140 None] Flow 'volume_create_manager' (5d073ba5-01bd-4c1a-b7b7-a6590d543717) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 20:04:31 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-89ef9808-9ce6-487d-9e6b-47c664165dde tempest-CreateVolumesFromImageTest-5083140 None] Created volume successfully.
Jul 02 20:04:31 devstack cinder-volume[86639]: DEBUG cinder.volume.flows.manager.create_volume [None req-880ee1f5-99f5-474f-aa0d-7ff8f3447672 tempest-VolumeAndVolumeTypeFromImageTest-1431078512 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 20:04:31 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-880ee1f5-99f5-474f-aa0d-7ff8f3447672 tempest-VolumeAndVolumeTypeFromImageTest-1431078512 None] Flow 'volume_create_manager' (3a8a71ed-8235-4626-ab47-ff7e3b3800d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 20:04:31 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-880ee1f5-99f5-474f-aa0d-7ff8f3447672 tempest-VolumeAndVolumeTypeFromImageTest-1431078512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63918f92-b2c4-4ef8-bc34-a42be91ca250) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:04:31 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-880ee1f5-99f5-474f-aa0d-7ff8f3447672 tempest-VolumeAndVolumeTypeFromImageTest-1431078512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63918f92-b2c4-4ef8-bc34-a42be91ca250) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T18:04:31Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e5353fc-811f-44c7-b05e-1573507d50a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7782f7af12734e659dd0009d35f55e70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T18:04:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T18:04:31Z,use_quota=True,user_id='dfa2a4b97f2e4c1f848b1c21d8b5313a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f69f8382-0a32-4c45-b4de-b3edcd8c014b),volume_type_id=f69f8382-0a32-4c45-b4de-b3edcd8c014b)' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:04:31 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-880ee1f5-99f5-474f-aa0d-7ff8f3447672 tempest-VolumeAndVolumeTypeFromImageTest-1431078512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (908af3a1-d01d-4b0a-972d-b602903ba713) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:04:31 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-880ee1f5-99f5-474f-aa0d-7ff8f3447672 tempest-VolumeAndVolumeTypeFromImageTest-1431078512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (908af3a1-d01d-4b0a-972d-b602903ba713) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:04:31 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-880ee1f5-99f5-474f-aa0d-7ff8f3447672 tempest-VolumeAndVolumeTypeFromImageTest-1431078512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed67d5ab-016e-4274-a6f5-ba768b116a24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:04:31 devstack cinder-volume[86639]: DEBUG cinder.image.glance [None req-880ee1f5-99f5-474f-aa0d-7ff8f3447672 tempest-VolumeAndVolumeTypeFromImageTest-1431078512 None] Creating Keystone auth plugin from conf {{(pid=86639) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jul 02 20:04:31 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-880ee1f5-99f5-474f-aa0d-7ff8f3447672 tempest-VolumeAndVolumeTypeFromImageTest-1431078512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed67d5ab-016e-4274-a6f5-ba768b116a24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '7e5353fc-811f-44c7-b05e-1573507d50a1', 'volume_name': 'volume-7e5353fc-811f-44c7-b05e-1573507d50a1', 'volume_size': 1, 'image_id': '9244de81-7e30-4359-8173-2858997d1cb2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9244de81-7e30-4359-8173-2858997d1cb2', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '07e4762e075927f55a0404c6a01b0b60', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '7782f7af12734e659dd0009d35f55e70', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ef6aa29076c4512b2e19099d91a38269497442a23c48644e811604deb4e36de059a49bb06e34c22cafbd0ca6da20a4d967bd5e93971e8cec404711a3cc6a4c1d', 'id': '9244de81-7e30-4359-8173-2858997d1cb2', 'created_at': datetime.datetime(2026, 7, 2, 18, 4, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 2, 18, 4, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9244de81-7e30-4359-8173-2858997d1cb2/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fce84adcd10>}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:04:31 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-880ee1f5-99f5-474f-aa0d-7ff8f3447672 tempest-VolumeAndVolumeTypeFromImageTest-1431078512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f9e91b8-d664-4d1f-a722-8d91159249e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:04:31 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-880ee1f5-99f5-474f-aa0d-7ff8f3447672 tempest-VolumeAndVolumeTypeFromImageTest-1431078512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f9e91b8-d664-4d1f-a722-8d91159249e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:04:31 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-880ee1f5-99f5-474f-aa0d-7ff8f3447672 tempest-VolumeAndVolumeTypeFromImageTest-1431078512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e93984e8-4d26-45b2-967f-c4daf79f25a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:04:31 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-880ee1f5-99f5-474f-aa0d-7ff8f3447672 tempest-VolumeAndVolumeTypeFromImageTest-1431078512 None] Volume 7e5353fc-811f-44c7-b05e-1573507d50a1: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-7e5353fc-811f-44c7-b05e-1573507d50a1', 'volume_size': 1, 'image_id': '9244de81-7e30-4359-8173-2858997d1cb2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9244de81-7e30-4359-8173-2858997d1cb2', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '07e4762e075927f55a0404c6a01b0b60', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '7782f7af12734e659dd0009d35f55e70', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ef6aa29076c4512b2e19099d91a38269497442a23c48644e811604deb4e36de059a49bb06e34c22cafbd0ca6da20a4d967bd5e93971e8cec404711a3cc6a4c1d', 'id': '9244de81-7e30-4359-8173-2858997d1cb2', 'created_at': datetime.datetime(2026, 7, 2, 18, 4, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 2, 18, 4, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9244de81-7e30-4359-8173-2858997d1cb2/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fce84adcd10>}
Jul 02 20:04:31 devstack cinder-volume[86639]: DEBUG cinder.volume.flows.manager.create_volume [None req-880ee1f5-99f5-474f-aa0d-7ff8f3447672 tempest-VolumeAndVolumeTypeFromImageTest-1431078512 None] Trying to clone 7e5353fc-811f-44c7-b05e-1573507d50a1 from image 9244de81-7e30-4359-8173-2858997d1cb2 at location (None, [{'url': 'file:///opt/stack/data/glance/images/9244de81-7e30-4359-8173-2858997d1cb2', 'metadata': {}}]). {{(pid=86639) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jul 02 20:04:31 devstack cinder-volume[86639]: DEBUG cinder.image.image_utils [None req-880ee1f5-99f5-474f-aa0d-7ff8f3447672 tempest-VolumeAndVolumeTypeFromImageTest-1431078512 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_9244de81-7e30-4359-8173-2858997d1cb2_v96k0njldevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86639) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jul 02 20:04:31 devstack cinder-volume[86639]: INFO cinder.image.image_utils [None req-880ee1f5-99f5-474f-aa0d-7ff8f3447672 tempest-VolumeAndVolumeTypeFromImageTest-1431078512 None] Image download 0.00 MB at 0.00 MB/s
Jul 02 20:04:31 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[808c0e93-65d3-4f43-a47c-6d7dffe9ade0]: (4, 'raw') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 20:04:31 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-880ee1f5-99f5-474f-aa0d-7ff8f3447672 tempest-VolumeAndVolumeTypeFromImageTest-1431078512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9244de81-7e30-4359-8173-2858997d1cb2_v96k0njldevstack@QuobyteHD {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:04:31 devstack sudo[106709]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9244de81-7e30-4359-8173-2858997d1cb2_v96k0njldevstack@QuobyteHD
Jul 02 20:04:32 devstack sudo[106709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:04:32 devstack sudo[106707]: pam_unix(sudo:session): session closed for user root
Jul 02 20:04:32 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-9e530538-b153-4b96-8f4b-ee7890cc28de tempest-CreateVolumesFromImageTest-5083140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-453fcf9c-db7a-442f-a64d-59dfc5d1428c 1073741824" returned: 0 in 0.880s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:04:32 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-9e530538-b153-4b96-8f4b-ee7890cc28de tempest-CreateVolumesFromImageTest-5083140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-453fcf9c-db7a-442f-a64d-59dfc5d1428c {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:04:32 devstack sudo[106715]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-453fcf9c-db7a-442f-a64d-59dfc5d1428c
Jul 02 20:04:32 devstack sudo[106715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:04:32 devstack sudo[106709]: pam_unix(sudo:session): session closed for user root
Jul 02 20:04:32 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-880ee1f5-99f5-474f-aa0d-7ff8f3447672 tempest-VolumeAndVolumeTypeFromImageTest-1431078512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9244de81-7e30-4359-8173-2858997d1cb2_v96k0njldevstack@QuobyteHD" returned: 0 in 0.751s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:04:32 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-880ee1f5-99f5-474f-aa0d-7ff8f3447672 tempest-VolumeAndVolumeTypeFromImageTest-1431078512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9244de81-7e30-4359-8173-2858997d1cb2_v96k0njldevstack@QuobyteHD {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:04:32 devstack sudo[106719]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9244de81-7e30-4359-8173-2858997d1cb2_v96k0njldevstack@QuobyteHD
Jul 02 20:04:32 devstack sudo[106719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:04:32 devstack sudo[106715]: pam_unix(sudo:session): session closed for user root
Jul 02 20:04:32 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-9e530538-b153-4b96-8f4b-ee7890cc28de tempest-CreateVolumesFromImageTest-5083140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-453fcf9c-db7a-442f-a64d-59dfc5d1428c" returned: 0 in 0.684s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:04:32 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-9e530538-b153-4b96-8f4b-ee7890cc28de tempest-CreateVolumesFromImageTest-5083140 None] <== create_volume: return (1604ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'} {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 20:04:32 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-9e530538-b153-4b96-8f4b-ee7890cc28de tempest-CreateVolumesFromImageTest-5083140 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.606s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 20:04:32 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-f5cb1768-1eac-44b2-a85b-0e9b2c823219 tempest-CreateVolumesFromSnapshotTest-1127395155 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.828s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 20:04:32 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-f5cb1768-1eac-44b2-a85b-0e9b2c823219 tempest-CreateVolumesFromSnapshotTest-1127395155 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce906cb830>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T18:04:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-30201440',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5522fb92-c1a5-4cf1-b383-71c8a54a3b48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfffcb664c3f4b49b07a3412c1642700',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T18:04:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T18:04:28Z,use_quota=True,user_id='ca1bd1389a844499a1f59dc320b608a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)}" {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 20:04:32 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-f5cb1768-1eac-44b2-a85b-0e9b2c823219 tempest-CreateVolumesFromSnapshotTest-1127395155 None] Creating volume 5522fb92-c1a5-4cf1-b383-71c8a54a3b48 {{(pid=86639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 20:04:32 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-f5cb1768-1eac-44b2-a85b-0e9b2c823219 tempest-CreateVolumesFromSnapshotTest-1127395155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 20:04:32 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-f5cb1768-1eac-44b2-a85b-0e9b2c823219 tempest-CreateVolumesFromSnapshotTest-1127395155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 20:04:32 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-f5cb1768-1eac-44b2-a85b-0e9b2c823219 tempest-CreateVolumesFromSnapshotTest-1127395155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 20:04:32 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-f5cb1768-1eac-44b2-a85b-0e9b2c823219 tempest-CreateVolumesFromSnapshotTest-1127395155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 20:04:32 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-f5cb1768-1eac-44b2-a85b-0e9b2c823219 tempest-CreateVolumesFromSnapshotTest-1127395155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 20:04:32 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-f5cb1768-1eac-44b2-a85b-0e9b2c823219 tempest-CreateVolumesFromSnapshotTest-1127395155 None] Selected osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92 as target Quobyte volume. {{(pid=86639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 20:04:32 devstack cinder-volume[86639]: INFO cinder.volume.drivers.remotefs [None req-f5cb1768-1eac-44b2-a85b-0e9b2c823219 tempest-CreateVolumesFromSnapshotTest-1127395155 None] casted to osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92
Jul 02 20:04:32 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-f5cb1768-1eac-44b2-a85b-0e9b2c823219 tempest-CreateVolumesFromSnapshotTest-1127395155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-5522fb92-c1a5-4cf1-b383-71c8a54a3b48 1073741824 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:04:32 devstack sudo[106722]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-5522fb92-c1a5-4cf1-b383-71c8a54a3b48 1073741824
Jul 02 20:04:32 devstack sudo[106722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:04:32 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-9e530538-b153-4b96-8f4b-ee7890cc28de tempest-CreateVolumesFromImageTest-5083140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6562f1df-3610-4336-96e6-1709e96e099f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-453fcf9c-db7a-442f-a64d-59dfc5d1428c', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:04:32 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-9e530538-b153-4b96-8f4b-ee7890cc28de tempest-CreateVolumesFromImageTest-5083140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5e7d3c7-79da-4b16-af43-91cc16cefe86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:04:32 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-9e530538-b153-4b96-8f4b-ee7890cc28de tempest-CreateVolumesFromImageTest-5083140 None] Volume volume-453fcf9c-db7a-442f-a64d-59dfc5d1428c (453fcf9c-db7a-442f-a64d-59dfc5d1428c): created successfully
Jul 02 20:04:32 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-9e530538-b153-4b96-8f4b-ee7890cc28de tempest-CreateVolumesFromImageTest-5083140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5e7d3c7-79da-4b16-af43-91cc16cefe86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:04:32 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-9e530538-b153-4b96-8f4b-ee7890cc28de tempest-CreateVolumesFromImageTest-5083140 None] Flow 'volume_create_manager' (e1317904-d155-4ef6-91ef-c84f53208825) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 20:04:33 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-9e530538-b153-4b96-8f4b-ee7890cc28de tempest-CreateVolumesFromImageTest-5083140 None] Created volume successfully.
Jul 02 20:04:33 devstack sudo[106719]: pam_unix(sudo:session): session closed for user root
Jul 02 20:04:33 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-880ee1f5-99f5-474f-aa0d-7ff8f3447672 tempest-VolumeAndVolumeTypeFromImageTest-1431078512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9244de81-7e30-4359-8173-2858997d1cb2_v96k0njldevstack@QuobyteHD" returned: 1 in 0.731s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:04:33 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-880ee1f5-99f5-474f-aa0d-7ff8f3447672 tempest-VolumeAndVolumeTypeFromImageTest-1431078512 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9244de81-7e30-4359-8173-2858997d1cb2_v96k0njldevstack@QuobyteHD' failed. Not Retrying. {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 02 20:04:33 devstack cinder-volume[86639]: DEBUG cinder.image.image_utils [None req-880ee1f5-99f5-474f-aa0d-7ff8f3447672 tempest-VolumeAndVolumeTypeFromImageTest-1431078512 None] Temporary image 9244de81-7e30-4359-8173-2858997d1cb2 is fetched for user dfa2a4b97f2e4c1f848b1c21d8b5313a. {{(pid=86639) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jul 02 20:04:33 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bc20b31-67ca-485e-8a9b-7a56d5530e08]: (4, 'raw') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 20:04:33 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-880ee1f5-99f5-474f-aa0d-7ff8f3447672 tempest-VolumeAndVolumeTypeFromImageTest-1431078512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9244de81-7e30-4359-8173-2858997d1cb2_v96k0njldevstack@QuobyteHD {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:04:33 devstack sudo[106727]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9244de81-7e30-4359-8173-2858997d1cb2_v96k0njldevstack@QuobyteHD
Jul 02 20:04:33 devstack sudo[106727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:04:33 devstack sudo[106722]: pam_unix(sudo:session): session closed for user root
Jul 02 20:04:33 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-f5cb1768-1eac-44b2-a85b-0e9b2c823219 tempest-CreateVolumesFromSnapshotTest-1127395155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-5522fb92-c1a5-4cf1-b383-71c8a54a3b48 1073741824" returned: 0 in 0.891s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:04:33 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-f5cb1768-1eac-44b2-a85b-0e9b2c823219 tempest-CreateVolumesFromSnapshotTest-1127395155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-5522fb92-c1a5-4cf1-b383-71c8a54a3b48 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:04:33 devstack sudo[106732]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-5522fb92-c1a5-4cf1-b383-71c8a54a3b48
Jul 02 20:04:33 devstack sudo[106732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:04:34 devstack sudo[106727]: pam_unix(sudo:session): session closed for user root
Jul 02 20:04:34 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-880ee1f5-99f5-474f-aa0d-7ff8f3447672 tempest-VolumeAndVolumeTypeFromImageTest-1431078512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9244de81-7e30-4359-8173-2858997d1cb2_v96k0njldevstack@QuobyteHD" returned: 0 in 0.720s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:04:34 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-880ee1f5-99f5-474f-aa0d-7ff8f3447672 tempest-VolumeAndVolumeTypeFromImageTest-1431078512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9244de81-7e30-4359-8173-2858997d1cb2_v96k0njldevstack@QuobyteHD {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:04:34 devstack sudo[106740]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9244de81-7e30-4359-8173-2858997d1cb2_v96k0njldevstack@QuobyteHD
Jul 02 20:04:34 devstack sudo[106740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:04:34 devstack sudo[106732]: pam_unix(sudo:session): session closed for user root
Jul 02 20:04:34 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-f5cb1768-1eac-44b2-a85b-0e9b2c823219 tempest-CreateVolumesFromSnapshotTest-1127395155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-5522fb92-c1a5-4cf1-b383-71c8a54a3b48" returned: 0 in 0.648s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:04:34 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-f5cb1768-1eac-44b2-a85b-0e9b2c823219 tempest-CreateVolumesFromSnapshotTest-1127395155 None] <== create_volume: return (1583ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'} {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 20:04:34 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-f5cb1768-1eac-44b2-a85b-0e9b2c823219 tempest-CreateVolumesFromSnapshotTest-1127395155 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.585s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 20:04:34 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-2977c3c2-cd92-4a3b-9436-6929d122a5dd tempest-CreateVolumesFromImageTest-5083140 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.141s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 20:04:34 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-2977c3c2-cd92-4a3b-9436-6929d122a5dd tempest-CreateVolumesFromImageTest-5083140 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce906cb830>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T18:04:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1681264195',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f95f8e3a-352c-4e29-b397-b42f830d5636,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8845934471604a91a853a5ef56c1099d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T18:04:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T18:04:28Z,use_quota=True,user_id='7f9781a1c6da4ebb85f228d5ed285ebe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)}" {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 20:04:34 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-2977c3c2-cd92-4a3b-9436-6929d122a5dd tempest-CreateVolumesFromImageTest-5083140 None] Creating volume f95f8e3a-352c-4e29-b397-b42f830d5636 {{(pid=86639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 20:04:34 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-2977c3c2-cd92-4a3b-9436-6929d122a5dd tempest-CreateVolumesFromImageTest-5083140 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 20:04:34 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-2977c3c2-cd92-4a3b-9436-6929d122a5dd tempest-CreateVolumesFromImageTest-5083140 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 20:04:34 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-2977c3c2-cd92-4a3b-9436-6929d122a5dd tempest-CreateVolumesFromImageTest-5083140 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 20:04:34 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-2977c3c2-cd92-4a3b-9436-6929d122a5dd tempest-CreateVolumesFromImageTest-5083140 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 20:04:34 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-2977c3c2-cd92-4a3b-9436-6929d122a5dd tempest-CreateVolumesFromImageTest-5083140 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 20:04:34 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-2977c3c2-cd92-4a3b-9436-6929d122a5dd tempest-CreateVolumesFromImageTest-5083140 None] Selected osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92 as target Quobyte volume. {{(pid=86639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 20:04:34 devstack cinder-volume[86639]: INFO cinder.volume.drivers.remotefs [None req-2977c3c2-cd92-4a3b-9436-6929d122a5dd tempest-CreateVolumesFromImageTest-5083140 None] casted to osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92
Jul 02 20:04:34 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-2977c3c2-cd92-4a3b-9436-6929d122a5dd tempest-CreateVolumesFromImageTest-5083140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-f95f8e3a-352c-4e29-b397-b42f830d5636 1073741824 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:04:34 devstack sudo[106746]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-f95f8e3a-352c-4e29-b397-b42f830d5636 1073741824
Jul 02 20:04:34 devstack sudo[106746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:04:34 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-f5cb1768-1eac-44b2-a85b-0e9b2c823219 tempest-CreateVolumesFromSnapshotTest-1127395155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4762b0e3-7a97-4ed6-8baf-03162cd47113) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5522fb92-c1a5-4cf1-b383-71c8a54a3b48', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:04:34 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-f5cb1768-1eac-44b2-a85b-0e9b2c823219 tempest-CreateVolumesFromSnapshotTest-1127395155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58deadb8-229d-46c4-8384-51f14f809200) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:04:34 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-f5cb1768-1eac-44b2-a85b-0e9b2c823219 tempest-CreateVolumesFromSnapshotTest-1127395155 None] Volume volume-5522fb92-c1a5-4cf1-b383-71c8a54a3b48 (5522fb92-c1a5-4cf1-b383-71c8a54a3b48): created successfully
Jul 02 20:04:34 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-f5cb1768-1eac-44b2-a85b-0e9b2c823219 tempest-CreateVolumesFromSnapshotTest-1127395155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58deadb8-229d-46c4-8384-51f14f809200) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:04:34 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-f5cb1768-1eac-44b2-a85b-0e9b2c823219 tempest-CreateVolumesFromSnapshotTest-1127395155 None] Flow 'volume_create_manager' (f2b415b1-1409-4e8a-a38c-0350a8a44eb1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 20:04:34 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-f5cb1768-1eac-44b2-a85b-0e9b2c823219 tempest-CreateVolumesFromSnapshotTest-1127395155 None] Created volume successfully.
Jul 02 20:04:34 devstack sudo[106740]: pam_unix(sudo:session): session closed for user root
Jul 02 20:04:34 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-880ee1f5-99f5-474f-aa0d-7ff8f3447672 tempest-VolumeAndVolumeTypeFromImageTest-1431078512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9244de81-7e30-4359-8173-2858997d1cb2_v96k0njldevstack@QuobyteHD" returned: 1 in 0.723s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:04:34 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-880ee1f5-99f5-474f-aa0d-7ff8f3447672 tempest-VolumeAndVolumeTypeFromImageTest-1431078512 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9244de81-7e30-4359-8173-2858997d1cb2_v96k0njldevstack@QuobyteHD' failed. Not Retrying. {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 02 20:04:34 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-880ee1f5-99f5-474f-aa0d-7ff8f3447672 tempest-VolumeAndVolumeTypeFromImageTest-1431078512 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 20:04:35 devstack sudo[106746]: pam_unix(sudo:session): session closed for user root
Jul 02 20:04:35 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-2977c3c2-cd92-4a3b-9436-6929d122a5dd tempest-CreateVolumesFromImageTest-5083140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-f95f8e3a-352c-4e29-b397-b42f830d5636 1073741824" returned: 0 in 0.891s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:04:35 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-2977c3c2-cd92-4a3b-9436-6929d122a5dd tempest-CreateVolumesFromImageTest-5083140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-f95f8e3a-352c-4e29-b397-b42f830d5636 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:04:35 devstack sudo[106789]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-f95f8e3a-352c-4e29-b397-b42f830d5636
Jul 02 20:04:35 devstack sudo[106789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:04:35 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-114482bc-c5be-4a60-9879-7a734e710cfa tempest-CreateVolumesFromSnapshotTest-1127395155 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 20:04:36 devstack sudo[106789]: pam_unix(sudo:session): session closed for user root
Jul 02 20:04:36 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-2977c3c2-cd92-4a3b-9436-6929d122a5dd tempest-CreateVolumesFromImageTest-5083140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-f95f8e3a-352c-4e29-b397-b42f830d5636" returned: 0 in 0.689s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:04:36 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-2977c3c2-cd92-4a3b-9436-6929d122a5dd tempest-CreateVolumesFromImageTest-5083140 None] <== create_volume: return (1642ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'} {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 20:04:36 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-2977c3c2-cd92-4a3b-9436-6929d122a5dd tempest-CreateVolumesFromImageTest-5083140 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.644s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 20:04:36 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-8bf329f5-c647-4d11-a082-23d187d083bd tempest-CreateVolumesFromImageTest-5083140 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.524s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 20:04:36 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-8bf329f5-c647-4d11-a082-23d187d083bd tempest-CreateVolumesFromImageTest-5083140 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce906cb830>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T18:04:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-535631295',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b671d890-7e05-4b2a-bdb3-9a90e23364dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8845934471604a91a853a5ef56c1099d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T18:04:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T18:04:28Z,use_quota=True,user_id='7f9781a1c6da4ebb85f228d5ed285ebe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)}" {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 20:04:36 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-8bf329f5-c647-4d11-a082-23d187d083bd tempest-CreateVolumesFromImageTest-5083140 None] Creating volume b671d890-7e05-4b2a-bdb3-9a90e23364dd {{(pid=86639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 20:04:36 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-8bf329f5-c647-4d11-a082-23d187d083bd tempest-CreateVolumesFromImageTest-5083140 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 20:04:36 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-8bf329f5-c647-4d11-a082-23d187d083bd tempest-CreateVolumesFromImageTest-5083140 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 20:04:36 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-8bf329f5-c647-4d11-a082-23d187d083bd tempest-CreateVolumesFromImageTest-5083140 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 20:04:36 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-8bf329f5-c647-4d11-a082-23d187d083bd tempest-CreateVolumesFromImageTest-5083140 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 20:04:36 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-8bf329f5-c647-4d11-a082-23d187d083bd tempest-CreateVolumesFromImageTest-5083140 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 20:04:36 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-8bf329f5-c647-4d11-a082-23d187d083bd tempest-CreateVolumesFromImageTest-5083140 None] Selected osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92 as target Quobyte volume. {{(pid=86639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 20:04:36 devstack cinder-volume[86639]: INFO cinder.volume.drivers.remotefs [None req-8bf329f5-c647-4d11-a082-23d187d083bd tempest-CreateVolumesFromImageTest-5083140 None] casted to osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92
Jul 02 20:04:36 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-8bf329f5-c647-4d11-a082-23d187d083bd tempest-CreateVolumesFromImageTest-5083140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-b671d890-7e05-4b2a-bdb3-9a90e23364dd 1073741824 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:04:36 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-2977c3c2-cd92-4a3b-9436-6929d122a5dd tempest-CreateVolumesFromImageTest-5083140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59c508cf-2539-44aa-93e1-98e796edddea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f95f8e3a-352c-4e29-b397-b42f830d5636', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:04:36 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-2977c3c2-cd92-4a3b-9436-6929d122a5dd tempest-CreateVolumesFromImageTest-5083140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3dad5f1f-e362-4643-89a3-942f80ebb9d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:04:36 devstack sudo[106794]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-b671d890-7e05-4b2a-bdb3-9a90e23364dd 1073741824
Jul 02 20:04:36 devstack sudo[106794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:04:36 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-2977c3c2-cd92-4a3b-9436-6929d122a5dd tempest-CreateVolumesFromImageTest-5083140 None] Volume volume-f95f8e3a-352c-4e29-b397-b42f830d5636 (f95f8e3a-352c-4e29-b397-b42f830d5636): created successfully
Jul 02 20:04:36 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-2977c3c2-cd92-4a3b-9436-6929d122a5dd tempest-CreateVolumesFromImageTest-5083140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3dad5f1f-e362-4643-89a3-942f80ebb9d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:04:36 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-2977c3c2-cd92-4a3b-9436-6929d122a5dd tempest-CreateVolumesFromImageTest-5083140 None] Flow 'volume_create_manager' (6e2db8f2-f6a2-4e68-ba2a-bbcb8d03b32a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 20:04:36 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-2977c3c2-cd92-4a3b-9436-6929d122a5dd tempest-CreateVolumesFromImageTest-5083140 None] Created volume successfully.
Jul 02 20:04:37 devstack sudo[106794]: pam_unix(sudo:session): session closed for user root
Jul 02 20:04:37 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-8bf329f5-c647-4d11-a082-23d187d083bd tempest-CreateVolumesFromImageTest-5083140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-b671d890-7e05-4b2a-bdb3-9a90e23364dd 1073741824" returned: 0 in 0.830s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:04:37 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-8bf329f5-c647-4d11-a082-23d187d083bd tempest-CreateVolumesFromImageTest-5083140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-b671d890-7e05-4b2a-bdb3-9a90e23364dd {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:04:37 devstack sudo[106800]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-b671d890-7e05-4b2a-bdb3-9a90e23364dd
Jul 02 20:04:37 devstack sudo[106800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:04:37 devstack sudo[106800]: pam_unix(sudo:session): session closed for user root
Jul 02 20:04:37 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-8bf329f5-c647-4d11-a082-23d187d083bd tempest-CreateVolumesFromImageTest-5083140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-b671d890-7e05-4b2a-bdb3-9a90e23364dd" returned: 0 in 0.643s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:04:37 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-8bf329f5-c647-4d11-a082-23d187d083bd tempest-CreateVolumesFromImageTest-5083140 None] <== create_volume: return (1516ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'} {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 20:04:37 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-8bf329f5-c647-4d11-a082-23d187d083bd tempest-CreateVolumesFromImageTest-5083140 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.520s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 20:04:37 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-4f41f7b0-6764-4adb-93bc-1c1236f7615f tempest-CreateVolumesFromImageTest-5083140 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.621s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 20:04:37 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-4f41f7b0-6764-4adb-93bc-1c1236f7615f tempest-CreateVolumesFromImageTest-5083140 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce906cb830>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T18:04:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-394025160',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0183b9f-efa8-4207-8ebd-b41532a4eab4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8845934471604a91a853a5ef56c1099d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T18:04:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T18:04:29Z,use_quota=True,user_id='7f9781a1c6da4ebb85f228d5ed285ebe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)}" {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 20:04:37 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-4f41f7b0-6764-4adb-93bc-1c1236f7615f tempest-CreateVolumesFromImageTest-5083140 None] Creating volume b0183b9f-efa8-4207-8ebd-b41532a4eab4 {{(pid=86639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 20:04:37 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-4f41f7b0-6764-4adb-93bc-1c1236f7615f tempest-CreateVolumesFromImageTest-5083140 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 20:04:37 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-4f41f7b0-6764-4adb-93bc-1c1236f7615f tempest-CreateVolumesFromImageTest-5083140 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 20:04:37 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-4f41f7b0-6764-4adb-93bc-1c1236f7615f tempest-CreateVolumesFromImageTest-5083140 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 20:04:37 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-4f41f7b0-6764-4adb-93bc-1c1236f7615f tempest-CreateVolumesFromImageTest-5083140 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 20:04:37 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-4f41f7b0-6764-4adb-93bc-1c1236f7615f tempest-CreateVolumesFromImageTest-5083140 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 20:04:37 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-4f41f7b0-6764-4adb-93bc-1c1236f7615f tempest-CreateVolumesFromImageTest-5083140 None] Selected osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92 as target Quobyte volume. {{(pid=86639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 20:04:37 devstack cinder-volume[86639]: INFO cinder.volume.drivers.remotefs [None req-4f41f7b0-6764-4adb-93bc-1c1236f7615f tempest-CreateVolumesFromImageTest-5083140 None] casted to osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92
Jul 02 20:04:37 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-4f41f7b0-6764-4adb-93bc-1c1236f7615f tempest-CreateVolumesFromImageTest-5083140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-b0183b9f-efa8-4207-8ebd-b41532a4eab4 1073741824 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:04:37 devstack sudo[106803]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-b0183b9f-efa8-4207-8ebd-b41532a4eab4 1073741824
Jul 02 20:04:37 devstack sudo[106803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:04:37 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-8bf329f5-c647-4d11-a082-23d187d083bd tempest-CreateVolumesFromImageTest-5083140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ef8b93d-09f7-493f-8a71-23a0bc455b18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b671d890-7e05-4b2a-bdb3-9a90e23364dd', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:04:37 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-8bf329f5-c647-4d11-a082-23d187d083bd tempest-CreateVolumesFromImageTest-5083140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24d5c084-29a7-4c7c-b57e-c294aca911c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:04:37 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-8bf329f5-c647-4d11-a082-23d187d083bd tempest-CreateVolumesFromImageTest-5083140 None] Volume volume-b671d890-7e05-4b2a-bdb3-9a90e23364dd (b671d890-7e05-4b2a-bdb3-9a90e23364dd): created successfully
Jul 02 20:04:37 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-8bf329f5-c647-4d11-a082-23d187d083bd tempest-CreateVolumesFromImageTest-5083140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24d5c084-29a7-4c7c-b57e-c294aca911c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:04:37 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-8bf329f5-c647-4d11-a082-23d187d083bd tempest-CreateVolumesFromImageTest-5083140 None] Flow 'volume_create_manager' (2d13ce6c-9faf-422a-b075-e327bb302d84) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 20:04:37 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-8bf329f5-c647-4d11-a082-23d187d083bd tempest-CreateVolumesFromImageTest-5083140 None] Created volume successfully.
Jul 02 20:04:38 devstack sudo[106803]: pam_unix(sudo:session): session closed for user root
Jul 02 20:04:38 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-4f41f7b0-6764-4adb-93bc-1c1236f7615f tempest-CreateVolumesFromImageTest-5083140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-b0183b9f-efa8-4207-8ebd-b41532a4eab4 1073741824" returned: 0 in 0.806s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:04:38 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-4f41f7b0-6764-4adb-93bc-1c1236f7615f tempest-CreateVolumesFromImageTest-5083140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-b0183b9f-efa8-4207-8ebd-b41532a4eab4 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:04:38 devstack sudo[106808]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-b0183b9f-efa8-4207-8ebd-b41532a4eab4
Jul 02 20:04:38 devstack sudo[106808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:04:39 devstack sudo[106808]: pam_unix(sudo:session): session closed for user root
Jul 02 20:04:39 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-4f41f7b0-6764-4adb-93bc-1c1236f7615f tempest-CreateVolumesFromImageTest-5083140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-b0183b9f-efa8-4207-8ebd-b41532a4eab4" returned: 0 in 0.652s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:04:39 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-4f41f7b0-6764-4adb-93bc-1c1236f7615f tempest-CreateVolumesFromImageTest-5083140 None] <== create_volume: return (1501ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'} {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 20:04:39 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-4f41f7b0-6764-4adb-93bc-1c1236f7615f tempest-CreateVolumesFromImageTest-5083140 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.503s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 20:04:39 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-f4ad002b-8225-4104-a017-b40fb01c3c61 tempest-CinderUnicodeTest-1101475161 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.376s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 20:04:39 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-f4ad002b-8225-4104-a017-b40fb01c3c61 tempest-CinderUnicodeTest-1101475161 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce906cb830>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T18:04:30Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1599466203',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=757d373a-a944-4ace-8acb-8929b8f3ffc5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59e2fda238d34363b7dc273cbafc8320',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T18:04:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T18:04:31Z,use_quota=True,user_id='8412d7ea508d47578a31135eadf8ea5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)}" {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 20:04:39 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-f4ad002b-8225-4104-a017-b40fb01c3c61 tempest-CinderUnicodeTest-1101475161 None] Creating volume 757d373a-a944-4ace-8acb-8929b8f3ffc5 {{(pid=86639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 20:04:39 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-f4ad002b-8225-4104-a017-b40fb01c3c61 tempest-CinderUnicodeTest-1101475161 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 20:04:39 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-f4ad002b-8225-4104-a017-b40fb01c3c61 tempest-CinderUnicodeTest-1101475161 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 20:04:39 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-f4ad002b-8225-4104-a017-b40fb01c3c61 tempest-CinderUnicodeTest-1101475161 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 20:04:39 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-f4ad002b-8225-4104-a017-b40fb01c3c61 tempest-CinderUnicodeTest-1101475161 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 20:04:39 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-f4ad002b-8225-4104-a017-b40fb01c3c61 tempest-CinderUnicodeTest-1101475161 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 20:04:39 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-f4ad002b-8225-4104-a017-b40fb01c3c61 tempest-CinderUnicodeTest-1101475161 None] Selected osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92 as target Quobyte volume. {{(pid=86639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 20:04:39 devstack cinder-volume[86639]: INFO cinder.volume.drivers.remotefs [None req-f4ad002b-8225-4104-a017-b40fb01c3c61 tempest-CinderUnicodeTest-1101475161 None] casted to osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92
Jul 02 20:04:39 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-f4ad002b-8225-4104-a017-b40fb01c3c61 tempest-CinderUnicodeTest-1101475161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-757d373a-a944-4ace-8acb-8929b8f3ffc5 1073741824 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:04:39 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-4f41f7b0-6764-4adb-93bc-1c1236f7615f tempest-CreateVolumesFromImageTest-5083140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54762552-02ee-48d6-a4e3-51e3d776a27c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b0183b9f-efa8-4207-8ebd-b41532a4eab4', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:04:39 devstack sudo[106811]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-757d373a-a944-4ace-8acb-8929b8f3ffc5 1073741824
Jul 02 20:04:39 devstack sudo[106811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:04:39 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-4f41f7b0-6764-4adb-93bc-1c1236f7615f tempest-CreateVolumesFromImageTest-5083140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28a3e26c-08f5-4bb9-813a-aa71afb85fdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:04:39 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-4f41f7b0-6764-4adb-93bc-1c1236f7615f tempest-CreateVolumesFromImageTest-5083140 None] Volume volume-b0183b9f-efa8-4207-8ebd-b41532a4eab4 (b0183b9f-efa8-4207-8ebd-b41532a4eab4): created successfully
Jul 02 20:04:39 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-4f41f7b0-6764-4adb-93bc-1c1236f7615f tempest-CreateVolumesFromImageTest-5083140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28a3e26c-08f5-4bb9-813a-aa71afb85fdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:04:39 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-4f41f7b0-6764-4adb-93bc-1c1236f7615f tempest-CreateVolumesFromImageTest-5083140 None] Flow 'volume_create_manager' (73394acf-e595-4cf9-90a4-e6610a775c8f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 20:04:39 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-4f41f7b0-6764-4adb-93bc-1c1236f7615f tempest-CreateVolumesFromImageTest-5083140 None] Created volume successfully.
Jul 02 20:04:39 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-fdcf7f14-7069-41d5-b57f-ff2672a630da tempest-CreateVolumesFromImageTest-5083140 None] Acquiring lock "cinder-b0183b9f-efa8-4207-8ebd-b41532a4eab4-delete_volume" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 20:04:39 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-fdcf7f14-7069-41d5-b57f-ff2672a630da tempest-CreateVolumesFromImageTest-5083140 None] Lock "cinder-b0183b9f-efa8-4207-8ebd-b41532a4eab4-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 20:04:39 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-fdcf7f14-7069-41d5-b57f-ff2672a630da tempest-CreateVolumesFromImageTest-5083140 None] Acquiring lock "cinder-quobyte-b0183b9f-efa8-4207-8ebd-b41532a4eab4" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 20:04:39 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-fdcf7f14-7069-41d5-b57f-ff2672a630da tempest-CreateVolumesFromImageTest-5083140 None] Lock "cinder-quobyte-b0183b9f-efa8-4207-8ebd-b41532a4eab4" acquired by "delete_volume" :: waited 0.016s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 20:04:39 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[163a25fa-7c5a-411b-a357-6eabcb831e85]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 20:04:39 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-fdcf7f14-7069-41d5-b57f-ff2672a630da tempest-CreateVolumesFromImageTest-5083140 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-b0183b9f-efa8-4207-8ebd-b41532a4eab4 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:04:40 devstack sudo[106816]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-b0183b9f-efa8-4207-8ebd-b41532a4eab4
Jul 02 20:04:40 devstack sudo[106816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:04:40 devstack sudo[106811]: pam_unix(sudo:session): session closed for user root
Jul 02 20:04:40 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-f4ad002b-8225-4104-a017-b40fb01c3c61 tempest-CinderUnicodeTest-1101475161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-757d373a-a944-4ace-8acb-8929b8f3ffc5 1073741824" returned: 0 in 0.893s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:04:40 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-f4ad002b-8225-4104-a017-b40fb01c3c61 tempest-CinderUnicodeTest-1101475161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-757d373a-a944-4ace-8acb-8929b8f3ffc5 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:04:40 devstack sudo[106818]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-757d373a-a944-4ace-8acb-8929b8f3ffc5
Jul 02 20:04:40 devstack sudo[106818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:04:40 devstack sudo[106816]: pam_unix(sudo:session): session closed for user root
Jul 02 20:04:40 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-fdcf7f14-7069-41d5-b57f-ff2672a630da tempest-CreateVolumesFromImageTest-5083140 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-b0183b9f-efa8-4207-8ebd-b41532a4eab4" returned: 0 in 0.826s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:04:40 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-fdcf7f14-7069-41d5-b57f-ff2672a630da tempest-CreateVolumesFromImageTest-5083140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-b0183b9f-efa8-4207-8ebd-b41532a4eab4 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:04:40 devstack sudo[106825]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-b0183b9f-efa8-4207-8ebd-b41532a4eab4
Jul 02 20:04:40 devstack sudo[106825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:04:40 devstack sudo[106818]: pam_unix(sudo:session): session closed for user root
Jul 02 20:04:40 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-f4ad002b-8225-4104-a017-b40fb01c3c61 tempest-CinderUnicodeTest-1101475161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-757d373a-a944-4ace-8acb-8929b8f3ffc5" returned: 0 in 0.682s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:04:40 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-f4ad002b-8225-4104-a017-b40fb01c3c61 tempest-CinderUnicodeTest-1101475161 None] <== create_volume: return (1618ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'} {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 20:04:40 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-f4ad002b-8225-4104-a017-b40fb01c3c61 tempest-CinderUnicodeTest-1101475161 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.623s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 20:04:40 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-880ee1f5-99f5-474f-aa0d-7ff8f3447672 tempest-VolumeAndVolumeTypeFromImageTest-1431078512 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.934s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 20:04:40 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-880ee1f5-99f5-474f-aa0d-7ff8f3447672 tempest-VolumeAndVolumeTypeFromImageTest-1431078512 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce906cb830>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T18:04:31Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e5353fc-811f-44c7-b05e-1573507d50a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7782f7af12734e659dd0009d35f55e70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T18:04:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T18:04:31Z,use_quota=True,user_id='dfa2a4b97f2e4c1f848b1c21d8b5313a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f69f8382-0a32-4c45-b4de-b3edcd8c014b),volume_type_id=f69f8382-0a32-4c45-b4de-b3edcd8c014b)}" {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 20:04:40 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-880ee1f5-99f5-474f-aa0d-7ff8f3447672 tempest-VolumeAndVolumeTypeFromImageTest-1431078512 None] Creating volume 7e5353fc-811f-44c7-b05e-1573507d50a1 {{(pid=86639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 20:04:40 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-880ee1f5-99f5-474f-aa0d-7ff8f3447672 tempest-VolumeAndVolumeTypeFromImageTest-1431078512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 20:04:40 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-880ee1f5-99f5-474f-aa0d-7ff8f3447672 tempest-VolumeAndVolumeTypeFromImageTest-1431078512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 20:04:40 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-880ee1f5-99f5-474f-aa0d-7ff8f3447672 tempest-VolumeAndVolumeTypeFromImageTest-1431078512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 20:04:40 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-880ee1f5-99f5-474f-aa0d-7ff8f3447672 tempest-VolumeAndVolumeTypeFromImageTest-1431078512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 20:04:40 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-880ee1f5-99f5-474f-aa0d-7ff8f3447672 tempest-VolumeAndVolumeTypeFromImageTest-1431078512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 20:04:40 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-880ee1f5-99f5-474f-aa0d-7ff8f3447672 tempest-VolumeAndVolumeTypeFromImageTest-1431078512 None] Selected osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92 as target Quobyte volume. {{(pid=86639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 20:04:40 devstack cinder-volume[86639]: INFO cinder.volume.drivers.remotefs [None req-880ee1f5-99f5-474f-aa0d-7ff8f3447672 tempest-VolumeAndVolumeTypeFromImageTest-1431078512 None] casted to osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92
Jul 02 20:04:40 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-880ee1f5-99f5-474f-aa0d-7ff8f3447672 tempest-VolumeAndVolumeTypeFromImageTest-1431078512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-7e5353fc-811f-44c7-b05e-1573507d50a1 1073741824 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:04:40 devstack sudo[106827]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-7e5353fc-811f-44c7-b05e-1573507d50a1 1073741824
Jul 02 20:04:40 devstack sudo[106827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:04:40 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-f4ad002b-8225-4104-a017-b40fb01c3c61 tempest-CinderUnicodeTest-1101475161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbfd75f6-77f2-46eb-975e-bb84803e0e10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-757d373a-a944-4ace-8acb-8929b8f3ffc5', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:04:40 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-f4ad002b-8225-4104-a017-b40fb01c3c61 tempest-CinderUnicodeTest-1101475161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00128bc7-976d-4a78-b0b9-51e88b387fce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:04:40 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-f4ad002b-8225-4104-a017-b40fb01c3c61 tempest-CinderUnicodeTest-1101475161 None] Volume volume-757d373a-a944-4ace-8acb-8929b8f3ffc5 (757d373a-a944-4ace-8acb-8929b8f3ffc5): created successfully
Jul 02 20:04:40 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-f4ad002b-8225-4104-a017-b40fb01c3c61 tempest-CinderUnicodeTest-1101475161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00128bc7-976d-4a78-b0b9-51e88b387fce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:04:40 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-f4ad002b-8225-4104-a017-b40fb01c3c61 tempest-CinderUnicodeTest-1101475161 None] Flow 'volume_create_manager' (f96a52de-4146-4cc1-a8ed-12e2cc710303) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 20:04:40 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-f4ad002b-8225-4104-a017-b40fb01c3c61 tempest-CinderUnicodeTest-1101475161 None] Created volume successfully.
Jul 02 20:04:41 devstack sudo[106825]: pam_unix(sudo:session): session closed for user root
Jul 02 20:04:41 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-fdcf7f14-7069-41d5-b57f-ff2672a630da tempest-CreateVolumesFromImageTest-5083140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-b0183b9f-efa8-4207-8ebd-b41532a4eab4" returned: 0 in 0.766s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:04:41 devstack cinder-volume[86639]: DEBUG oslo_service.periodic_task [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86639) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 02 20:04:41 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 20:04:41 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 20:04:41 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 20:04:41 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 20:04:41 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 20:04:41 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:04:41 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-fdcf7f14-7069-41d5-b57f-ff2672a630da tempest-CreateVolumesFromImageTest-5083140 None] Lock "cinder-quobyte-b0183b9f-efa8-4207-8ebd-b41532a4eab4" released by "delete_volume" :: held 1.700s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 20:04:41 devstack sudo[106833]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e
Jul 02 20:04:41 devstack sudo[106833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:04:41 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-7323c997-ae70-4290-b5cd-949f6515d327 tempest-CinderUnicodeTest-1101475161 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 20:04:41 devstack cinder-volume[86639]: DEBUG cinder.quota [None req-fdcf7f14-7069-41d5-b57f-ff2672a630da tempest-CreateVolumesFromImageTest-5083140 None] Created reservations ['7b1aad2d-5235-43a4-9378-4b45eac4ab41', '8d4533e4-1116-4029-a5b0-87caa6f45b34', '80a99cef-1067-4a9d-9f32-0387d0478e59', '41d3a1d7-80c0-4bf0-8918-5b910916980b'] {{(pid=86639) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 20:04:41 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-fdcf7f14-7069-41d5-b57f-ff2672a630da tempest-CreateVolumesFromImageTest-5083140 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 20:04:41 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-fdcf7f14-7069-41d5-b57f-ff2672a630da tempest-CreateVolumesFromImageTest-5083140 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 20:04:41 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-fdcf7f14-7069-41d5-b57f-ff2672a630da tempest-CreateVolumesFromImageTest-5083140 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 20:04:41 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-fdcf7f14-7069-41d5-b57f-ff2672a630da tempest-CreateVolumesFromImageTest-5083140 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 20:04:41 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-fdcf7f14-7069-41d5-b57f-ff2672a630da tempest-CreateVolumesFromImageTest-5083140 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 20:04:41 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-fdcf7f14-7069-41d5-b57f-ff2672a630da tempest-CreateVolumesFromImageTest-5083140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:04:41 devstack sudo[106835]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e
Jul 02 20:04:41 devstack sudo[106835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:04:41 devstack sudo[106827]: pam_unix(sudo:session): session closed for user root
Jul 02 20:04:41 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-880ee1f5-99f5-474f-aa0d-7ff8f3447672 tempest-VolumeAndVolumeTypeFromImageTest-1431078512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-7e5353fc-811f-44c7-b05e-1573507d50a1 1073741824" returned: 0 in 1.034s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:04:41 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-880ee1f5-99f5-474f-aa0d-7ff8f3447672 tempest-VolumeAndVolumeTypeFromImageTest-1431078512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-7e5353fc-811f-44c7-b05e-1573507d50a1 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:04:41 devstack sudo[106837]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-7e5353fc-811f-44c7-b05e-1573507d50a1
Jul 02 20:04:41 devstack sudo[106837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:04:42 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-f271c5ec-ec94-44dd-be6f-5f8c22a0eb3b tempest-CreateVolumesFromImageTest-5083140 None] Acquiring lock "cinder-b671d890-7e05-4b2a-bdb3-9a90e23364dd-delete_volume" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 20:04:42 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-f271c5ec-ec94-44dd-be6f-5f8c22a0eb3b tempest-CreateVolumesFromImageTest-5083140 None] Lock "cinder-b671d890-7e05-4b2a-bdb3-9a90e23364dd-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 20:04:42 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-f271c5ec-ec94-44dd-be6f-5f8c22a0eb3b tempest-CreateVolumesFromImageTest-5083140 None] Acquiring lock "cinder-quobyte-b671d890-7e05-4b2a-bdb3-9a90e23364dd" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 20:04:42 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-f271c5ec-ec94-44dd-be6f-5f8c22a0eb3b tempest-CreateVolumesFromImageTest-5083140 None] Lock "cinder-quobyte-b671d890-7e05-4b2a-bdb3-9a90e23364dd" acquired by "delete_volume" :: waited 0.026s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 20:04:42 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[75a24064-10c5-4452-8291-0289cf60b7bc]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 20:04:42 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-f271c5ec-ec94-44dd-be6f-5f8c22a0eb3b tempest-CreateVolumesFromImageTest-5083140 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-b671d890-7e05-4b2a-bdb3-9a90e23364dd {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:04:42 devstack sudo[106833]: pam_unix(sudo:session): session closed for user root
Jul 02 20:04:42 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e" returned: 0 in 0.824s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:04:42 devstack cinder-volume[86639]: DEBUG cinder.manager [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] Notifying Schedulers of capabilities ... {{(pid=86639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 20:04:42 devstack cinder-volume[86639]: DEBUG oslo_service.periodic_task [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] Running periodic task VolumeManager._thread_info {{(pid=86639) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 02 20:04:42 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] thread count: 28 {{(pid=86639) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 02 20:04:42 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] thread info: [<_MainThread(MainThread, started 140525261275264)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 140525150678016)>, <Thread(Thread-3 (stat_writer), started daemon 140525150025920)>, <Thread(Rabbit-heartbeat, started daemon 140525150500864)>, <Thread(Thread-5 (_runner), started daemon 140525149847296)>, <Thread(Thread-7 (_runner), started daemon 140525149863424)>, <Thread(fd_logger, started daemon 140525146589376)>, <Thread(privsep_reader, started daemon 140525144562432)>, <Thread(tpool_thread_0, started daemon 140525137151680)>, <Thread(tpool_thread_1, started daemon 140525128758976)>, <Thread(tpool_thread_2, started daemon 140525120349888)>, <Thread(tpool_thread_3, started daemon 140525111940800)>, <Thread(tpool_thread_4, started daemon 140525103531712)>, <Thread(tpool_thread_5, started daemon 140525095122624)>, <Thread(tpool_thread_6, started daemon 140525086713536)>, <Thread(tpool_thread_7, started daemon 140525078304448)>, <Thread(tpool_thread_8, started daemon 140525069895360)>, <Thread(tpool_thread_9, started daemon 140525061486272)>, <Thread(tpool_thread_10, started daemon 140525053077184)>, <Thread(tpool_thread_11, started daemon 140525044668096)>, <Thread(tpool_thread_12, started daemon 140525036259008)>, <Thread(tpool_thread_13, started daemon 140525027849920)>, <Thread(tpool_thread_14, started daemon 140525019440832)>, <Thread(tpool_thread_15, started daemon 140525011031744)>, <Thread(tpool_thread_16, started daemon 140525002622656)>, <Thread(tpool_thread_17, started daemon 140524994213568)>, <Thread(tpool_thread_18, started daemon 140524985804480)>, <Thread(tpool_thread_19, started daemon 140524977395392)>] {{(pid=86639) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 02 20:04:42 devstack sudo[106840]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-b671d890-7e05-4b2a-bdb3-9a90e23364dd
Jul 02 20:04:42 devstack sudo[106840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:04:42 devstack sudo[106835]: pam_unix(sudo:session): session closed for user root
Jul 02 20:04:42 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-fdcf7f14-7069-41d5-b57f-ff2672a630da tempest-CreateVolumesFromImageTest-5083140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e" returned: 0 in 0.726s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:04:42 devstack cinder-volume[86639]: DEBUG cinder.manager [None req-fdcf7f14-7069-41d5-b57f-ff2672a630da tempest-CreateVolumesFromImageTest-5083140 None] Notifying Schedulers of capabilities ... {{(pid=86639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 20:04:42 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-fdcf7f14-7069-41d5-b57f-ff2672a630da tempest-CreateVolumesFromImageTest-5083140 None] Deleted volume successfully.
Jul 02 20:04:42 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-fdcf7f14-7069-41d5-b57f-ff2672a630da tempest-CreateVolumesFromImageTest-5083140 None] Lock "cinder-b0183b9f-efa8-4207-8ebd-b41532a4eab4-delete_volume" released by "delete_volume" :: held 2.696s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 20:04:42 devstack sudo[106837]: pam_unix(sudo:session): session closed for user root
Jul 02 20:04:42 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-880ee1f5-99f5-474f-aa0d-7ff8f3447672 tempest-VolumeAndVolumeTypeFromImageTest-1431078512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-7e5353fc-811f-44c7-b05e-1573507d50a1" returned: 0 in 0.808s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:04:42 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-880ee1f5-99f5-474f-aa0d-7ff8f3447672 tempest-VolumeAndVolumeTypeFromImageTest-1431078512 None] <== create_volume: return (1892ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'} {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 20:04:42 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-880ee1f5-99f5-474f-aa0d-7ff8f3447672 tempest-VolumeAndVolumeTypeFromImageTest-1431078512 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.896s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 20:04:42 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-114482bc-c5be-4a60-9879-7a734e710cfa tempest-CreateVolumesFromSnapshotTest-1127395155 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.055s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 20:04:42 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-114482bc-c5be-4a60-9879-7a734e710cfa tempest-CreateVolumesFromSnapshotTest-1127395155 None] Creating offline snapshot bffa9e21-b9a5-4230-9d75-b7c8bf602974 of volume 5522fb92-c1a5-4cf1-b383-71c8a54a3b48 {{(pid=86639) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 02 20:04:42 devstack cinder-volume[86639]: DEBUG cinder.volume.volume_utils [None req-880ee1f5-99f5-474f-aa0d-7ff8f3447672 tempest-VolumeAndVolumeTypeFromImageTest-1431078512 None] Attempting download of 9244de81-7e30-4359-8173-2858997d1cb2 ((None, [{'url': 'file:///opt/stack/data/glance/images/9244de81-7e30-4359-8173-2858997d1cb2', 'metadata': {}}])) to volume 7e5353fc-811f-44c7-b05e-1573507d50a1. {{(pid=86639) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jul 02 20:04:42 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[25311b1b-01af-49eb-a9a6-c100e04ba8d5]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 20:04:42 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-114482bc-c5be-4a60-9879-7a734e710cfa tempest-CreateVolumesFromSnapshotTest-1127395155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-5522fb92-c1a5-4cf1-b383-71c8a54a3b48 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:04:42 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[31105c21-c838-4f45-bc18-b6261b30aed9]: (4, 'raw') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 20:04:42 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-880ee1f5-99f5-474f-aa0d-7ff8f3447672 tempest-VolumeAndVolumeTypeFromImageTest-1431078512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9244de81-7e30-4359-8173-2858997d1cb2_plt1bnon {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:04:42 devstack sudo[106844]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-5522fb92-c1a5-4cf1-b383-71c8a54a3b48
Jul 02 20:04:42 devstack sudo[106844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:04:43 devstack sudo[106846]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9244de81-7e30-4359-8173-2858997d1cb2_plt1bnon
Jul 02 20:04:43 devstack sudo[106846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:04:43 devstack sudo[106840]: pam_unix(sudo:session): session closed for user root
Jul 02 20:04:43 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-f271c5ec-ec94-44dd-be6f-5f8c22a0eb3b tempest-CreateVolumesFromImageTest-5083140 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-b671d890-7e05-4b2a-bdb3-9a90e23364dd" returned: 0 in 0.892s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:04:43 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-f271c5ec-ec94-44dd-be6f-5f8c22a0eb3b tempest-CreateVolumesFromImageTest-5083140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-b671d890-7e05-4b2a-bdb3-9a90e23364dd {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:04:43 devstack sudo[106851]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-b671d890-7e05-4b2a-bdb3-9a90e23364dd
Jul 02 20:04:43 devstack sudo[106851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:04:43 devstack sudo[106844]: pam_unix(sudo:session): session closed for user root
Jul 02 20:04:43 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-114482bc-c5be-4a60-9879-7a734e710cfa tempest-CreateVolumesFromSnapshotTest-1127395155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-5522fb92-c1a5-4cf1-b383-71c8a54a3b48" returned: 0 in 0.806s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:04:43 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-114482bc-c5be-4a60-9879-7a734e710cfa tempest-CreateVolumesFromSnapshotTest-1127395155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-5522fb92-c1a5-4cf1-b383-71c8a54a3b48,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-5522fb92-c1a5-4cf1-b383-71c8a54a3b48.bffa9e21-b9a5-4230-9d75-b7c8bf602974 1G {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:04:43 devstack sudo[106858]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-5522fb92-c1a5-4cf1-b383-71c8a54a3b48,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-5522fb92-c1a5-4cf1-b383-71c8a54a3b48.bffa9e21-b9a5-4230-9d75-b7c8bf602974 1G
Jul 02 20:04:43 devstack sudo[106858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:04:43 devstack sudo[106846]: pam_unix(sudo:session): session closed for user root
Jul 02 20:04:43 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-880ee1f5-99f5-474f-aa0d-7ff8f3447672 tempest-VolumeAndVolumeTypeFromImageTest-1431078512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9244de81-7e30-4359-8173-2858997d1cb2_plt1bnon" returned: 0 in 0.789s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:04:43 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-880ee1f5-99f5-474f-aa0d-7ff8f3447672 tempest-VolumeAndVolumeTypeFromImageTest-1431078512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9244de81-7e30-4359-8173-2858997d1cb2_plt1bnon {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:04:43 devstack sudo[106860]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9244de81-7e30-4359-8173-2858997d1cb2_plt1bnon
Jul 02 20:04:43 devstack sudo[106860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:04:43 devstack sudo[106851]: pam_unix(sudo:session): session closed for user root
Jul 02 20:04:43 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-f271c5ec-ec94-44dd-be6f-5f8c22a0eb3b tempest-CreateVolumesFromImageTest-5083140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-b671d890-7e05-4b2a-bdb3-9a90e23364dd" returned: 0 in 0.666s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:04:43 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-f271c5ec-ec94-44dd-be6f-5f8c22a0eb3b tempest-CreateVolumesFromImageTest-5083140 None] Lock "cinder-quobyte-b671d890-7e05-4b2a-bdb3-9a90e23364dd" released by "delete_volume" :: held 1.625s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 20:04:44 devstack cinder-volume[86639]: DEBUG cinder.quota [None req-f271c5ec-ec94-44dd-be6f-5f8c22a0eb3b tempest-CreateVolumesFromImageTest-5083140 None] Created reservations ['614cc445-1804-4cc7-ad9f-3ba1911d8408', '2676d7df-857f-4aaa-afc7-57fc28dec7e1', '14a3dbf9-cfae-43ea-bea9-1b97b2dffb69', 'a7d3579c-7bab-44b8-ab88-7aae5f39fb0b'] {{(pid=86639) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 20:04:44 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-f271c5ec-ec94-44dd-be6f-5f8c22a0eb3b tempest-CreateVolumesFromImageTest-5083140 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 20:04:44 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-f271c5ec-ec94-44dd-be6f-5f8c22a0eb3b tempest-CreateVolumesFromImageTest-5083140 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 20:04:44 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-f271c5ec-ec94-44dd-be6f-5f8c22a0eb3b tempest-CreateVolumesFromImageTest-5083140 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 20:04:44 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-f271c5ec-ec94-44dd-be6f-5f8c22a0eb3b tempest-CreateVolumesFromImageTest-5083140 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 20:04:44 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-f271c5ec-ec94-44dd-be6f-5f8c22a0eb3b tempest-CreateVolumesFromImageTest-5083140 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 20:04:44 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-f271c5ec-ec94-44dd-be6f-5f8c22a0eb3b tempest-CreateVolumesFromImageTest-5083140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:04:44 devstack sudo[106868]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e
Jul 02 20:04:44 devstack sudo[106868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:04:44 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-0cefe937-8a4b-4c18-8414-4ea14f1c11fe tempest-CreateVolumesFromImageTest-5083140 None] Acquiring lock "cinder-f95f8e3a-352c-4e29-b397-b42f830d5636-delete_volume" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 20:04:44 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-0cefe937-8a4b-4c18-8414-4ea14f1c11fe tempest-CreateVolumesFromImageTest-5083140 None] Lock "cinder-f95f8e3a-352c-4e29-b397-b42f830d5636-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 20:04:44 devstack sudo[106858]: pam_unix(sudo:session): session closed for user root
Jul 02 20:04:44 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-114482bc-c5be-4a60-9879-7a734e710cfa tempest-CreateVolumesFromSnapshotTest-1127395155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-5522fb92-c1a5-4cf1-b383-71c8a54a3b48,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-5522fb92-c1a5-4cf1-b383-71c8a54a3b48.bffa9e21-b9a5-4230-9d75-b7c8bf602974 1G" returned: 0 in 0.942s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:04:44 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-114482bc-c5be-4a60-9879-7a734e710cfa tempest-CreateVolumesFromSnapshotTest-1127395155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5522fb92-c1a5-4cf1-b383-71c8a54a3b48 -F qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-5522fb92-c1a5-4cf1-b383-71c8a54a3b48.bffa9e21-b9a5-4230-9d75-b7c8bf602974 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:04:44 devstack sudo[106860]: pam_unix(sudo:session): session closed for user root
Jul 02 20:04:44 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-0cefe937-8a4b-4c18-8414-4ea14f1c11fe tempest-CreateVolumesFromImageTest-5083140 None] Acquiring lock "cinder-quobyte-f95f8e3a-352c-4e29-b397-b42f830d5636" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 20:04:44 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-880ee1f5-99f5-474f-aa0d-7ff8f3447672 tempest-VolumeAndVolumeTypeFromImageTest-1431078512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9244de81-7e30-4359-8173-2858997d1cb2_plt1bnon" returned: 1 in 0.870s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:04:44 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-880ee1f5-99f5-474f-aa0d-7ff8f3447672 tempest-VolumeAndVolumeTypeFromImageTest-1431078512 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9244de81-7e30-4359-8173-2858997d1cb2_plt1bnon' failed. Not Retrying. {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 02 20:04:44 devstack sudo[106873]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5522fb92-c1a5-4cf1-b383-71c8a54a3b48 -F qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-5522fb92-c1a5-4cf1-b383-71c8a54a3b48.bffa9e21-b9a5-4230-9d75-b7c8bf602974
Jul 02 20:04:44 devstack sudo[106873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:04:44 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[29ebbf18-6e20-42cb-95db-177067bbba1f]: (4, 'raw') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 20:04:44 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-880ee1f5-99f5-474f-aa0d-7ff8f3447672 tempest-VolumeAndVolumeTypeFromImageTest-1431078512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9244de81-7e30-4359-8173-2858997d1cb2_v96k0njldevstack@QuobyteHD {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:04:44 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-0cefe937-8a4b-4c18-8414-4ea14f1c11fe tempest-CreateVolumesFromImageTest-5083140 None] Lock "cinder-quobyte-f95f8e3a-352c-4e29-b397-b42f830d5636" acquired by "delete_volume" :: waited 0.032s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 20:04:44 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[776bc486-697f-4414-a256-3db7e6a34e6e]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 20:04:44 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-0cefe937-8a4b-4c18-8414-4ea14f1c11fe tempest-CreateVolumesFromImageTest-5083140 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-f95f8e3a-352c-4e29-b397-b42f830d5636 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:04:44 devstack sudo[106875]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9244de81-7e30-4359-8173-2858997d1cb2_v96k0njldevstack@QuobyteHD
Jul 02 20:04:44 devstack sudo[106875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:04:44 devstack sudo[106876]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-f95f8e3a-352c-4e29-b397-b42f830d5636
Jul 02 20:04:44 devstack sudo[106876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:04:44 devstack sudo[106868]: pam_unix(sudo:session): session closed for user root
Jul 02 20:04:45 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-f271c5ec-ec94-44dd-be6f-5f8c22a0eb3b tempest-CreateVolumesFromImageTest-5083140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e" returned: 0 in 0.793s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:04:45 devstack cinder-volume[86639]: DEBUG cinder.manager [None req-f271c5ec-ec94-44dd-be6f-5f8c22a0eb3b tempest-CreateVolumesFromImageTest-5083140 None] Notifying Schedulers of capabilities ... {{(pid=86639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 20:04:45 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-f271c5ec-ec94-44dd-be6f-5f8c22a0eb3b tempest-CreateVolumesFromImageTest-5083140 None] Deleted volume successfully.
Jul 02 20:04:45 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-f271c5ec-ec94-44dd-be6f-5f8c22a0eb3b tempest-CreateVolumesFromImageTest-5083140 None] Lock "cinder-b671d890-7e05-4b2a-bdb3-9a90e23364dd-delete_volume" released by "delete_volume" :: held 2.875s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 20:04:45 devstack sudo[106873]: pam_unix(sudo:session): session closed for user root
Jul 02 20:04:45 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-114482bc-c5be-4a60-9879-7a734e710cfa tempest-CreateVolumesFromSnapshotTest-1127395155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5522fb92-c1a5-4cf1-b383-71c8a54a3b48 -F qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-5522fb92-c1a5-4cf1-b383-71c8a54a3b48.bffa9e21-b9a5-4230-9d75-b7c8bf602974" returned: 0 in 0.751s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:04:45 devstack cinder-volume[86639]: WARNING cinder.volume.drivers.remotefs [None req-114482bc-c5be-4a60-9879-7a734e710cfa tempest-CreateVolumesFromSnapshotTest-1127395155 None] /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-5522fb92-c1a5-4cf1-b383-71c8a54a3b48.bffa9e21-b9a5-4230-9d75-b7c8bf602974 is being set with open permissions: ugo+rw
Jul 02 20:04:45 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-114482bc-c5be-4a60-9879-7a734e710cfa tempest-CreateVolumesFromSnapshotTest-1127395155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-5522fb92-c1a5-4cf1-b383-71c8a54a3b48.bffa9e21-b9a5-4230-9d75-b7c8bf602974 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:04:45 devstack sudo[106883]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-5522fb92-c1a5-4cf1-b383-71c8a54a3b48.bffa9e21-b9a5-4230-9d75-b7c8bf602974
Jul 02 20:04:45 devstack sudo[106883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:04:45 devstack sudo[106875]: pam_unix(sudo:session): session closed for user root
Jul 02 20:04:45 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-880ee1f5-99f5-474f-aa0d-7ff8f3447672 tempest-VolumeAndVolumeTypeFromImageTest-1431078512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9244de81-7e30-4359-8173-2858997d1cb2_v96k0njldevstack@QuobyteHD" returned: 0 in 0.877s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:04:45 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-880ee1f5-99f5-474f-aa0d-7ff8f3447672 tempest-VolumeAndVolumeTypeFromImageTest-1431078512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9244de81-7e30-4359-8173-2858997d1cb2_v96k0njldevstack@QuobyteHD {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:04:45 devstack sudo[106876]: pam_unix(sudo:session): session closed for user root
Jul 02 20:04:45 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-0cefe937-8a4b-4c18-8414-4ea14f1c11fe tempest-CreateVolumesFromImageTest-5083140 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-f95f8e3a-352c-4e29-b397-b42f830d5636" returned: 0 in 0.871s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:04:45 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-0cefe937-8a4b-4c18-8414-4ea14f1c11fe tempest-CreateVolumesFromImageTest-5083140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-f95f8e3a-352c-4e29-b397-b42f830d5636 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:04:45 devstack sudo[106891]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-f95f8e3a-352c-4e29-b397-b42f830d5636
Jul 02 20:04:45 devstack sudo[106891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:04:45 devstack sudo[106890]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9244de81-7e30-4359-8173-2858997d1cb2_v96k0njldevstack@QuobyteHD
Jul 02 20:04:45 devstack sudo[106890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:04:45 devstack sudo[106883]: pam_unix(sudo:session): session closed for user root
Jul 02 20:04:45 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-114482bc-c5be-4a60-9879-7a734e710cfa tempest-CreateVolumesFromSnapshotTest-1127395155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-5522fb92-c1a5-4cf1-b383-71c8a54a3b48.bffa9e21-b9a5-4230-9d75-b7c8bf602974" returned: 0 in 0.700s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:04:46 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-114482bc-c5be-4a60-9879-7a734e710cfa tempest-CreateVolumesFromSnapshotTest-1127395155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-5522fb92-c1a5-4cf1-b383-71c8a54a3b48.info {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:04:46 devstack sudo[106895]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-5522fb92-c1a5-4cf1-b383-71c8a54a3b48.info
Jul 02 20:04:46 devstack sudo[106895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:04:46 devstack sudo[106891]: pam_unix(sudo:session): session closed for user root
Jul 02 20:04:46 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-0cefe937-8a4b-4c18-8414-4ea14f1c11fe tempest-CreateVolumesFromImageTest-5083140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-f95f8e3a-352c-4e29-b397-b42f830d5636" returned: 0 in 0.709s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:04:46 devstack sudo[106890]: pam_unix(sudo:session): session closed for user root
Jul 02 20:04:46 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-880ee1f5-99f5-474f-aa0d-7ff8f3447672 tempest-VolumeAndVolumeTypeFromImageTest-1431078512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9244de81-7e30-4359-8173-2858997d1cb2_v96k0njldevstack@QuobyteHD" returned: 1 in 0.761s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:04:46 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-880ee1f5-99f5-474f-aa0d-7ff8f3447672 tempest-VolumeAndVolumeTypeFromImageTest-1431078512 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9244de81-7e30-4359-8173-2858997d1cb2_v96k0njldevstack@QuobyteHD' failed. Not Retrying. {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 02 20:04:46 devstack cinder-volume[86639]: DEBUG cinder.image.image_utils [None req-880ee1f5-99f5-474f-aa0d-7ff8f3447672 tempest-VolumeAndVolumeTypeFromImageTest-1431078512 None] 9244de81-7e30-4359-8173-2858997d1cb2 was raw, converting to raw {{(pid=86639) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jul 02 20:04:46 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-880ee1f5-99f5-474f-aa0d-7ff8f3447672 tempest-VolumeAndVolumeTypeFromImageTest-1431078512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_9244de81-7e30-4359-8173-2858997d1cb2_v96k0njldevstack@QuobyteHD /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-7e5353fc-811f-44c7-b05e-1573507d50a1 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:04:46 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-0cefe937-8a4b-4c18-8414-4ea14f1c11fe tempest-CreateVolumesFromImageTest-5083140 None] Lock "cinder-quobyte-f95f8e3a-352c-4e29-b397-b42f830d5636" released by "delete_volume" :: held 1.649s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 20:04:46 devstack sudo[106901]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_9244de81-7e30-4359-8173-2858997d1cb2_v96k0njldevstack@QuobyteHD /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-7e5353fc-811f-44c7-b05e-1573507d50a1
Jul 02 20:04:46 devstack sudo[106901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:04:46 devstack cinder-volume[86639]: DEBUG cinder.quota [None req-0cefe937-8a4b-4c18-8414-4ea14f1c11fe tempest-CreateVolumesFromImageTest-5083140 None] Created reservations ['8be05091-340b-4567-b304-c6e53a7b6c40', 'a7945c26-ee60-4447-925c-33d208cfb1d5', 'e88d39e7-0512-450e-9334-372ba24a3e0a', '7e71e859-e00d-4512-8316-06a1e97b21d7'] {{(pid=86639) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 20:04:46 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-0cefe937-8a4b-4c18-8414-4ea14f1c11fe tempest-CreateVolumesFromImageTest-5083140 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 20:04:46 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-0cefe937-8a4b-4c18-8414-4ea14f1c11fe tempest-CreateVolumesFromImageTest-5083140 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 20:04:46 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-0cefe937-8a4b-4c18-8414-4ea14f1c11fe tempest-CreateVolumesFromImageTest-5083140 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 20:04:46 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-0cefe937-8a4b-4c18-8414-4ea14f1c11fe tempest-CreateVolumesFromImageTest-5083140 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 20:04:46 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-0cefe937-8a4b-4c18-8414-4ea14f1c11fe tempest-CreateVolumesFromImageTest-5083140 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 20:04:46 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-0cefe937-8a4b-4c18-8414-4ea14f1c11fe tempest-CreateVolumesFromImageTest-5083140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:04:46 devstack sudo[106903]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e
Jul 02 20:04:46 devstack sudo[106903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:04:46 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-bf2bd663-f167-4550-b984-1844dbf9f85b tempest-CreateVolumesFromImageTest-5083140 None] Acquiring lock "cinder-453fcf9c-db7a-442f-a64d-59dfc5d1428c-delete_volume" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 20:04:46 devstack sudo[106895]: pam_unix(sudo:session): session closed for user root
Jul 02 20:04:46 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-114482bc-c5be-4a60-9879-7a734e710cfa tempest-CreateVolumesFromSnapshotTest-1127395155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-5522fb92-c1a5-4cf1-b383-71c8a54a3b48.info" returned: 0 in 0.754s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:04:46 devstack cinder-volume[86639]: WARNING cinder.volume.drivers.remotefs [None req-114482bc-c5be-4a60-9879-7a734e710cfa tempest-CreateVolumesFromSnapshotTest-1127395155 None] /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-5522fb92-c1a5-4cf1-b383-71c8a54a3b48.info is being set with open permissions: ugo+rw
Jul 02 20:04:46 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-114482bc-c5be-4a60-9879-7a734e710cfa tempest-CreateVolumesFromSnapshotTest-1127395155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-5522fb92-c1a5-4cf1-b383-71c8a54a3b48.info {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:04:46 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-bf2bd663-f167-4550-b984-1844dbf9f85b tempest-CreateVolumesFromImageTest-5083140 None] Lock "cinder-453fcf9c-db7a-442f-a64d-59dfc5d1428c-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 20:04:46 devstack sudo[106906]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-5522fb92-c1a5-4cf1-b383-71c8a54a3b48.info
Jul 02 20:04:46 devstack sudo[106906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:04:46 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-bf2bd663-f167-4550-b984-1844dbf9f85b tempest-CreateVolumesFromImageTest-5083140 None] Acquiring lock "cinder-quobyte-453fcf9c-db7a-442f-a64d-59dfc5d1428c" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 20:04:46 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-bf2bd663-f167-4550-b984-1844dbf9f85b tempest-CreateVolumesFromImageTest-5083140 None] Lock "cinder-quobyte-453fcf9c-db7a-442f-a64d-59dfc5d1428c" acquired by "delete_volume" :: waited 0.031s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 20:04:46 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[44a451ec-6a2f-4c9d-a230-ee9297d59e38]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 20:04:46 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-bf2bd663-f167-4550-b984-1844dbf9f85b tempest-CreateVolumesFromImageTest-5083140 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-453fcf9c-db7a-442f-a64d-59dfc5d1428c {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:04:47 devstack sudo[106910]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-453fcf9c-db7a-442f-a64d-59dfc5d1428c
Jul 02 20:04:47 devstack sudo[106910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:04:47 devstack sudo[106903]: pam_unix(sudo:session): session closed for user root
Jul 02 20:04:47 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-0cefe937-8a4b-4c18-8414-4ea14f1c11fe tempest-CreateVolumesFromImageTest-5083140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e" returned: 0 in 0.743s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:04:47 devstack cinder-volume[86639]: DEBUG cinder.manager [None req-0cefe937-8a4b-4c18-8414-4ea14f1c11fe tempest-CreateVolumesFromImageTest-5083140 None] Notifying Schedulers of capabilities ... {{(pid=86639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 20:04:47 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-0cefe937-8a4b-4c18-8414-4ea14f1c11fe tempest-CreateVolumesFromImageTest-5083140 None] Deleted volume successfully.
Jul 02 20:04:47 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-0cefe937-8a4b-4c18-8414-4ea14f1c11fe tempest-CreateVolumesFromImageTest-5083140 None] Lock "cinder-f95f8e3a-352c-4e29-b397-b42f830d5636-delete_volume" released by "delete_volume" :: held 2.686s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 20:04:47 devstack sudo[106901]: pam_unix(sudo:session): session closed for user root
Jul 02 20:04:47 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-880ee1f5-99f5-474f-aa0d-7ff8f3447672 tempest-VolumeAndVolumeTypeFromImageTest-1431078512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_9244de81-7e30-4359-8173-2858997d1cb2_v96k0njldevstack@QuobyteHD /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-7e5353fc-811f-44c7-b05e-1573507d50a1" returned: 0 in 0.956s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:04:47 devstack cinder-volume[86639]: DEBUG cinder.image.image_utils [None req-880ee1f5-99f5-474f-aa0d-7ff8f3447672 tempest-VolumeAndVolumeTypeFromImageTest-1431078512 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_9244de81-7e30-4359-8173-2858997d1cb2_v96k0njldevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-7e5353fc-811f-44c7-b05e-1573507d50a1 {{(pid=86639) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 02 20:04:47 devstack cinder-volume[86639]: INFO cinder.image.image_utils [None req-880ee1f5-99f5-474f-aa0d-7ff8f3447672 tempest-VolumeAndVolumeTypeFromImageTest-1431078512 None] Converted 0.00 MB image at 0.00 MB/s
Jul 02 20:04:47 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-880ee1f5-99f5-474f-aa0d-7ff8f3447672 tempest-VolumeAndVolumeTypeFromImageTest-1431078512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-7e5353fc-811f-44c7-b05e-1573507d50a1 1G {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:04:47 devstack sudo[106914]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-7e5353fc-811f-44c7-b05e-1573507d50a1 1G
Jul 02 20:04:47 devstack sudo[106914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:04:47 devstack sudo[106906]: pam_unix(sudo:session): session closed for user root
Jul 02 20:04:47 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-114482bc-c5be-4a60-9879-7a734e710cfa tempest-CreateVolumesFromSnapshotTest-1127395155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-5522fb92-c1a5-4cf1-b383-71c8a54a3b48.info" returned: 0 in 0.741s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:04:47 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-114482bc-c5be-4a60-9879-7a734e710cfa tempest-CreateVolumesFromSnapshotTest-1127395155 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.825s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 20:04:47 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-7323c997-ae70-4290-b5cd-949f6515d327 tempest-CinderUnicodeTest-1101475161 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.938s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 20:04:47 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-7323c997-ae70-4290-b5cd-949f6515d327 tempest-CinderUnicodeTest-1101475161 None] Creating offline snapshot 0ec9fcbb-8a38-4d22-b1f4-58626a1b5295 of volume 757d373a-a944-4ace-8acb-8929b8f3ffc5 {{(pid=86639) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 02 20:04:47 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-114482bc-c5be-4a60-9879-7a734e710cfa tempest-CreateVolumesFromSnapshotTest-1127395155 None] Create snapshot completed successfully
Jul 02 20:04:47 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[83ecdd74-3457-43c4-a767-e6f3c7ff5103]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 20:04:47 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-7323c997-ae70-4290-b5cd-949f6515d327 tempest-CinderUnicodeTest-1101475161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-757d373a-a944-4ace-8acb-8929b8f3ffc5 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:04:47 devstack sudo[106917]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-757d373a-a944-4ace-8acb-8929b8f3ffc5
Jul 02 20:04:47 devstack sudo[106917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:04:47 devstack sudo[106910]: pam_unix(sudo:session): session closed for user root
Jul 02 20:04:47 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-bf2bd663-f167-4550-b984-1844dbf9f85b tempest-CreateVolumesFromImageTest-5083140 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-453fcf9c-db7a-442f-a64d-59dfc5d1428c" returned: 0 in 0.982s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:04:47 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-bf2bd663-f167-4550-b984-1844dbf9f85b tempest-CreateVolumesFromImageTest-5083140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-453fcf9c-db7a-442f-a64d-59dfc5d1428c {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:04:47 devstack sudo[106926]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-453fcf9c-db7a-442f-a64d-59dfc5d1428c
Jul 02 20:04:47 devstack sudo[106926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:04:47 devstack sudo[106914]: pam_unix(sudo:session): session closed for user root
Jul 02 20:04:47 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-880ee1f5-99f5-474f-aa0d-7ff8f3447672 tempest-VolumeAndVolumeTypeFromImageTest-1431078512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-7e5353fc-811f-44c7-b05e-1573507d50a1 1G" returned: 0 in 0.808s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:04:48 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[f22e461f-ce00-4901-ac7f-9ceb47e1e2f8]: (4, 'raw') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 20:04:48 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-880ee1f5-99f5-474f-aa0d-7ff8f3447672 tempest-VolumeAndVolumeTypeFromImageTest-1431078512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-7e5353fc-811f-44c7-b05e-1573507d50a1 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:04:48 devstack sudo[106928]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-7e5353fc-811f-44c7-b05e-1573507d50a1
Jul 02 20:04:48 devstack sudo[106928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:04:48 devstack sudo[106917]: pam_unix(sudo:session): session closed for user root
Jul 02 20:04:48 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-7323c997-ae70-4290-b5cd-949f6515d327 tempest-CinderUnicodeTest-1101475161 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-757d373a-a944-4ace-8acb-8929b8f3ffc5" returned: 0 in 0.975s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:04:48 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-7323c997-ae70-4290-b5cd-949f6515d327 tempest-CinderUnicodeTest-1101475161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-757d373a-a944-4ace-8acb-8929b8f3ffc5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-757d373a-a944-4ace-8acb-8929b8f3ffc5.0ec9fcbb-8a38-4d22-b1f4-58626a1b5295 1G {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:04:48 devstack sudo[106933]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-757d373a-a944-4ace-8acb-8929b8f3ffc5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-757d373a-a944-4ace-8acb-8929b8f3ffc5.0ec9fcbb-8a38-4d22-b1f4-58626a1b5295 1G
Jul 02 20:04:48 devstack sudo[106933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:04:48 devstack sudo[106926]: pam_unix(sudo:session): session closed for user root
Jul 02 20:04:48 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-bf2bd663-f167-4550-b984-1844dbf9f85b tempest-CreateVolumesFromImageTest-5083140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-453fcf9c-db7a-442f-a64d-59dfc5d1428c" returned: 0 in 0.837s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:04:48 devstack cinder-volume[86639]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d947f16-2605-47c9-8f24-db2e2cddabce tempest-CreateVolumesFromSnapshotTest-1127395155 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 20:04:48 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-6d947f16-2605-47c9-8f24-db2e2cddabce tempest-CreateVolumesFromSnapshotTest-1127395155 None] Flow 'volume_create_manager' (0c539858-d739-4b54-a70a-a5ba046c2451) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 20:04:48 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-6d947f16-2605-47c9-8f24-db2e2cddabce tempest-CreateVolumesFromSnapshotTest-1127395155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99c0ab39-1940-40aa-8141-a0a66a1ace6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:04:48 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-bf2bd663-f167-4550-b984-1844dbf9f85b tempest-CreateVolumesFromImageTest-5083140 None] Lock "cinder-quobyte-453fcf9c-db7a-442f-a64d-59dfc5d1428c" released by "delete_volume" :: held 1.924s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 20:04:48 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-6d947f16-2605-47c9-8f24-db2e2cddabce tempest-CreateVolumesFromSnapshotTest-1127395155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99c0ab39-1940-40aa-8141-a0a66a1ace6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T18:04:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-590479448',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=158a8c57-bddf-4c71-86f6-661b6f42fb7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfffcb664c3f4b49b07a3412c1642700',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T18:04:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T18:04:49Z,use_quota=True,user_id='ca1bd1389a844499a1f59dc320b608a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:04:48 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-6d947f16-2605-47c9-8f24-db2e2cddabce tempest-CreateVolumesFromSnapshotTest-1127395155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (729dc26c-e468-4cf1-ba73-59150daae9db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:04:48 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-6d947f16-2605-47c9-8f24-db2e2cddabce tempest-CreateVolumesFromSnapshotTest-1127395155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (729dc26c-e468-4cf1-ba73-59150daae9db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:04:48 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-6d947f16-2605-47c9-8f24-db2e2cddabce tempest-CreateVolumesFromSnapshotTest-1127395155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4890442-0504-42f2-95a1-f06f72cfc863) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:04:48 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-6d947f16-2605-47c9-8f24-db2e2cddabce tempest-CreateVolumesFromSnapshotTest-1127395155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4890442-0504-42f2-95a1-f06f72cfc863) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '158a8c57-bddf-4c71-86f6-661b6f42fb7e', 'volume_name': 'volume-158a8c57-bddf-4c71-86f6-661b6f42fb7e', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:04:48 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-6d947f16-2605-47c9-8f24-db2e2cddabce tempest-CreateVolumesFromSnapshotTest-1127395155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16882ea7-b170-4ddb-883a-5999ccf6c113) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:04:48 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-6d947f16-2605-47c9-8f24-db2e2cddabce tempest-CreateVolumesFromSnapshotTest-1127395155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16882ea7-b170-4ddb-883a-5999ccf6c113) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:04:48 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-6d947f16-2605-47c9-8f24-db2e2cddabce tempest-CreateVolumesFromSnapshotTest-1127395155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e174722-efa1-45c6-93e9-55728e3eea06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:04:48 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-6d947f16-2605-47c9-8f24-db2e2cddabce tempest-CreateVolumesFromSnapshotTest-1127395155 None] Volume 158a8c57-bddf-4c71-86f6-661b6f42fb7e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-158a8c57-bddf-4c71-86f6-661b6f42fb7e', 'volume_size': 1}
Jul 02 20:04:48 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-6d947f16-2605-47c9-8f24-db2e2cddabce tempest-CreateVolumesFromSnapshotTest-1127395155 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 20:04:49 devstack sudo[106928]: pam_unix(sudo:session): session closed for user root
Jul 02 20:04:49 devstack cinder-volume[86639]: DEBUG cinder.quota [None req-bf2bd663-f167-4550-b984-1844dbf9f85b tempest-CreateVolumesFromImageTest-5083140 None] Created reservations ['ff00491c-0488-4fdc-9264-c28fb9298cf5', '28f621c5-09c2-4266-89e7-2279ccde7400', '57ace4a8-3a88-49c5-bfb0-511130b8baba', 'b32ff806-c06c-40dc-bf94-9f0623c2f007'] {{(pid=86639) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 20:04:49 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-880ee1f5-99f5-474f-aa0d-7ff8f3447672 tempest-VolumeAndVolumeTypeFromImageTest-1431078512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-7e5353fc-811f-44c7-b05e-1573507d50a1" returned: 0 in 1.021s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:04:49 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-880ee1f5-99f5-474f-aa0d-7ff8f3447672 tempest-VolumeAndVolumeTypeFromImageTest-1431078512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-7e5353fc-811f-44c7-b05e-1573507d50a1 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:04:49 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-bf2bd663-f167-4550-b984-1844dbf9f85b tempest-CreateVolumesFromImageTest-5083140 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 20:04:49 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-bf2bd663-f167-4550-b984-1844dbf9f85b tempest-CreateVolumesFromImageTest-5083140 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 20:04:49 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-bf2bd663-f167-4550-b984-1844dbf9f85b tempest-CreateVolumesFromImageTest-5083140 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 20:04:49 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-bf2bd663-f167-4550-b984-1844dbf9f85b tempest-CreateVolumesFromImageTest-5083140 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 20:04:49 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-bf2bd663-f167-4550-b984-1844dbf9f85b tempest-CreateVolumesFromImageTest-5083140 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 20:04:49 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-bf2bd663-f167-4550-b984-1844dbf9f85b tempest-CreateVolumesFromImageTest-5083140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:04:49 devstack sudo[106938]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-7e5353fc-811f-44c7-b05e-1573507d50a1
Jul 02 20:04:49 devstack sudo[106938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:04:49 devstack sudo[106939]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e
Jul 02 20:04:49 devstack sudo[106939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:04:49 devstack cinder-volume[86639]: DEBUG cinder.volume.flows.manager.create_volume [None req-a07a980a-c584-43d7-8555-bd8f45f8a047 tempest-CreateVolumesFromSnapshotTest-1127395155 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 20:04:49 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-a07a980a-c584-43d7-8555-bd8f45f8a047 tempest-CreateVolumesFromSnapshotTest-1127395155 None] Flow 'volume_create_manager' (6dea37f8-8511-4134-a614-5cbf5acbd82d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 20:04:49 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-a07a980a-c584-43d7-8555-bd8f45f8a047 tempest-CreateVolumesFromSnapshotTest-1127395155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2c11cc9-cd74-4b61-95b1-a5e525422af7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:04:49 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-a07a980a-c584-43d7-8555-bd8f45f8a047 tempest-CreateVolumesFromSnapshotTest-1127395155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2c11cc9-cd74-4b61-95b1-a5e525422af7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T18:04:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-638352873',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79af5d4f-8b2e-4dd2-8745-88662a0f8ba0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfffcb664c3f4b49b07a3412c1642700',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T18:04:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T18:04:49Z,use_quota=True,user_id='ca1bd1389a844499a1f59dc320b608a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:04:49 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-a07a980a-c584-43d7-8555-bd8f45f8a047 tempest-CreateVolumesFromSnapshotTest-1127395155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d7f705d-198f-453f-a385-30834ef450d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:04:49 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-a07a980a-c584-43d7-8555-bd8f45f8a047 tempest-CreateVolumesFromSnapshotTest-1127395155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d7f705d-198f-453f-a385-30834ef450d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:04:49 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-a07a980a-c584-43d7-8555-bd8f45f8a047 tempest-CreateVolumesFromSnapshotTest-1127395155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f82580e7-180f-4ed0-94e8-c248279f301f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:04:49 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-a07a980a-c584-43d7-8555-bd8f45f8a047 tempest-CreateVolumesFromSnapshotTest-1127395155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f82580e7-180f-4ed0-94e8-c248279f301f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '79af5d4f-8b2e-4dd2-8745-88662a0f8ba0', 'volume_name': 'volume-79af5d4f-8b2e-4dd2-8745-88662a0f8ba0', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:04:49 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-a07a980a-c584-43d7-8555-bd8f45f8a047 tempest-CreateVolumesFromSnapshotTest-1127395155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (269672a3-a7af-48b0-893a-eff4ca5c3c53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:04:49 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-a07a980a-c584-43d7-8555-bd8f45f8a047 tempest-CreateVolumesFromSnapshotTest-1127395155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (269672a3-a7af-48b0-893a-eff4ca5c3c53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:04:49 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-a07a980a-c584-43d7-8555-bd8f45f8a047 tempest-CreateVolumesFromSnapshotTest-1127395155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b00511ab-8dfd-4b51-8e33-91312c8c7668) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:04:49 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-a07a980a-c584-43d7-8555-bd8f45f8a047 tempest-CreateVolumesFromSnapshotTest-1127395155 None] Volume 79af5d4f-8b2e-4dd2-8745-88662a0f8ba0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-79af5d4f-8b2e-4dd2-8745-88662a0f8ba0', 'volume_size': 1}
Jul 02 20:04:49 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-a07a980a-c584-43d7-8555-bd8f45f8a047 tempest-CreateVolumesFromSnapshotTest-1127395155 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 20:04:49 devstack cinder-volume[86639]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2223430-ce82-451b-bfcc-3def1180001b tempest-CreateVolumesFromSnapshotTest-1127395155 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 20:04:49 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-e2223430-ce82-451b-bfcc-3def1180001b tempest-CreateVolumesFromSnapshotTest-1127395155 None] Flow 'volume_create_manager' (846c85b0-b284-4cf5-b9c1-c3b24975c824) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 20:04:49 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-e2223430-ce82-451b-bfcc-3def1180001b tempest-CreateVolumesFromSnapshotTest-1127395155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2a818b5-3d52-4cde-a936-2986b3463873) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:04:49 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-e2223430-ce82-451b-bfcc-3def1180001b tempest-CreateVolumesFromSnapshotTest-1127395155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2a818b5-3d52-4cde-a936-2986b3463873) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T18:04:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-245115512',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0c2aa04-4a57-4ecc-a977-55bf55843dae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfffcb664c3f4b49b07a3412c1642700',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T18:04:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T18:04:50Z,use_quota=True,user_id='ca1bd1389a844499a1f59dc320b608a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:04:49 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-e2223430-ce82-451b-bfcc-3def1180001b tempest-CreateVolumesFromSnapshotTest-1127395155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ee87ab6-d619-40e7-bb85-cbb7a54f52fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:04:49 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-e2223430-ce82-451b-bfcc-3def1180001b tempest-CreateVolumesFromSnapshotTest-1127395155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ee87ab6-d619-40e7-bb85-cbb7a54f52fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:04:49 devstack sudo[106933]: pam_unix(sudo:session): session closed for user root
Jul 02 20:04:49 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-e2223430-ce82-451b-bfcc-3def1180001b tempest-CreateVolumesFromSnapshotTest-1127395155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb81daf9-8bf0-4570-8d5b-5d9298307170) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:04:49 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-e2223430-ce82-451b-bfcc-3def1180001b tempest-CreateVolumesFromSnapshotTest-1127395155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb81daf9-8bf0-4570-8d5b-5d9298307170) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a0c2aa04-4a57-4ecc-a977-55bf55843dae', 'volume_name': 'volume-a0c2aa04-4a57-4ecc-a977-55bf55843dae', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:04:49 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-e2223430-ce82-451b-bfcc-3def1180001b tempest-CreateVolumesFromSnapshotTest-1127395155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7188c974-5569-477d-b7b5-aabe9ef7af46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:04:49 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-e2223430-ce82-451b-bfcc-3def1180001b tempest-CreateVolumesFromSnapshotTest-1127395155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7188c974-5569-477d-b7b5-aabe9ef7af46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:04:49 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-e2223430-ce82-451b-bfcc-3def1180001b tempest-CreateVolumesFromSnapshotTest-1127395155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f270f45-c83b-48d7-89c3-ed25f795e30f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:04:49 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-e2223430-ce82-451b-bfcc-3def1180001b tempest-CreateVolumesFromSnapshotTest-1127395155 None] Volume a0c2aa04-4a57-4ecc-a977-55bf55843dae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a0c2aa04-4a57-4ecc-a977-55bf55843dae', 'volume_size': 1}
Jul 02 20:04:49 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-e2223430-ce82-451b-bfcc-3def1180001b tempest-CreateVolumesFromSnapshotTest-1127395155 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 20:04:49 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-7323c997-ae70-4290-b5cd-949f6515d327 tempest-CinderUnicodeTest-1101475161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-757d373a-a944-4ace-8acb-8929b8f3ffc5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-757d373a-a944-4ace-8acb-8929b8f3ffc5.0ec9fcbb-8a38-4d22-b1f4-58626a1b5295 1G" returned: 0 in 1.331s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:04:49 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-7323c997-ae70-4290-b5cd-949f6515d327 tempest-CinderUnicodeTest-1101475161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-757d373a-a944-4ace-8acb-8929b8f3ffc5 -F qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-757d373a-a944-4ace-8acb-8929b8f3ffc5.0ec9fcbb-8a38-4d22-b1f4-58626a1b5295 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:04:49 devstack sudo[106945]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-757d373a-a944-4ace-8acb-8929b8f3ffc5 -F qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-757d373a-a944-4ace-8acb-8929b8f3ffc5.0ec9fcbb-8a38-4d22-b1f4-58626a1b5295
Jul 02 20:04:49 devstack sudo[106945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:04:50 devstack sudo[106938]: pam_unix(sudo:session): session closed for user root
Jul 02 20:04:50 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-880ee1f5-99f5-474f-aa0d-7ff8f3447672 tempest-VolumeAndVolumeTypeFromImageTest-1431078512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-7e5353fc-811f-44c7-b05e-1573507d50a1" returned: 1 in 1.129s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:04:50 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-880ee1f5-99f5-474f-aa0d-7ff8f3447672 tempest-VolumeAndVolumeTypeFromImageTest-1431078512 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-7e5353fc-811f-44c7-b05e-1573507d50a1' failed. Not Retrying. {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 02 20:04:50 devstack cinder-volume[86639]: DEBUG cinder.volume.volume_utils [None req-880ee1f5-99f5-474f-aa0d-7ff8f3447672 tempest-VolumeAndVolumeTypeFromImageTest-1431078512 None] Downloaded image 9244de81-7e30-4359-8173-2858997d1cb2 ((None, [{'url': 'file:///opt/stack/data/glance/images/9244de81-7e30-4359-8173-2858997d1cb2', 'metadata': {}}])) to volume 7e5353fc-811f-44c7-b05e-1573507d50a1 successfully. {{(pid=86639) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jul 02 20:04:50 devstack cinder-volume[86639]: DEBUG cinder.image.image_utils [None req-880ee1f5-99f5-474f-aa0d-7ff8f3447672 tempest-VolumeAndVolumeTypeFromImageTest-1431078512 None] Temporary image 9244de81-7e30-4359-8173-2858997d1cb2 for user dfa2a4b97f2e4c1f848b1c21d8b5313a is deleted. {{(pid=86639) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jul 02 20:04:50 devstack cinder-volume[86639]: DEBUG cinder.volume.volume_utils [None req-880ee1f5-99f5-474f-aa0d-7ff8f3447672 tempest-VolumeAndVolumeTypeFromImageTest-1431078512 None] Marking volume 7e5353fc-811f-44c7-b05e-1573507d50a1 as bootable. {{(pid=86639) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jul 02 20:04:50 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-5b67a66e-dbfa-4bef-9c69-85ea8cb2f935 tempest-CreateVolumesFromImageTest-5083140 None] Acquiring lock "cinder-028322ce-d9b7-45d6-84d2-d01de4808af1-delete_volume" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 20:04:50 devstack cinder-volume[86639]: DEBUG cinder.volume.flows.manager.create_volume [None req-880ee1f5-99f5-474f-aa0d-7ff8f3447672 tempest-VolumeAndVolumeTypeFromImageTest-1431078512 None] Copying metadata from image 9244de81-7e30-4359-8173-2858997d1cb2 to 7e5353fc-811f-44c7-b05e-1573507d50a1. {{(pid=86639) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jul 02 20:04:50 devstack cinder-volume[86639]: DEBUG cinder.volume.flows.manager.create_volume [None req-880ee1f5-99f5-474f-aa0d-7ff8f3447672 tempest-VolumeAndVolumeTypeFromImageTest-1431078512 None] Creating volume glance metadata for volume 7e5353fc-811f-44c7-b05e-1573507d50a1 backed by image 9244de81-7e30-4359-8173-2858997d1cb2 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '9244de81-7e30-4359-8173-2858997d1cb2', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '07e4762e075927f55a0404c6a01b0b60', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86639) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jul 02 20:04:50 devstack cinder-volume[86639]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb2f2657-cce7-4a87-8ebc-593ea64b9301 tempest-CreateVolumesFromSnapshotTest-1127395155 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 20:04:50 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-cb2f2657-cce7-4a87-8ebc-593ea64b9301 tempest-CreateVolumesFromSnapshotTest-1127395155 None] Flow 'volume_create_manager' (663aeb18-aeb4-4257-994b-033d01177b02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 20:04:50 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-cb2f2657-cce7-4a87-8ebc-593ea64b9301 tempest-CreateVolumesFromSnapshotTest-1127395155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b307a03-cf53-4b77-b88e-744e1a554098) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:04:50 devstack sudo[106939]: pam_unix(sudo:session): session closed for user root
Jul 02 20:04:50 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-bf2bd663-f167-4550-b984-1844dbf9f85b tempest-CreateVolumesFromImageTest-5083140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e" returned: 0 in 1.145s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:04:50 devstack cinder-volume[86639]: DEBUG cinder.manager [None req-bf2bd663-f167-4550-b984-1844dbf9f85b tempest-CreateVolumesFromImageTest-5083140 None] Notifying Schedulers of capabilities ... {{(pid=86639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 20:04:50 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-5b67a66e-dbfa-4bef-9c69-85ea8cb2f935 tempest-CreateVolumesFromImageTest-5083140 None] Lock "cinder-028322ce-d9b7-45d6-84d2-d01de4808af1-delete_volume" acquired by "delete_volume" :: waited 0.097s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 20:04:50 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-bf2bd663-f167-4550-b984-1844dbf9f85b tempest-CreateVolumesFromImageTest-5083140 None] Deleted volume successfully.
Jul 02 20:04:50 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-cb2f2657-cce7-4a87-8ebc-593ea64b9301 tempest-CreateVolumesFromSnapshotTest-1127395155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b307a03-cf53-4b77-b88e-744e1a554098) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T18:04:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1244511030',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98fc0f7b-f3f8-4e97-83f7-d9e927fcf84d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfffcb664c3f4b49b07a3412c1642700',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T18:04:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T18:04:50Z,use_quota=True,user_id='ca1bd1389a844499a1f59dc320b608a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:04:50 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-cb2f2657-cce7-4a87-8ebc-593ea64b9301 tempest-CreateVolumesFromSnapshotTest-1127395155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6b57fc4-634c-4727-a4b6-e3c2f4de25a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:04:50 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-cb2f2657-cce7-4a87-8ebc-593ea64b9301 tempest-CreateVolumesFromSnapshotTest-1127395155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6b57fc4-634c-4727-a4b6-e3c2f4de25a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:04:50 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-cb2f2657-cce7-4a87-8ebc-593ea64b9301 tempest-CreateVolumesFromSnapshotTest-1127395155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc26db01-9938-492f-8586-65f02417a6c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:04:50 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-cb2f2657-cce7-4a87-8ebc-593ea64b9301 tempest-CreateVolumesFromSnapshotTest-1127395155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc26db01-9938-492f-8586-65f02417a6c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '98fc0f7b-f3f8-4e97-83f7-d9e927fcf84d', 'volume_name': 'volume-98fc0f7b-f3f8-4e97-83f7-d9e927fcf84d', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:04:50 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-cb2f2657-cce7-4a87-8ebc-593ea64b9301 tempest-CreateVolumesFromSnapshotTest-1127395155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07c32351-09b0-45bb-923c-6323e8a6b39c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:04:50 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-cb2f2657-cce7-4a87-8ebc-593ea64b9301 tempest-CreateVolumesFromSnapshotTest-1127395155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07c32351-09b0-45bb-923c-6323e8a6b39c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:04:50 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-cb2f2657-cce7-4a87-8ebc-593ea64b9301 tempest-CreateVolumesFromSnapshotTest-1127395155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cae99b25-e153-4f46-a3ea-56d5ce999964) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:04:50 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-cb2f2657-cce7-4a87-8ebc-593ea64b9301 tempest-CreateVolumesFromSnapshotTest-1127395155 None] Volume 98fc0f7b-f3f8-4e97-83f7-d9e927fcf84d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-98fc0f7b-f3f8-4e97-83f7-d9e927fcf84d', 'volume_size': 1}
Jul 02 20:04:50 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-cb2f2657-cce7-4a87-8ebc-593ea64b9301 tempest-CreateVolumesFromSnapshotTest-1127395155 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 20:04:50 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-bf2bd663-f167-4550-b984-1844dbf9f85b tempest-CreateVolumesFromImageTest-5083140 None] Lock "cinder-453fcf9c-db7a-442f-a64d-59dfc5d1428c-delete_volume" released by "delete_volume" :: held 3.750s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 20:04:50 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-5b67a66e-dbfa-4bef-9c69-85ea8cb2f935 tempest-CreateVolumesFromImageTest-5083140 None] Acquiring lock "cinder-quobyte-028322ce-d9b7-45d6-84d2-d01de4808af1" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 20:04:50 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-5b67a66e-dbfa-4bef-9c69-85ea8cb2f935 tempest-CreateVolumesFromImageTest-5083140 None] Lock "cinder-quobyte-028322ce-d9b7-45d6-84d2-d01de4808af1" acquired by "delete_volume" :: waited 0.023s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 20:04:50 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-880ee1f5-99f5-474f-aa0d-7ff8f3447672 tempest-VolumeAndVolumeTypeFromImageTest-1431078512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e93984e8-4d26-45b2-967f-c4daf79f25a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e5353fc-811f-44c7-b05e-1573507d50a1', 'volume_size': 1, 'image_id': '9244de81-7e30-4359-8173-2858997d1cb2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9244de81-7e30-4359-8173-2858997d1cb2', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '07e4762e075927f55a0404c6a01b0b60', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '7782f7af12734e659dd0009d35f55e70', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ef6aa29076c4512b2e19099d91a38269497442a23c48644e811604deb4e36de059a49bb06e34c22cafbd0ca6da20a4d967bd5e93971e8cec404711a3cc6a4c1d', 'id': '9244de81-7e30-4359-8173-2858997d1cb2', 'created_at': datetime.datetime(2026, 7, 2, 18, 4, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 2, 18, 4, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9244de81-7e30-4359-8173-2858997d1cb2/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fce84adcd10>}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:04:50 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-880ee1f5-99f5-474f-aa0d-7ff8f3447672 tempest-VolumeAndVolumeTypeFromImageTest-1431078512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4e89edf-c377-484d-9e74-01fbd9582918) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:04:50 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c549135-f055-4690-a46d-792e781f4e54]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 20:04:50 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-5b67a66e-dbfa-4bef-9c69-85ea8cb2f935 tempest-CreateVolumesFromImageTest-5083140 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-028322ce-d9b7-45d6-84d2-d01de4808af1 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:04:50 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-880ee1f5-99f5-474f-aa0d-7ff8f3447672 tempest-VolumeAndVolumeTypeFromImageTest-1431078512 None] Volume volume-7e5353fc-811f-44c7-b05e-1573507d50a1 (7e5353fc-811f-44c7-b05e-1573507d50a1): created successfully
Jul 02 20:04:50 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-880ee1f5-99f5-474f-aa0d-7ff8f3447672 tempest-VolumeAndVolumeTypeFromImageTest-1431078512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4e89edf-c377-484d-9e74-01fbd9582918) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:04:50 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-880ee1f5-99f5-474f-aa0d-7ff8f3447672 tempest-VolumeAndVolumeTypeFromImageTest-1431078512 None] Flow 'volume_create_manager' (3a8a71ed-8235-4626-ab47-ff7e3b3800d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 20:04:50 devstack cinder-volume[86639]: DEBUG cinder.volume.flows.manager.create_volume [None req-84b8975c-4084-41a1-9d63-5055e1f29c9d tempest-CreateVolumesFromSnapshotTest-1127395155 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 20:04:50 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-84b8975c-4084-41a1-9d63-5055e1f29c9d tempest-CreateVolumesFromSnapshotTest-1127395155 None] Flow 'volume_create_manager' (d82209cb-8307-4a65-a7c8-6cccf02d5a50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 20:04:50 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-84b8975c-4084-41a1-9d63-5055e1f29c9d tempest-CreateVolumesFromSnapshotTest-1127395155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83737155-9cac-4223-a170-483ca54120ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:04:50 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-880ee1f5-99f5-474f-aa0d-7ff8f3447672 tempest-VolumeAndVolumeTypeFromImageTest-1431078512 None] Created volume successfully.
Jul 02 20:04:50 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-84b8975c-4084-41a1-9d63-5055e1f29c9d tempest-CreateVolumesFromSnapshotTest-1127395155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83737155-9cac-4223-a170-483ca54120ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T18:04:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1221147574',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e293c981-d5d0-49ee-9bcd-9f8f958cbeef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfffcb664c3f4b49b07a3412c1642700',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T18:04:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T18:04:51Z,use_quota=True,user_id='ca1bd1389a844499a1f59dc320b608a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:04:50 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-84b8975c-4084-41a1-9d63-5055e1f29c9d tempest-CreateVolumesFromSnapshotTest-1127395155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (969fa094-242a-4059-9962-f1f7d742e746) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:04:50 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-84b8975c-4084-41a1-9d63-5055e1f29c9d tempest-CreateVolumesFromSnapshotTest-1127395155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (969fa094-242a-4059-9962-f1f7d742e746) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:04:50 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-84b8975c-4084-41a1-9d63-5055e1f29c9d tempest-CreateVolumesFromSnapshotTest-1127395155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b67d0a8d-e6c8-4c6f-9177-ff83a39146b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:04:50 devstack sudo[106951]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-028322ce-d9b7-45d6-84d2-d01de4808af1
Jul 02 20:04:50 devstack sudo[106951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:04:50 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-84b8975c-4084-41a1-9d63-5055e1f29c9d tempest-CreateVolumesFromSnapshotTest-1127395155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b67d0a8d-e6c8-4c6f-9177-ff83a39146b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e293c981-d5d0-49ee-9bcd-9f8f958cbeef', 'volume_name': 'volume-e293c981-d5d0-49ee-9bcd-9f8f958cbeef', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:04:50 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-84b8975c-4084-41a1-9d63-5055e1f29c9d tempest-CreateVolumesFromSnapshotTest-1127395155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1d89938-5b90-4c38-a443-71327fdf2525) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:04:50 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-84b8975c-4084-41a1-9d63-5055e1f29c9d tempest-CreateVolumesFromSnapshotTest-1127395155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1d89938-5b90-4c38-a443-71327fdf2525) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:04:50 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-84b8975c-4084-41a1-9d63-5055e1f29c9d tempest-CreateVolumesFromSnapshotTest-1127395155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7808539-f950-4f65-b217-953f108da413) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:04:50 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-84b8975c-4084-41a1-9d63-5055e1f29c9d tempest-CreateVolumesFromSnapshotTest-1127395155 None] Volume e293c981-d5d0-49ee-9bcd-9f8f958cbeef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e293c981-d5d0-49ee-9bcd-9f8f958cbeef', 'volume_size': 1}
Jul 02 20:04:50 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-84b8975c-4084-41a1-9d63-5055e1f29c9d tempest-CreateVolumesFromSnapshotTest-1127395155 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 20:04:50 devstack sudo[106945]: pam_unix(sudo:session): session closed for user root
Jul 02 20:04:50 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-6e08ded9-785e-4dd5-a28d-ecede1c5377c tempest-VolumeAndVolumeTypeFromImageTest-1431078512 None] Acquiring lock "cinder-7e5353fc-811f-44c7-b05e-1573507d50a1-delete_volume" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 20:04:50 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-7323c997-ae70-4290-b5cd-949f6515d327 tempest-CinderUnicodeTest-1101475161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-757d373a-a944-4ace-8acb-8929b8f3ffc5 -F qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-757d373a-a944-4ace-8acb-8929b8f3ffc5.0ec9fcbb-8a38-4d22-b1f4-58626a1b5295" returned: 0 in 0.981s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:04:50 devstack cinder-volume[86639]: WARNING cinder.volume.drivers.remotefs [None req-7323c997-ae70-4290-b5cd-949f6515d327 tempest-CinderUnicodeTest-1101475161 None] /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-757d373a-a944-4ace-8acb-8929b8f3ffc5.0ec9fcbb-8a38-4d22-b1f4-58626a1b5295 is being set with open permissions: ugo+rw
Jul 02 20:04:50 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-7323c997-ae70-4290-b5cd-949f6515d327 tempest-CinderUnicodeTest-1101475161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-757d373a-a944-4ace-8acb-8929b8f3ffc5.0ec9fcbb-8a38-4d22-b1f4-58626a1b5295 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:04:50 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-6e08ded9-785e-4dd5-a28d-ecede1c5377c tempest-VolumeAndVolumeTypeFromImageTest-1431078512 None] Lock "cinder-7e5353fc-811f-44c7-b05e-1573507d50a1-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 20:04:50 devstack sudo[106956]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-757d373a-a944-4ace-8acb-8929b8f3ffc5.0ec9fcbb-8a38-4d22-b1f4-58626a1b5295
Jul 02 20:04:50 devstack sudo[106956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:04:50 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-6e08ded9-785e-4dd5-a28d-ecede1c5377c tempest-VolumeAndVolumeTypeFromImageTest-1431078512 None] Acquiring lock "cinder-quobyte-7e5353fc-811f-44c7-b05e-1573507d50a1" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 20:04:50 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-6e08ded9-785e-4dd5-a28d-ecede1c5377c tempest-VolumeAndVolumeTypeFromImageTest-1431078512 None] Lock "cinder-quobyte-7e5353fc-811f-44c7-b05e-1573507d50a1" acquired by "delete_volume" :: waited 0.022s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 20:04:51 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[f07b0f1b-e0fc-4b02-8b22-7259d0116f77]: (4, 'raw') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 20:04:51 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-6e08ded9-785e-4dd5-a28d-ecede1c5377c tempest-VolumeAndVolumeTypeFromImageTest-1431078512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-7e5353fc-811f-44c7-b05e-1573507d50a1 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:04:51 devstack sudo[106958]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-7e5353fc-811f-44c7-b05e-1573507d50a1
Jul 02 20:04:51 devstack sudo[106958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:04:51 devstack sudo[106951]: pam_unix(sudo:session): session closed for user root
Jul 02 20:04:51 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-5b67a66e-dbfa-4bef-9c69-85ea8cb2f935 tempest-CreateVolumesFromImageTest-5083140 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-028322ce-d9b7-45d6-84d2-d01de4808af1" returned: 0 in 0.865s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:04:51 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-5b67a66e-dbfa-4bef-9c69-85ea8cb2f935 tempest-CreateVolumesFromImageTest-5083140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-028322ce-d9b7-45d6-84d2-d01de4808af1 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:04:51 devstack sudo[106964]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-028322ce-d9b7-45d6-84d2-d01de4808af1
Jul 02 20:04:51 devstack sudo[106964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:04:51 devstack sudo[106956]: pam_unix(sudo:session): session closed for user root
Jul 02 20:04:51 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-7323c997-ae70-4290-b5cd-949f6515d327 tempest-CinderUnicodeTest-1101475161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-757d373a-a944-4ace-8acb-8929b8f3ffc5.0ec9fcbb-8a38-4d22-b1f4-58626a1b5295" returned: 0 in 0.788s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:04:51 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-7323c997-ae70-4290-b5cd-949f6515d327 tempest-CinderUnicodeTest-1101475161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-757d373a-a944-4ace-8acb-8929b8f3ffc5.info {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:04:51 devstack sudo[106969]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-757d373a-a944-4ace-8acb-8929b8f3ffc5.info
Jul 02 20:04:51 devstack sudo[106969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:04:51 devstack sudo[106958]: pam_unix(sudo:session): session closed for user root
Jul 02 20:04:51 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-6e08ded9-785e-4dd5-a28d-ecede1c5377c tempest-VolumeAndVolumeTypeFromImageTest-1431078512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-7e5353fc-811f-44c7-b05e-1573507d50a1" returned: 0 in 0.824s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:04:51 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-6e08ded9-785e-4dd5-a28d-ecede1c5377c tempest-VolumeAndVolumeTypeFromImageTest-1431078512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-7e5353fc-811f-44c7-b05e-1573507d50a1 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:04:51 devstack sudo[106971]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-7e5353fc-811f-44c7-b05e-1573507d50a1
Jul 02 20:04:51 devstack sudo[106971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:04:52 devstack sudo[106964]: pam_unix(sudo:session): session closed for user root
Jul 02 20:04:52 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-5b67a66e-dbfa-4bef-9c69-85ea8cb2f935 tempest-CreateVolumesFromImageTest-5083140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-028322ce-d9b7-45d6-84d2-d01de4808af1" returned: 0 in 0.680s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:04:52 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-5b67a66e-dbfa-4bef-9c69-85ea8cb2f935 tempest-CreateVolumesFromImageTest-5083140 None] Lock "cinder-quobyte-028322ce-d9b7-45d6-84d2-d01de4808af1" released by "delete_volume" :: held 1.607s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 20:04:52 devstack cinder-volume[86639]: DEBUG cinder.quota [None req-5b67a66e-dbfa-4bef-9c69-85ea8cb2f935 tempest-CreateVolumesFromImageTest-5083140 None] Created reservations ['1dd5828f-f189-4a12-ae92-13d5c1e12733', '84717d4b-7e1a-43ce-a137-8a44792a1981', '1b5f5625-7bda-4ca6-8a48-56b86c3ecb66', 'a3312875-8535-47e7-9234-d6c650b55e83'] {{(pid=86639) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 20:04:52 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-5b67a66e-dbfa-4bef-9c69-85ea8cb2f935 tempest-CreateVolumesFromImageTest-5083140 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 20:04:52 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-5b67a66e-dbfa-4bef-9c69-85ea8cb2f935 tempest-CreateVolumesFromImageTest-5083140 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 20:04:52 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-5b67a66e-dbfa-4bef-9c69-85ea8cb2f935 tempest-CreateVolumesFromImageTest-5083140 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 20:04:52 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-5b67a66e-dbfa-4bef-9c69-85ea8cb2f935 tempest-CreateVolumesFromImageTest-5083140 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 20:04:52 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-5b67a66e-dbfa-4bef-9c69-85ea8cb2f935 tempest-CreateVolumesFromImageTest-5083140 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 20:04:52 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-5b67a66e-dbfa-4bef-9c69-85ea8cb2f935 tempest-CreateVolumesFromImageTest-5083140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:04:52 devstack sudo[106977]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e
Jul 02 20:04:52 devstack sudo[106977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:04:52 devstack sudo[106969]: pam_unix(sudo:session): session closed for user root
Jul 02 20:04:52 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-7323c997-ae70-4290-b5cd-949f6515d327 tempest-CinderUnicodeTest-1101475161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-757d373a-a944-4ace-8acb-8929b8f3ffc5.info" returned: 0 in 0.720s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:04:52 devstack cinder-volume[86639]: WARNING cinder.volume.drivers.remotefs [None req-7323c997-ae70-4290-b5cd-949f6515d327 tempest-CinderUnicodeTest-1101475161 None] /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-757d373a-a944-4ace-8acb-8929b8f3ffc5.info is being set with open permissions: ugo+rw
Jul 02 20:04:52 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-7323c997-ae70-4290-b5cd-949f6515d327 tempest-CinderUnicodeTest-1101475161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-757d373a-a944-4ace-8acb-8929b8f3ffc5.info {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:04:52 devstack sudo[106979]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-757d373a-a944-4ace-8acb-8929b8f3ffc5.info
Jul 02 20:04:52 devstack sudo[106979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:04:52 devstack sudo[106971]: pam_unix(sudo:session): session closed for user root
Jul 02 20:04:52 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-6e08ded9-785e-4dd5-a28d-ecede1c5377c tempest-VolumeAndVolumeTypeFromImageTest-1431078512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-7e5353fc-811f-44c7-b05e-1573507d50a1" returned: 1 in 0.948s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:04:52 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-6e08ded9-785e-4dd5-a28d-ecede1c5377c tempest-VolumeAndVolumeTypeFromImageTest-1431078512 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-7e5353fc-811f-44c7-b05e-1573507d50a1' failed. Not Retrying. {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 02 20:04:52 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-6e08ded9-785e-4dd5-a28d-ecede1c5377c tempest-VolumeAndVolumeTypeFromImageTest-1431078512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-7e5353fc-811f-44c7-b05e-1573507d50a1 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:04:52 devstack sudo[106984]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-7e5353fc-811f-44c7-b05e-1573507d50a1
Jul 02 20:04:52 devstack sudo[106984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:04:53 devstack sudo[106977]: pam_unix(sudo:session): session closed for user root
Jul 02 20:04:53 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-5b67a66e-dbfa-4bef-9c69-85ea8cb2f935 tempest-CreateVolumesFromImageTest-5083140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e" returned: 0 in 0.790s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:04:53 devstack cinder-volume[86639]: DEBUG cinder.manager [None req-5b67a66e-dbfa-4bef-9c69-85ea8cb2f935 tempest-CreateVolumesFromImageTest-5083140 None] Notifying Schedulers of capabilities ... {{(pid=86639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 20:04:53 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-5b67a66e-dbfa-4bef-9c69-85ea8cb2f935 tempest-CreateVolumesFromImageTest-5083140 None] Deleted volume successfully.
Jul 02 20:04:53 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-5b67a66e-dbfa-4bef-9c69-85ea8cb2f935 tempest-CreateVolumesFromImageTest-5083140 None] Lock "cinder-028322ce-d9b7-45d6-84d2-d01de4808af1-delete_volume" released by "delete_volume" :: held 2.846s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 20:04:53 devstack sudo[106979]: pam_unix(sudo:session): session closed for user root
Jul 02 20:04:53 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-7323c997-ae70-4290-b5cd-949f6515d327 tempest-CinderUnicodeTest-1101475161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-757d373a-a944-4ace-8acb-8929b8f3ffc5.info" returned: 0 in 0.766s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:04:53 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-7323c997-ae70-4290-b5cd-949f6515d327 tempest-CinderUnicodeTest-1101475161 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.686s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 20:04:53 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-6d947f16-2605-47c9-8f24-db2e2cddabce tempest-CreateVolumesFromSnapshotTest-1127395155 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.295s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 20:04:53 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-6d947f16-2605-47c9-8f24-db2e2cddabce tempest-CreateVolumesFromSnapshotTest-1127395155 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce906cb830>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T18:04:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-590479448',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=158a8c57-bddf-4c71-86f6-661b6f42fb7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfffcb664c3f4b49b07a3412c1642700',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T18:04:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T18:04:49Z,use_quota=True,user_id='ca1bd1389a844499a1f59dc320b608a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)}" {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 20:04:53 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-6d947f16-2605-47c9-8f24-db2e2cddabce tempest-CreateVolumesFromSnapshotTest-1127395155 None] Creating volume 158a8c57-bddf-4c71-86f6-661b6f42fb7e {{(pid=86639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 20:04:53 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-6d947f16-2605-47c9-8f24-db2e2cddabce tempest-CreateVolumesFromSnapshotTest-1127395155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 20:04:53 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-6d947f16-2605-47c9-8f24-db2e2cddabce tempest-CreateVolumesFromSnapshotTest-1127395155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 20:04:53 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-6d947f16-2605-47c9-8f24-db2e2cddabce tempest-CreateVolumesFromSnapshotTest-1127395155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 20:04:53 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-6d947f16-2605-47c9-8f24-db2e2cddabce tempest-CreateVolumesFromSnapshotTest-1127395155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 20:04:53 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-6d947f16-2605-47c9-8f24-db2e2cddabce tempest-CreateVolumesFromSnapshotTest-1127395155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 20:04:53 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-6d947f16-2605-47c9-8f24-db2e2cddabce tempest-CreateVolumesFromSnapshotTest-1127395155 None] Selected osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92 as target Quobyte volume. {{(pid=86639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 20:04:53 devstack cinder-volume[86639]: INFO cinder.volume.drivers.remotefs [None req-6d947f16-2605-47c9-8f24-db2e2cddabce tempest-CreateVolumesFromSnapshotTest-1127395155 None] casted to osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92
Jul 02 20:04:53 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-6d947f16-2605-47c9-8f24-db2e2cddabce tempest-CreateVolumesFromSnapshotTest-1127395155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-158a8c57-bddf-4c71-86f6-661b6f42fb7e 1073741824 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:04:53 devstack sudo[106988]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-158a8c57-bddf-4c71-86f6-661b6f42fb7e 1073741824
Jul 02 20:04:53 devstack sudo[106988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:04:53 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-7323c997-ae70-4290-b5cd-949f6515d327 tempest-CinderUnicodeTest-1101475161 None] Create snapshot completed successfully
Jul 02 20:04:53 devstack sudo[106984]: pam_unix(sudo:session): session closed for user root
Jul 02 20:04:53 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-6e08ded9-785e-4dd5-a28d-ecede1c5377c tempest-VolumeAndVolumeTypeFromImageTest-1431078512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-7e5353fc-811f-44c7-b05e-1573507d50a1" returned: 0 in 0.805s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:04:53 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-6e08ded9-785e-4dd5-a28d-ecede1c5377c tempest-VolumeAndVolumeTypeFromImageTest-1431078512 None] Lock "cinder-quobyte-7e5353fc-811f-44c7-b05e-1573507d50a1" released by "delete_volume" :: held 2.646s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 20:04:53 devstack cinder-volume[86639]: DEBUG cinder.quota [None req-6e08ded9-785e-4dd5-a28d-ecede1c5377c tempest-VolumeAndVolumeTypeFromImageTest-1431078512 None] Created reservations ['246938ff-694f-45ea-a95f-139210691d40', 'e7ffce0a-1c0c-4182-b992-782a3acc93c5', '320bb037-c6bd-4744-beb4-acef94ab64b0', 'aefabdc5-ebdb-41a7-baea-4be6cbb15190'] {{(pid=86639) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 20:04:53 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-6e08ded9-785e-4dd5-a28d-ecede1c5377c tempest-VolumeAndVolumeTypeFromImageTest-1431078512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 20:04:53 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-6e08ded9-785e-4dd5-a28d-ecede1c5377c tempest-VolumeAndVolumeTypeFromImageTest-1431078512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 20:04:53 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-6e08ded9-785e-4dd5-a28d-ecede1c5377c tempest-VolumeAndVolumeTypeFromImageTest-1431078512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 20:04:53 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-6e08ded9-785e-4dd5-a28d-ecede1c5377c tempest-VolumeAndVolumeTypeFromImageTest-1431078512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 20:04:53 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-6e08ded9-785e-4dd5-a28d-ecede1c5377c tempest-VolumeAndVolumeTypeFromImageTest-1431078512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 20:04:53 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-6e08ded9-785e-4dd5-a28d-ecede1c5377c tempest-VolumeAndVolumeTypeFromImageTest-1431078512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:04:53 devstack sudo[106992]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e
Jul 02 20:04:53 devstack sudo[106992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:04:54 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-c584fc1f-e944-48fb-9dd0-59d125f7ec6f tempest-CinderUnicodeTest-1101475161 None] Acquiring lock "cinder-0ec9fcbb-8a38-4d22-b1f4-58626a1b5295-delete_snapshot" by "delete_snapshot" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 20:04:54 devstack sudo[106988]: pam_unix(sudo:session): session closed for user root
Jul 02 20:04:54 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-6d947f16-2605-47c9-8f24-db2e2cddabce tempest-CreateVolumesFromSnapshotTest-1127395155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-158a8c57-bddf-4c71-86f6-661b6f42fb7e 1073741824" returned: 0 in 1.112s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:04:54 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-c584fc1f-e944-48fb-9dd0-59d125f7ec6f tempest-CinderUnicodeTest-1101475161 None] Lock "cinder-0ec9fcbb-8a38-4d22-b1f4-58626a1b5295-delete_snapshot" acquired by "delete_snapshot" :: waited 0.046s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 20:04:54 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-c584fc1f-e944-48fb-9dd0-59d125f7ec6f tempest-CinderUnicodeTest-1101475161 None] Acquiring lock "cinder-quobyte-757d373a-a944-4ace-8acb-8929b8f3ffc5" by "delete_snapshot" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 20:04:54 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-c584fc1f-e944-48fb-9dd0-59d125f7ec6f tempest-CinderUnicodeTest-1101475161 None] Lock "cinder-quobyte-757d373a-a944-4ace-8acb-8929b8f3ffc5" acquired by "delete_snapshot" :: waited 0.037s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 20:04:54 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-c584fc1f-e944-48fb-9dd0-59d125f7ec6f tempest-CinderUnicodeTest-1101475161 None] Acquiring lock "cinder-quobyte-0ec9fcbb-8a38-4d22-b1f4-58626a1b5295" by "_delete_snapshot" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 20:04:54 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-c584fc1f-e944-48fb-9dd0-59d125f7ec6f tempest-CinderUnicodeTest-1101475161 None] Lock "cinder-quobyte-0ec9fcbb-8a38-4d22-b1f4-58626a1b5295" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 20:04:54 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-c584fc1f-e944-48fb-9dd0-59d125f7ec6f tempest-CinderUnicodeTest-1101475161 None] Deleting offline snapshot 0ec9fcbb-8a38-4d22-b1f4-58626a1b5295 of volume 757d373a-a944-4ace-8acb-8929b8f3ffc5 {{(pid=86639) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 02 20:04:54 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-c584fc1f-e944-48fb-9dd0-59d125f7ec6f tempest-CinderUnicodeTest-1101475161 None] snapshot_file for this snap is: volume-757d373a-a944-4ace-8acb-8929b8f3ffc5.0ec9fcbb-8a38-4d22-b1f4-58626a1b5295 {{(pid=86639) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 02 20:04:54 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-6d947f16-2605-47c9-8f24-db2e2cddabce tempest-CreateVolumesFromSnapshotTest-1127395155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-158a8c57-bddf-4c71-86f6-661b6f42fb7e {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:04:54 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3e3e0a0-5f1f-4524-8850-39e1b2c7bc68]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 20:04:54 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-c584fc1f-e944-48fb-9dd0-59d125f7ec6f tempest-CinderUnicodeTest-1101475161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-757d373a-a944-4ace-8acb-8929b8f3ffc5.0ec9fcbb-8a38-4d22-b1f4-58626a1b5295 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:04:54 devstack sudo[106999]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-158a8c57-bddf-4c71-86f6-661b6f42fb7e
Jul 02 20:04:54 devstack sudo[106999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:04:54 devstack sudo[107001]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-757d373a-a944-4ace-8acb-8929b8f3ffc5.0ec9fcbb-8a38-4d22-b1f4-58626a1b5295
Jul 02 20:04:54 devstack sudo[107001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:04:54 devstack sudo[106992]: pam_unix(sudo:session): session closed for user root
Jul 02 20:04:54 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-6e08ded9-785e-4dd5-a28d-ecede1c5377c tempest-VolumeAndVolumeTypeFromImageTest-1431078512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e" returned: 0 in 0.897s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:04:54 devstack cinder-volume[86639]: DEBUG cinder.manager [None req-6e08ded9-785e-4dd5-a28d-ecede1c5377c tempest-VolumeAndVolumeTypeFromImageTest-1431078512 None] Notifying Schedulers of capabilities ... {{(pid=86639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 20:04:54 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-6e08ded9-785e-4dd5-a28d-ecede1c5377c tempest-VolumeAndVolumeTypeFromImageTest-1431078512 None] Deleted volume successfully.
Jul 02 20:04:54 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-6e08ded9-785e-4dd5-a28d-ecede1c5377c tempest-VolumeAndVolumeTypeFromImageTest-1431078512 None] Lock "cinder-7e5353fc-811f-44c7-b05e-1573507d50a1-delete_volume" released by "delete_volume" :: held 3.881s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 20:04:55 devstack sudo[106999]: pam_unix(sudo:session): session closed for user root
Jul 02 20:04:55 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-6d947f16-2605-47c9-8f24-db2e2cddabce tempest-CreateVolumesFromSnapshotTest-1127395155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-158a8c57-bddf-4c71-86f6-661b6f42fb7e" returned: 0 in 0.947s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:04:55 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-6d947f16-2605-47c9-8f24-db2e2cddabce tempest-CreateVolumesFromSnapshotTest-1127395155 None] <== create_volume: return (2191ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'} {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 20:04:55 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-6d947f16-2605-47c9-8f24-db2e2cddabce tempest-CreateVolumesFromSnapshotTest-1127395155 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.194s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 20:04:55 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-a07a980a-c584-43d7-8555-bd8f45f8a047 tempest-CreateVolumesFromSnapshotTest-1127395155 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.952s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 20:04:55 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-a07a980a-c584-43d7-8555-bd8f45f8a047 tempest-CreateVolumesFromSnapshotTest-1127395155 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce906cb830>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T18:04:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-638352873',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79af5d4f-8b2e-4dd2-8745-88662a0f8ba0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfffcb664c3f4b49b07a3412c1642700',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T18:04:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T18:04:49Z,use_quota=True,user_id='ca1bd1389a844499a1f59dc320b608a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)}" {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 20:04:55 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-a07a980a-c584-43d7-8555-bd8f45f8a047 tempest-CreateVolumesFromSnapshotTest-1127395155 None] Creating volume 79af5d4f-8b2e-4dd2-8745-88662a0f8ba0 {{(pid=86639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 20:04:55 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-a07a980a-c584-43d7-8555-bd8f45f8a047 tempest-CreateVolumesFromSnapshotTest-1127395155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 20:04:55 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-a07a980a-c584-43d7-8555-bd8f45f8a047 tempest-CreateVolumesFromSnapshotTest-1127395155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 20:04:55 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-a07a980a-c584-43d7-8555-bd8f45f8a047 tempest-CreateVolumesFromSnapshotTest-1127395155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 20:04:55 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-a07a980a-c584-43d7-8555-bd8f45f8a047 tempest-CreateVolumesFromSnapshotTest-1127395155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 20:04:55 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-a07a980a-c584-43d7-8555-bd8f45f8a047 tempest-CreateVolumesFromSnapshotTest-1127395155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 20:04:55 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-a07a980a-c584-43d7-8555-bd8f45f8a047 tempest-CreateVolumesFromSnapshotTest-1127395155 None] Selected osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92 as target Quobyte volume. {{(pid=86639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 20:04:55 devstack cinder-volume[86639]: INFO cinder.volume.drivers.remotefs [None req-a07a980a-c584-43d7-8555-bd8f45f8a047 tempest-CreateVolumesFromSnapshotTest-1127395155 None] casted to osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92
Jul 02 20:04:55 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-a07a980a-c584-43d7-8555-bd8f45f8a047 tempest-CreateVolumesFromSnapshotTest-1127395155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-79af5d4f-8b2e-4dd2-8745-88662a0f8ba0 1073741824 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:04:55 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-6d947f16-2605-47c9-8f24-db2e2cddabce tempest-CreateVolumesFromSnapshotTest-1127395155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e174722-efa1-45c6-93e9-55728e3eea06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-158a8c57-bddf-4c71-86f6-661b6f42fb7e', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:04:55 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-6d947f16-2605-47c9-8f24-db2e2cddabce tempest-CreateVolumesFromSnapshotTest-1127395155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16f0a821-d102-43ae-9571-71918e919ab2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:04:55 devstack sudo[107010]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-79af5d4f-8b2e-4dd2-8745-88662a0f8ba0 1073741824
Jul 02 20:04:55 devstack sudo[107010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:04:55 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-6d947f16-2605-47c9-8f24-db2e2cddabce tempest-CreateVolumesFromSnapshotTest-1127395155 None] Volume volume-158a8c57-bddf-4c71-86f6-661b6f42fb7e (158a8c57-bddf-4c71-86f6-661b6f42fb7e): created successfully
Jul 02 20:04:55 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-6d947f16-2605-47c9-8f24-db2e2cddabce tempest-CreateVolumesFromSnapshotTest-1127395155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16f0a821-d102-43ae-9571-71918e919ab2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:04:55 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-6d947f16-2605-47c9-8f24-db2e2cddabce tempest-CreateVolumesFromSnapshotTest-1127395155 None] Flow 'volume_create_manager' (0c539858-d739-4b54-a70a-a5ba046c2451) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 20:04:55 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-6d947f16-2605-47c9-8f24-db2e2cddabce tempest-CreateVolumesFromSnapshotTest-1127395155 None] Created volume successfully.
Jul 02 20:04:55 devstack sudo[107001]: pam_unix(sudo:session): session closed for user root
Jul 02 20:04:55 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-c584fc1f-e944-48fb-9dd0-59d125f7ec6f tempest-CinderUnicodeTest-1101475161 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-757d373a-a944-4ace-8acb-8929b8f3ffc5.0ec9fcbb-8a38-4d22-b1f4-58626a1b5295" returned: 0 in 1.095s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:04:55 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-c584fc1f-e944-48fb-9dd0-59d125f7ec6f tempest-CinderUnicodeTest-1101475161 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-757d373a-a944-4ace-8acb-8929b8f3ffc5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86639) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 02 20:04:55 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[27f6b562-fece-4ea0-bc31-5b303952ab39]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 20:04:55 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-c584fc1f-e944-48fb-9dd0-59d125f7ec6f tempest-CinderUnicodeTest-1101475161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-757d373a-a944-4ace-8acb-8929b8f3ffc5 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:04:55 devstack sudo[107012]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-757d373a-a944-4ace-8acb-8929b8f3ffc5
Jul 02 20:04:55 devstack sudo[107012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:04:56 devstack sudo[107010]: pam_unix(sudo:session): session closed for user root
Jul 02 20:04:56 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-a07a980a-c584-43d7-8555-bd8f45f8a047 tempest-CreateVolumesFromSnapshotTest-1127395155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-79af5d4f-8b2e-4dd2-8745-88662a0f8ba0 1073741824" returned: 0 in 1.176s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:04:56 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-a07a980a-c584-43d7-8555-bd8f45f8a047 tempest-CreateVolumesFromSnapshotTest-1127395155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-79af5d4f-8b2e-4dd2-8745-88662a0f8ba0 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:04:56 devstack sudo[107021]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-79af5d4f-8b2e-4dd2-8745-88662a0f8ba0
Jul 02 20:04:56 devstack sudo[107021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:04:56 devstack sudo[107012]: pam_unix(sudo:session): session closed for user root
Jul 02 20:04:56 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-c584fc1f-e944-48fb-9dd0-59d125f7ec6f tempest-CinderUnicodeTest-1101475161 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-757d373a-a944-4ace-8acb-8929b8f3ffc5" returned: 0 in 1.190s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:04:56 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-c584fc1f-e944-48fb-9dd0-59d125f7ec6f tempest-CinderUnicodeTest-1101475161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-757d373a-a944-4ace-8acb-8929b8f3ffc5.0ec9fcbb-8a38-4d22-b1f4-58626a1b5295 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:04:56 devstack sudo[107023]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-757d373a-a944-4ace-8acb-8929b8f3ffc5.0ec9fcbb-8a38-4d22-b1f4-58626a1b5295
Jul 02 20:04:56 devstack sudo[107023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:04:57 devstack cinder-volume[86639]: DEBUG cinder.volume.flows.manager.create_volume [None req-2cea91d7-b488-4aff-bb3e-369a8fbf70e6 tempest-VolumeDependencyTests-1189288576 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 20:04:57 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-2cea91d7-b488-4aff-bb3e-369a8fbf70e6 tempest-VolumeDependencyTests-1189288576 None] Flow 'volume_create_manager' (787ce6f1-b2ea-45a0-9743-6a0359a42776) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 20:04:57 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-2cea91d7-b488-4aff-bb3e-369a8fbf70e6 tempest-VolumeDependencyTests-1189288576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4303f097-1c95-477f-9c64-3e25d48be9f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:04:57 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-2cea91d7-b488-4aff-bb3e-369a8fbf70e6 tempest-VolumeDependencyTests-1189288576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4303f097-1c95-477f-9c64-3e25d48be9f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T18:04:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-910613532',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ca68623-8e69-48d9-b453-cd62b2c53823,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6331398c26f5430ab6745cced81e28e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T18:04:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T18:04:57Z,use_quota=True,user_id='655530ba13194b4997735df3696865f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:04:57 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-2cea91d7-b488-4aff-bb3e-369a8fbf70e6 tempest-VolumeDependencyTests-1189288576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91e9679a-e26c-4613-8aad-0794b00cba1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:04:57 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-2cea91d7-b488-4aff-bb3e-369a8fbf70e6 tempest-VolumeDependencyTests-1189288576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91e9679a-e26c-4613-8aad-0794b00cba1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:04:57 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-2cea91d7-b488-4aff-bb3e-369a8fbf70e6 tempest-VolumeDependencyTests-1189288576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6c63898-c93b-4d17-9608-8b74bf349d2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:04:57 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-2cea91d7-b488-4aff-bb3e-369a8fbf70e6 tempest-VolumeDependencyTests-1189288576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6c63898-c93b-4d17-9608-8b74bf349d2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ca68623-8e69-48d9-b453-cd62b2c53823', 'volume_name': 'volume-7ca68623-8e69-48d9-b453-cd62b2c53823', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:04:57 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-2cea91d7-b488-4aff-bb3e-369a8fbf70e6 tempest-VolumeDependencyTests-1189288576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ca0d4da-8b9c-465c-82bf-952f342f8f55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:04:57 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-2cea91d7-b488-4aff-bb3e-369a8fbf70e6 tempest-VolumeDependencyTests-1189288576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ca0d4da-8b9c-465c-82bf-952f342f8f55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:04:57 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-2cea91d7-b488-4aff-bb3e-369a8fbf70e6 tempest-VolumeDependencyTests-1189288576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f797c9c1-f100-45ea-b966-c6a8b0734c77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:04:57 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-2cea91d7-b488-4aff-bb3e-369a8fbf70e6 tempest-VolumeDependencyTests-1189288576 None] Volume 7ca68623-8e69-48d9-b453-cd62b2c53823: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ca68623-8e69-48d9-b453-cd62b2c53823', 'volume_size': 1}
Jul 02 20:04:57 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-2cea91d7-b488-4aff-bb3e-369a8fbf70e6 tempest-VolumeDependencyTests-1189288576 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 20:04:57 devstack sudo[107021]: pam_unix(sudo:session): session closed for user root
Jul 02 20:04:57 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-a07a980a-c584-43d7-8555-bd8f45f8a047 tempest-CreateVolumesFromSnapshotTest-1127395155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-79af5d4f-8b2e-4dd2-8745-88662a0f8ba0" returned: 0 in 0.798s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:04:57 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-a07a980a-c584-43d7-8555-bd8f45f8a047 tempest-CreateVolumesFromSnapshotTest-1127395155 None] <== create_volume: return (2044ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'} {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 20:04:57 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-a07a980a-c584-43d7-8555-bd8f45f8a047 tempest-CreateVolumesFromSnapshotTest-1127395155 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.047s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 20:04:57 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-e2223430-ce82-451b-bfcc-3def1180001b tempest-CreateVolumesFromSnapshotTest-1127395155 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.598s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 20:04:57 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-e2223430-ce82-451b-bfcc-3def1180001b tempest-CreateVolumesFromSnapshotTest-1127395155 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce906cb830>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T18:04:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-245115512',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0c2aa04-4a57-4ecc-a977-55bf55843dae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfffcb664c3f4b49b07a3412c1642700',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T18:04:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T18:04:50Z,use_quota=True,user_id='ca1bd1389a844499a1f59dc320b608a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)}" {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 20:04:57 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-e2223430-ce82-451b-bfcc-3def1180001b tempest-CreateVolumesFromSnapshotTest-1127395155 None] Creating volume a0c2aa04-4a57-4ecc-a977-55bf55843dae {{(pid=86639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 20:04:57 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-e2223430-ce82-451b-bfcc-3def1180001b tempest-CreateVolumesFromSnapshotTest-1127395155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 20:04:57 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-e2223430-ce82-451b-bfcc-3def1180001b tempest-CreateVolumesFromSnapshotTest-1127395155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 20:04:57 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-e2223430-ce82-451b-bfcc-3def1180001b tempest-CreateVolumesFromSnapshotTest-1127395155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 20:04:57 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-e2223430-ce82-451b-bfcc-3def1180001b tempest-CreateVolumesFromSnapshotTest-1127395155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 20:04:57 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-e2223430-ce82-451b-bfcc-3def1180001b tempest-CreateVolumesFromSnapshotTest-1127395155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 20:04:57 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-e2223430-ce82-451b-bfcc-3def1180001b tempest-CreateVolumesFromSnapshotTest-1127395155 None] Selected osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92 as target Quobyte volume. {{(pid=86639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 20:04:57 devstack cinder-volume[86639]: INFO cinder.volume.drivers.remotefs [None req-e2223430-ce82-451b-bfcc-3def1180001b tempest-CreateVolumesFromSnapshotTest-1127395155 None] casted to osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92
Jul 02 20:04:57 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-e2223430-ce82-451b-bfcc-3def1180001b tempest-CreateVolumesFromSnapshotTest-1127395155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-a0c2aa04-4a57-4ecc-a977-55bf55843dae 1073741824 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:04:57 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-a07a980a-c584-43d7-8555-bd8f45f8a047 tempest-CreateVolumesFromSnapshotTest-1127395155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b00511ab-8dfd-4b51-8e33-91312c8c7668) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-79af5d4f-8b2e-4dd2-8745-88662a0f8ba0', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:04:57 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-a07a980a-c584-43d7-8555-bd8f45f8a047 tempest-CreateVolumesFromSnapshotTest-1127395155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa66cf31-1abe-4b89-9f7f-c7d97846a2fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:04:57 devstack sudo[107026]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-a0c2aa04-4a57-4ecc-a977-55bf55843dae 1073741824
Jul 02 20:04:57 devstack sudo[107026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:04:57 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-a07a980a-c584-43d7-8555-bd8f45f8a047 tempest-CreateVolumesFromSnapshotTest-1127395155 None] Volume volume-79af5d4f-8b2e-4dd2-8745-88662a0f8ba0 (79af5d4f-8b2e-4dd2-8745-88662a0f8ba0): created successfully
Jul 02 20:04:57 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-a07a980a-c584-43d7-8555-bd8f45f8a047 tempest-CreateVolumesFromSnapshotTest-1127395155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa66cf31-1abe-4b89-9f7f-c7d97846a2fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:04:57 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-a07a980a-c584-43d7-8555-bd8f45f8a047 tempest-CreateVolumesFromSnapshotTest-1127395155 None] Flow 'volume_create_manager' (6dea37f8-8511-4134-a614-5cbf5acbd82d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 20:04:57 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-a07a980a-c584-43d7-8555-bd8f45f8a047 tempest-CreateVolumesFromSnapshotTest-1127395155 None] Created volume successfully.
Jul 02 20:04:57 devstack sudo[107023]: pam_unix(sudo:session): session closed for user root
Jul 02 20:04:57 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-c584fc1f-e944-48fb-9dd0-59d125f7ec6f tempest-CinderUnicodeTest-1101475161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-757d373a-a944-4ace-8acb-8929b8f3ffc5.0ec9fcbb-8a38-4d22-b1f4-58626a1b5295" returned: 0 in 0.977s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:04:57 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-c584fc1f-e944-48fb-9dd0-59d125f7ec6f tempest-CinderUnicodeTest-1101475161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-757d373a-a944-4ace-8acb-8929b8f3ffc5.0ec9fcbb-8a38-4d22-b1f4-58626a1b5295 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:04:57 devstack sudo[107032]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-757d373a-a944-4ace-8acb-8929b8f3ffc5.0ec9fcbb-8a38-4d22-b1f4-58626a1b5295
Jul 02 20:04:57 devstack sudo[107032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:04:58 devstack sudo[107032]: pam_unix(sudo:session): session closed for user root
Jul 02 20:04:58 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-c584fc1f-e944-48fb-9dd0-59d125f7ec6f tempest-CinderUnicodeTest-1101475161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-757d373a-a944-4ace-8acb-8929b8f3ffc5.0ec9fcbb-8a38-4d22-b1f4-58626a1b5295" returned: 0 in 0.814s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:04:58 devstack sudo[107026]: pam_unix(sudo:session): session closed for user root
Jul 02 20:04:58 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-c584fc1f-e944-48fb-9dd0-59d125f7ec6f tempest-CinderUnicodeTest-1101475161 None] Lock "cinder-quobyte-0ec9fcbb-8a38-4d22-b1f4-58626a1b5295" released by "_delete_snapshot" :: held 4.257s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 20:04:58 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-e2223430-ce82-451b-bfcc-3def1180001b tempest-CreateVolumesFromSnapshotTest-1127395155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-a0c2aa04-4a57-4ecc-a977-55bf55843dae 1073741824" returned: 0 in 1.204s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:04:58 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-c584fc1f-e944-48fb-9dd0-59d125f7ec6f tempest-CinderUnicodeTest-1101475161 None] Lock "cinder-quobyte-757d373a-a944-4ace-8acb-8929b8f3ffc5" released by "delete_snapshot" :: held 4.291s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 20:04:58 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-e2223430-ce82-451b-bfcc-3def1180001b tempest-CreateVolumesFromSnapshotTest-1127395155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-a0c2aa04-4a57-4ecc-a977-55bf55843dae {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:04:58 devstack sudo[107039]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-a0c2aa04-4a57-4ecc-a977-55bf55843dae
Jul 02 20:04:58 devstack sudo[107039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:04:58 devstack cinder-volume[86639]: DEBUG cinder.quota [None req-c584fc1f-e944-48fb-9dd0-59d125f7ec6f tempest-CinderUnicodeTest-1101475161 None] Created reservations ['32d85ee6-84b8-400e-8997-6851320bc71e', '75ce6f1d-8e49-44a5-ba44-b90af8bf7964', '393d3e99-9df2-45c4-a270-95cc379f274b', 'bc03b2aa-e73b-4d4c-a5bc-522093bab0f4'] {{(pid=86639) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 20:04:58 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-c584fc1f-e944-48fb-9dd0-59d125f7ec6f tempest-CinderUnicodeTest-1101475161 None] Delete snapshot completed successfully.
Jul 02 20:04:58 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-c584fc1f-e944-48fb-9dd0-59d125f7ec6f tempest-CinderUnicodeTest-1101475161 None] Lock "cinder-0ec9fcbb-8a38-4d22-b1f4-58626a1b5295-delete_snapshot" released by "delete_snapshot" :: held 4.493s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 20:04:59 devstack sudo[107039]: pam_unix(sudo:session): session closed for user root
Jul 02 20:04:59 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-e2223430-ce82-451b-bfcc-3def1180001b tempest-CreateVolumesFromSnapshotTest-1127395155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-a0c2aa04-4a57-4ecc-a977-55bf55843dae" returned: 0 in 0.700s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:04:59 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-e2223430-ce82-451b-bfcc-3def1180001b tempest-CreateVolumesFromSnapshotTest-1127395155 None] <== create_volume: return (1967ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'} {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 20:04:59 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-e2223430-ce82-451b-bfcc-3def1180001b tempest-CreateVolumesFromSnapshotTest-1127395155 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.971s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 20:04:59 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-cb2f2657-cce7-4a87-8ebc-593ea64b9301 tempest-CreateVolumesFromSnapshotTest-1127395155 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.980s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 20:04:59 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-cb2f2657-cce7-4a87-8ebc-593ea64b9301 tempest-CreateVolumesFromSnapshotTest-1127395155 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce906cb830>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T18:04:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1244511030',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98fc0f7b-f3f8-4e97-83f7-d9e927fcf84d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfffcb664c3f4b49b07a3412c1642700',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T18:04:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T18:04:50Z,use_quota=True,user_id='ca1bd1389a844499a1f59dc320b608a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)}" {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 20:04:59 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-cb2f2657-cce7-4a87-8ebc-593ea64b9301 tempest-CreateVolumesFromSnapshotTest-1127395155 None] Creating volume 98fc0f7b-f3f8-4e97-83f7-d9e927fcf84d {{(pid=86639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 20:04:59 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-cb2f2657-cce7-4a87-8ebc-593ea64b9301 tempest-CreateVolumesFromSnapshotTest-1127395155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 20:04:59 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-cb2f2657-cce7-4a87-8ebc-593ea64b9301 tempest-CreateVolumesFromSnapshotTest-1127395155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 20:04:59 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-cb2f2657-cce7-4a87-8ebc-593ea64b9301 tempest-CreateVolumesFromSnapshotTest-1127395155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 20:04:59 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-cb2f2657-cce7-4a87-8ebc-593ea64b9301 tempest-CreateVolumesFromSnapshotTest-1127395155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 20:04:59 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-cb2f2657-cce7-4a87-8ebc-593ea64b9301 tempest-CreateVolumesFromSnapshotTest-1127395155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 20:04:59 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-cb2f2657-cce7-4a87-8ebc-593ea64b9301 tempest-CreateVolumesFromSnapshotTest-1127395155 None] Selected osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92 as target Quobyte volume. {{(pid=86639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 20:04:59 devstack cinder-volume[86639]: INFO cinder.volume.drivers.remotefs [None req-cb2f2657-cce7-4a87-8ebc-593ea64b9301 tempest-CreateVolumesFromSnapshotTest-1127395155 None] casted to osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92
Jul 02 20:04:59 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-cb2f2657-cce7-4a87-8ebc-593ea64b9301 tempest-CreateVolumesFromSnapshotTest-1127395155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-98fc0f7b-f3f8-4e97-83f7-d9e927fcf84d 1073741824 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:04:59 devstack sudo[107042]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-98fc0f7b-f3f8-4e97-83f7-d9e927fcf84d 1073741824
Jul 02 20:04:59 devstack sudo[107042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:04:59 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-e2223430-ce82-451b-bfcc-3def1180001b tempest-CreateVolumesFromSnapshotTest-1127395155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f270f45-c83b-48d7-89c3-ed25f795e30f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a0c2aa04-4a57-4ecc-a977-55bf55843dae', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:04:59 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-e2223430-ce82-451b-bfcc-3def1180001b tempest-CreateVolumesFromSnapshotTest-1127395155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (234ce99a-a542-4cb1-9bde-bf8a1ccb8000) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:04:59 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-e2223430-ce82-451b-bfcc-3def1180001b tempest-CreateVolumesFromSnapshotTest-1127395155 None] Volume volume-a0c2aa04-4a57-4ecc-a977-55bf55843dae (a0c2aa04-4a57-4ecc-a977-55bf55843dae): created successfully
Jul 02 20:04:59 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-e2223430-ce82-451b-bfcc-3def1180001b tempest-CreateVolumesFromSnapshotTest-1127395155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (234ce99a-a542-4cb1-9bde-bf8a1ccb8000) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:04:59 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-e2223430-ce82-451b-bfcc-3def1180001b tempest-CreateVolumesFromSnapshotTest-1127395155 None] Flow 'volume_create_manager' (846c85b0-b284-4cf5-b9c1-c3b24975c824) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 20:04:59 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-e2223430-ce82-451b-bfcc-3def1180001b tempest-CreateVolumesFromSnapshotTest-1127395155 None] Created volume successfully.
Jul 02 20:04:59 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-e80f7117-3466-471f-a8ba-2f326a79ba3f tempest-CinderUnicodeTest-1101475161 None] Acquiring lock "cinder-757d373a-a944-4ace-8acb-8929b8f3ffc5-delete_volume" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 20:04:59 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-e80f7117-3466-471f-a8ba-2f326a79ba3f tempest-CinderUnicodeTest-1101475161 None] Lock "cinder-757d373a-a944-4ace-8acb-8929b8f3ffc5-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 20:04:59 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-e80f7117-3466-471f-a8ba-2f326a79ba3f tempest-CinderUnicodeTest-1101475161 None] Acquiring lock "cinder-quobyte-757d373a-a944-4ace-8acb-8929b8f3ffc5" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 20:04:59 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-e80f7117-3466-471f-a8ba-2f326a79ba3f tempest-CinderUnicodeTest-1101475161 None] Lock "cinder-quobyte-757d373a-a944-4ace-8acb-8929b8f3ffc5" acquired by "delete_volume" :: waited 0.025s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 20:04:59 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5f7a758-47bc-4c86-91a7-2c3ada95f3ce]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 20:04:59 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-e80f7117-3466-471f-a8ba-2f326a79ba3f tempest-CinderUnicodeTest-1101475161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-757d373a-a944-4ace-8acb-8929b8f3ffc5 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:04:59 devstack sudo[107044]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-757d373a-a944-4ace-8acb-8929b8f3ffc5
Jul 02 20:04:59 devstack sudo[107044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:05:00 devstack sudo[107042]: pam_unix(sudo:session): session closed for user root
Jul 02 20:05:00 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-cb2f2657-cce7-4a87-8ebc-593ea64b9301 tempest-CreateVolumesFromSnapshotTest-1127395155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-98fc0f7b-f3f8-4e97-83f7-d9e927fcf84d 1073741824" returned: 0 in 1.069s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:05:00 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-cb2f2657-cce7-4a87-8ebc-593ea64b9301 tempest-CreateVolumesFromSnapshotTest-1127395155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-98fc0f7b-f3f8-4e97-83f7-d9e927fcf84d {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:05:00 devstack sudo[107052]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-98fc0f7b-f3f8-4e97-83f7-d9e927fcf84d
Jul 02 20:05:00 devstack sudo[107052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:05:00 devstack sudo[107044]: pam_unix(sudo:session): session closed for user root
Jul 02 20:05:00 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-e80f7117-3466-471f-a8ba-2f326a79ba3f tempest-CinderUnicodeTest-1101475161 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-757d373a-a944-4ace-8acb-8929b8f3ffc5" returned: 0 in 0.880s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:05:00 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-e80f7117-3466-471f-a8ba-2f326a79ba3f tempest-CinderUnicodeTest-1101475161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-757d373a-a944-4ace-8acb-8929b8f3ffc5 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:05:00 devstack sudo[107055]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-757d373a-a944-4ace-8acb-8929b8f3ffc5
Jul 02 20:05:00 devstack sudo[107055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:05:01 devstack sudo[107052]: pam_unix(sudo:session): session closed for user root
Jul 02 20:05:01 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-cb2f2657-cce7-4a87-8ebc-593ea64b9301 tempest-CreateVolumesFromSnapshotTest-1127395155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-98fc0f7b-f3f8-4e97-83f7-d9e927fcf84d" returned: 0 in 0.788s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:05:01 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-cb2f2657-cce7-4a87-8ebc-593ea64b9301 tempest-CreateVolumesFromSnapshotTest-1127395155 None] <== create_volume: return (1926ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'} {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 20:05:01 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-cb2f2657-cce7-4a87-8ebc-593ea64b9301 tempest-CreateVolumesFromSnapshotTest-1127395155 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.930s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 20:05:01 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-84b8975c-4084-41a1-9d63-5055e1f29c9d tempest-CreateVolumesFromSnapshotTest-1127395155 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.601s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 20:05:01 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-84b8975c-4084-41a1-9d63-5055e1f29c9d tempest-CreateVolumesFromSnapshotTest-1127395155 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce906cb830>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T18:04:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1221147574',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e293c981-d5d0-49ee-9bcd-9f8f958cbeef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfffcb664c3f4b49b07a3412c1642700',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T18:04:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T18:04:51Z,use_quota=True,user_id='ca1bd1389a844499a1f59dc320b608a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)}" {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 20:05:01 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-84b8975c-4084-41a1-9d63-5055e1f29c9d tempest-CreateVolumesFromSnapshotTest-1127395155 None] Creating volume e293c981-d5d0-49ee-9bcd-9f8f958cbeef {{(pid=86639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 20:05:01 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-84b8975c-4084-41a1-9d63-5055e1f29c9d tempest-CreateVolumesFromSnapshotTest-1127395155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 20:05:01 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-84b8975c-4084-41a1-9d63-5055e1f29c9d tempest-CreateVolumesFromSnapshotTest-1127395155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 20:05:01 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-84b8975c-4084-41a1-9d63-5055e1f29c9d tempest-CreateVolumesFromSnapshotTest-1127395155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 20:05:01 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-84b8975c-4084-41a1-9d63-5055e1f29c9d tempest-CreateVolumesFromSnapshotTest-1127395155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 20:05:01 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-84b8975c-4084-41a1-9d63-5055e1f29c9d tempest-CreateVolumesFromSnapshotTest-1127395155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 20:05:01 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-84b8975c-4084-41a1-9d63-5055e1f29c9d tempest-CreateVolumesFromSnapshotTest-1127395155 None] Selected osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92 as target Quobyte volume. {{(pid=86639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 20:05:01 devstack cinder-volume[86639]: INFO cinder.volume.drivers.remotefs [None req-84b8975c-4084-41a1-9d63-5055e1f29c9d tempest-CreateVolumesFromSnapshotTest-1127395155 None] casted to osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92
Jul 02 20:05:01 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-84b8975c-4084-41a1-9d63-5055e1f29c9d tempest-CreateVolumesFromSnapshotTest-1127395155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-e293c981-d5d0-49ee-9bcd-9f8f958cbeef 1073741824 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:05:01 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-cb2f2657-cce7-4a87-8ebc-593ea64b9301 tempest-CreateVolumesFromSnapshotTest-1127395155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cae99b25-e153-4f46-a3ea-56d5ce999964) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-98fc0f7b-f3f8-4e97-83f7-d9e927fcf84d', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:05:01 devstack sudo[107062]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-e293c981-d5d0-49ee-9bcd-9f8f958cbeef 1073741824
Jul 02 20:05:01 devstack sudo[107062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:05:01 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-cb2f2657-cce7-4a87-8ebc-593ea64b9301 tempest-CreateVolumesFromSnapshotTest-1127395155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a9d01b0-fc25-4ee1-a5d5-fbbce4932563) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:05:01 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-cb2f2657-cce7-4a87-8ebc-593ea64b9301 tempest-CreateVolumesFromSnapshotTest-1127395155 None] Volume volume-98fc0f7b-f3f8-4e97-83f7-d9e927fcf84d (98fc0f7b-f3f8-4e97-83f7-d9e927fcf84d): created successfully
Jul 02 20:05:01 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-cb2f2657-cce7-4a87-8ebc-593ea64b9301 tempest-CreateVolumesFromSnapshotTest-1127395155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a9d01b0-fc25-4ee1-a5d5-fbbce4932563) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:05:01 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-cb2f2657-cce7-4a87-8ebc-593ea64b9301 tempest-CreateVolumesFromSnapshotTest-1127395155 None] Flow 'volume_create_manager' (663aeb18-aeb4-4257-994b-033d01177b02) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 20:05:01 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-cb2f2657-cce7-4a87-8ebc-593ea64b9301 tempest-CreateVolumesFromSnapshotTest-1127395155 None] Created volume successfully.
Jul 02 20:05:01 devstack sudo[107055]: pam_unix(sudo:session): session closed for user root
Jul 02 20:05:01 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-e80f7117-3466-471f-a8ba-2f326a79ba3f tempest-CinderUnicodeTest-1101475161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-757d373a-a944-4ace-8acb-8929b8f3ffc5" returned: 0 in 0.802s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:05:01 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-e80f7117-3466-471f-a8ba-2f326a79ba3f tempest-CinderUnicodeTest-1101475161 None] Lock "cinder-quobyte-757d373a-a944-4ace-8acb-8929b8f3ffc5" released by "delete_volume" :: held 1.771s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 20:05:01 devstack cinder-volume[86639]: DEBUG cinder.quota [None req-e80f7117-3466-471f-a8ba-2f326a79ba3f tempest-CinderUnicodeTest-1101475161 None] Created reservations ['3a907b0b-2774-4cb0-8e81-7fb07b6e210e', 'c8b40177-bfd8-4c75-bb37-d9bf7212c726', '98d9ab82-cf16-4000-b720-c8a58a18656d', 'b43bc0b7-c4e5-4bad-a1e9-505794df0f2d'] {{(pid=86639) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 20:05:01 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-e80f7117-3466-471f-a8ba-2f326a79ba3f tempest-CinderUnicodeTest-1101475161 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 20:05:01 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-e80f7117-3466-471f-a8ba-2f326a79ba3f tempest-CinderUnicodeTest-1101475161 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 20:05:01 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-e80f7117-3466-471f-a8ba-2f326a79ba3f tempest-CinderUnicodeTest-1101475161 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 20:05:01 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-e80f7117-3466-471f-a8ba-2f326a79ba3f tempest-CinderUnicodeTest-1101475161 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 20:05:01 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-e80f7117-3466-471f-a8ba-2f326a79ba3f tempest-CinderUnicodeTest-1101475161 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 20:05:01 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-e80f7117-3466-471f-a8ba-2f326a79ba3f tempest-CinderUnicodeTest-1101475161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:05:01 devstack sudo[107064]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e
Jul 02 20:05:01 devstack sudo[107064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:05:02 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-0a0ac4ff-9da3-4bac-8292-c86c8d842dff tempest-CinderUnicodeTest-1101475161 None] Acquiring lock "cinder-34ec6bc0-000f-4c69-b004-41e91e29566a-delete_volume" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 20:05:02 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-0a0ac4ff-9da3-4bac-8292-c86c8d842dff tempest-CinderUnicodeTest-1101475161 None] Lock "cinder-34ec6bc0-000f-4c69-b004-41e91e29566a-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 20:05:02 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-0a0ac4ff-9da3-4bac-8292-c86c8d842dff tempest-CinderUnicodeTest-1101475161 None] Acquiring lock "cinder-quobyte-34ec6bc0-000f-4c69-b004-41e91e29566a" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 20:05:02 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-0a0ac4ff-9da3-4bac-8292-c86c8d842dff tempest-CinderUnicodeTest-1101475161 None] Lock "cinder-quobyte-34ec6bc0-000f-4c69-b004-41e91e29566a" acquired by "delete_volume" :: waited 0.026s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 20:05:02 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[88bba3cb-58cc-4a54-8df0-52cb0ca80d1c]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 20:05:02 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-0a0ac4ff-9da3-4bac-8292-c86c8d842dff tempest-CinderUnicodeTest-1101475161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-34ec6bc0-000f-4c69-b004-41e91e29566a {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:05:02 devstack sudo[107069]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-34ec6bc0-000f-4c69-b004-41e91e29566a
Jul 02 20:05:02 devstack sudo[107069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:05:02 devstack sudo[107062]: pam_unix(sudo:session): session closed for user root
Jul 02 20:05:02 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-84b8975c-4084-41a1-9d63-5055e1f29c9d tempest-CreateVolumesFromSnapshotTest-1127395155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-e293c981-d5d0-49ee-9bcd-9f8f958cbeef 1073741824" returned: 0 in 1.059s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:05:02 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-84b8975c-4084-41a1-9d63-5055e1f29c9d tempest-CreateVolumesFromSnapshotTest-1127395155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-e293c981-d5d0-49ee-9bcd-9f8f958cbeef {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:05:02 devstack sudo[107073]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-e293c981-d5d0-49ee-9bcd-9f8f958cbeef
Jul 02 20:05:02 devstack sudo[107073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:05:02 devstack sudo[107064]: pam_unix(sudo:session): session closed for user root
Jul 02 20:05:02 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-e80f7117-3466-471f-a8ba-2f326a79ba3f tempest-CinderUnicodeTest-1101475161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e" returned: 0 in 0.902s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:05:02 devstack cinder-volume[86639]: DEBUG cinder.manager [None req-e80f7117-3466-471f-a8ba-2f326a79ba3f tempest-CinderUnicodeTest-1101475161 None] Notifying Schedulers of capabilities ... {{(pid=86639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 20:05:02 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-e80f7117-3466-471f-a8ba-2f326a79ba3f tempest-CinderUnicodeTest-1101475161 None] Deleted volume successfully.
Jul 02 20:05:02 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-e80f7117-3466-471f-a8ba-2f326a79ba3f tempest-CinderUnicodeTest-1101475161 None] Lock "cinder-757d373a-a944-4ace-8acb-8929b8f3ffc5-delete_volume" released by "delete_volume" :: held 2.973s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 20:05:02 devstack cinder-volume[86639]: DEBUG cinder.volume.flows.manager.create_volume [None req-771e95f0-d136-4b66-86f0-bfcd1de47e74 tempest-VolumeImageDependencyTests-1452431683 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 20:05:02 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-771e95f0-d136-4b66-86f0-bfcd1de47e74 tempest-VolumeImageDependencyTests-1452431683 None] Flow 'volume_create_manager' (f2f5ba2f-d4ac-4c76-8bff-f0f46ff85a8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 20:05:02 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-771e95f0-d136-4b66-86f0-bfcd1de47e74 tempest-VolumeImageDependencyTests-1452431683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10d1ed2b-7fe7-46b1-bf87-6aa1e9686ba2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:05:02 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-771e95f0-d136-4b66-86f0-bfcd1de47e74 tempest-VolumeImageDependencyTests-1452431683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10d1ed2b-7fe7-46b1-bf87-6aa1e9686ba2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T18:05:02Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c945ed08-dc6d-4ee3-a3e3-935325ce22f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62d82d7e98624985aa12acf1bf898293',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T18:05:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T18:05:03Z,use_quota=True,user_id='4acbd19e898a4f288abf479d2981c127',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:05:02 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-771e95f0-d136-4b66-86f0-bfcd1de47e74 tempest-VolumeImageDependencyTests-1452431683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db76b477-d614-4239-be9a-326ac2bdbbb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:05:02 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-771e95f0-d136-4b66-86f0-bfcd1de47e74 tempest-VolumeImageDependencyTests-1452431683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db76b477-d614-4239-be9a-326ac2bdbbb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:05:02 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-771e95f0-d136-4b66-86f0-bfcd1de47e74 tempest-VolumeImageDependencyTests-1452431683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (901afdf1-2a20-43c9-a484-ad7b09b7f1c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:05:02 devstack cinder-volume[86639]: DEBUG cinder.image.glance [None req-771e95f0-d136-4b66-86f0-bfcd1de47e74 tempest-VolumeImageDependencyTests-1452431683 None] Creating Keystone auth plugin from conf {{(pid=86639) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jul 02 20:05:03 devstack sudo[107069]: pam_unix(sudo:session): session closed for user root
Jul 02 20:05:03 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-0a0ac4ff-9da3-4bac-8292-c86c8d842dff tempest-CinderUnicodeTest-1101475161 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-34ec6bc0-000f-4c69-b004-41e91e29566a" returned: 0 in 1.005s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:05:03 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-0a0ac4ff-9da3-4bac-8292-c86c8d842dff tempest-CinderUnicodeTest-1101475161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-34ec6bc0-000f-4c69-b004-41e91e29566a {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:05:03 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-771e95f0-d136-4b66-86f0-bfcd1de47e74 tempest-VolumeImageDependencyTests-1452431683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (901afdf1-2a20-43c9-a484-ad7b09b7f1c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c945ed08-dc6d-4ee3-a3e3-935325ce22f5', 'volume_name': 'volume-c945ed08-dc6d-4ee3-a3e3-935325ce22f5', 'volume_size': 1, 'image_id': 'f71d6505-83be-4a8b-8c87-2961243ff32a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f71d6505-83be-4a8b-8c87-2961243ff32a', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ceb679f2d519f5e27c9bce3d31d5b72e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '62d82d7e98624985aa12acf1bf898293', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '7465f8f83e57762c7253c4b1f0de55bd2dcc48183ff3cc6fef8c91bc3b5fb93d93c8d04f6fc68227755e2b974b76e3cac137992635c425f65daf6402a16629d3', 'id': 'f71d6505-83be-4a8b-8c87-2961243ff32a', 'created_at': datetime.datetime(2026, 7, 2, 18, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 2, 18, 5, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f71d6505-83be-4a8b-8c87-2961243ff32a/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fce84bd34a0>}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:05:03 devstack sudo[107078]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-34ec6bc0-000f-4c69-b004-41e91e29566a
Jul 02 20:05:03 devstack sudo[107078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:05:03 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-771e95f0-d136-4b66-86f0-bfcd1de47e74 tempest-VolumeImageDependencyTests-1452431683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90e2ae88-f3e1-401a-81ee-7f303ae52007) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:05:03 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-771e95f0-d136-4b66-86f0-bfcd1de47e74 tempest-VolumeImageDependencyTests-1452431683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90e2ae88-f3e1-401a-81ee-7f303ae52007) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:05:03 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-771e95f0-d136-4b66-86f0-bfcd1de47e74 tempest-VolumeImageDependencyTests-1452431683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10005dbf-dc43-4724-8239-80d21e9152b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:05:03 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-771e95f0-d136-4b66-86f0-bfcd1de47e74 tempest-VolumeImageDependencyTests-1452431683 None] Volume c945ed08-dc6d-4ee3-a3e3-935325ce22f5: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c945ed08-dc6d-4ee3-a3e3-935325ce22f5', 'volume_size': 1, 'image_id': 'f71d6505-83be-4a8b-8c87-2961243ff32a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f71d6505-83be-4a8b-8c87-2961243ff32a', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ceb679f2d519f5e27c9bce3d31d5b72e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '62d82d7e98624985aa12acf1bf898293', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '7465f8f83e57762c7253c4b1f0de55bd2dcc48183ff3cc6fef8c91bc3b5fb93d93c8d04f6fc68227755e2b974b76e3cac137992635c425f65daf6402a16629d3', 'id': 'f71d6505-83be-4a8b-8c87-2961243ff32a', 'created_at': datetime.datetime(2026, 7, 2, 18, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 2, 18, 5, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f71d6505-83be-4a8b-8c87-2961243ff32a/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fce84bd34a0>}
Jul 02 20:05:03 devstack cinder-volume[86639]: DEBUG cinder.volume.flows.manager.create_volume [None req-771e95f0-d136-4b66-86f0-bfcd1de47e74 tempest-VolumeImageDependencyTests-1452431683 None] Trying to clone c945ed08-dc6d-4ee3-a3e3-935325ce22f5 from image f71d6505-83be-4a8b-8c87-2961243ff32a at location (None, [{'url': 'file:///opt/stack/data/glance/images/f71d6505-83be-4a8b-8c87-2961243ff32a', 'metadata': {}}]). {{(pid=86639) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jul 02 20:05:03 devstack cinder-volume[86639]: DEBUG cinder.image.image_utils [None req-771e95f0-d136-4b66-86f0-bfcd1de47e74 tempest-VolumeImageDependencyTests-1452431683 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_f71d6505-83be-4a8b-8c87-2961243ff32a_ny73sfxldevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86639) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jul 02 20:05:03 devstack cinder-volume[86639]: INFO cinder.image.image_utils [None req-771e95f0-d136-4b66-86f0-bfcd1de47e74 tempest-VolumeImageDependencyTests-1452431683 None] Image download 0.00 MB at 0.00 MB/s
Jul 02 20:05:03 devstack sudo[107073]: pam_unix(sudo:session): session closed for user root
Jul 02 20:05:03 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-84b8975c-4084-41a1-9d63-5055e1f29c9d tempest-CreateVolumesFromSnapshotTest-1127395155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-e293c981-d5d0-49ee-9bcd-9f8f958cbeef" returned: 0 in 0.847s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:05:03 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-84b8975c-4084-41a1-9d63-5055e1f29c9d tempest-CreateVolumesFromSnapshotTest-1127395155 None] <== create_volume: return (1963ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'} {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 20:05:03 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-84b8975c-4084-41a1-9d63-5055e1f29c9d tempest-CreateVolumesFromSnapshotTest-1127395155 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.967s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 20:05:03 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-2cea91d7-b488-4aff-bb3e-369a8fbf70e6 tempest-VolumeDependencyTests-1189288576 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.269s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 20:05:03 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-2cea91d7-b488-4aff-bb3e-369a8fbf70e6 tempest-VolumeDependencyTests-1189288576 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce906cb830>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T18:04:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-910613532',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ca68623-8e69-48d9-b453-cd62b2c53823,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6331398c26f5430ab6745cced81e28e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T18:04:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T18:04:57Z,use_quota=True,user_id='655530ba13194b4997735df3696865f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)}" {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 20:05:03 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-2cea91d7-b488-4aff-bb3e-369a8fbf70e6 tempest-VolumeDependencyTests-1189288576 None] Creating volume 7ca68623-8e69-48d9-b453-cd62b2c53823 {{(pid=86639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 20:05:03 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-2cea91d7-b488-4aff-bb3e-369a8fbf70e6 tempest-VolumeDependencyTests-1189288576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 20:05:03 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-2cea91d7-b488-4aff-bb3e-369a8fbf70e6 tempest-VolumeDependencyTests-1189288576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 20:05:03 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-2cea91d7-b488-4aff-bb3e-369a8fbf70e6 tempest-VolumeDependencyTests-1189288576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 20:05:03 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-2cea91d7-b488-4aff-bb3e-369a8fbf70e6 tempest-VolumeDependencyTests-1189288576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 20:05:03 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-2cea91d7-b488-4aff-bb3e-369a8fbf70e6 tempest-VolumeDependencyTests-1189288576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 20:05:03 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-2cea91d7-b488-4aff-bb3e-369a8fbf70e6 tempest-VolumeDependencyTests-1189288576 None] Selected osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92 as target Quobyte volume. {{(pid=86639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 20:05:03 devstack cinder-volume[86639]: INFO cinder.volume.drivers.remotefs [None req-2cea91d7-b488-4aff-bb3e-369a8fbf70e6 tempest-VolumeDependencyTests-1189288576 None] casted to osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92
Jul 02 20:05:03 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-2cea91d7-b488-4aff-bb3e-369a8fbf70e6 tempest-VolumeDependencyTests-1189288576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-7ca68623-8e69-48d9-b453-cd62b2c53823 1073741824 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:05:03 devstack sudo[107081]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-7ca68623-8e69-48d9-b453-cd62b2c53823 1073741824
Jul 02 20:05:03 devstack sudo[107081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:05:03 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-84b8975c-4084-41a1-9d63-5055e1f29c9d tempest-CreateVolumesFromSnapshotTest-1127395155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7808539-f950-4f65-b217-953f108da413) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e293c981-d5d0-49ee-9bcd-9f8f958cbeef', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:05:03 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-84b8975c-4084-41a1-9d63-5055e1f29c9d tempest-CreateVolumesFromSnapshotTest-1127395155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69734f22-c98a-4156-bffd-ff6da0da5bb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:05:03 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[adb59169-3062-4041-ab49-bdd4bff6d464]: (4, 'raw') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 20:05:03 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-771e95f0-d136-4b66-86f0-bfcd1de47e74 tempest-VolumeImageDependencyTests-1452431683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f71d6505-83be-4a8b-8c87-2961243ff32a_ny73sfxldevstack@QuobyteHD {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:05:03 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-84b8975c-4084-41a1-9d63-5055e1f29c9d tempest-CreateVolumesFromSnapshotTest-1127395155 None] Volume volume-e293c981-d5d0-49ee-9bcd-9f8f958cbeef (e293c981-d5d0-49ee-9bcd-9f8f958cbeef): created successfully
Jul 02 20:05:03 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-84b8975c-4084-41a1-9d63-5055e1f29c9d tempest-CreateVolumesFromSnapshotTest-1127395155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69734f22-c98a-4156-bffd-ff6da0da5bb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:05:03 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-84b8975c-4084-41a1-9d63-5055e1f29c9d tempest-CreateVolumesFromSnapshotTest-1127395155 None] Flow 'volume_create_manager' (d82209cb-8307-4a65-a7c8-6cccf02d5a50) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 20:05:03 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-84b8975c-4084-41a1-9d63-5055e1f29c9d tempest-CreateVolumesFromSnapshotTest-1127395155 None] Created volume successfully.
Jul 02 20:05:03 devstack sudo[107083]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f71d6505-83be-4a8b-8c87-2961243ff32a_ny73sfxldevstack@QuobyteHD
Jul 02 20:05:03 devstack sudo[107083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:05:03 devstack sudo[107078]: pam_unix(sudo:session): session closed for user root
Jul 02 20:05:03 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-0a0ac4ff-9da3-4bac-8292-c86c8d842dff tempest-CinderUnicodeTest-1101475161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-34ec6bc0-000f-4c69-b004-41e91e29566a" returned: 0 in 0.768s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:05:03 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-0a0ac4ff-9da3-4bac-8292-c86c8d842dff tempest-CinderUnicodeTest-1101475161 None] Lock "cinder-quobyte-34ec6bc0-000f-4c69-b004-41e91e29566a" released by "delete_volume" :: held 1.822s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 20:05:04 devstack cinder-volume[86639]: DEBUG cinder.quota [None req-0a0ac4ff-9da3-4bac-8292-c86c8d842dff tempest-CinderUnicodeTest-1101475161 None] Created reservations ['529d313a-a5b1-4e50-bbb3-74522ff9e8eb', 'ede7315f-09fa-42a4-bf55-de119d795558', 'c4f85d88-e7f6-4e16-96bc-14739bae2e5f', 'ebfcaecb-db02-4a0d-b553-787c7bd36b2d'] {{(pid=86639) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 20:05:04 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-b5c3b504-7d0b-4179-ad95-8bf0ccf61598 tempest-CreateVolumesFromSnapshotTest-1127395155 None] Acquiring lock "cinder-e293c981-d5d0-49ee-9bcd-9f8f958cbeef-delete_volume" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 20:05:04 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-b5c3b504-7d0b-4179-ad95-8bf0ccf61598 tempest-CreateVolumesFromSnapshotTest-1127395155 None] Lock "cinder-e293c981-d5d0-49ee-9bcd-9f8f958cbeef-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 20:05:04 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-0a0ac4ff-9da3-4bac-8292-c86c8d842dff tempest-CinderUnicodeTest-1101475161 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 20:05:04 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-0a0ac4ff-9da3-4bac-8292-c86c8d842dff tempest-CinderUnicodeTest-1101475161 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 20:05:04 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-0a0ac4ff-9da3-4bac-8292-c86c8d842dff tempest-CinderUnicodeTest-1101475161 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 20:05:04 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-0a0ac4ff-9da3-4bac-8292-c86c8d842dff tempest-CinderUnicodeTest-1101475161 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 20:05:04 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-0a0ac4ff-9da3-4bac-8292-c86c8d842dff tempest-CinderUnicodeTest-1101475161 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 20:05:04 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-0a0ac4ff-9da3-4bac-8292-c86c8d842dff tempest-CinderUnicodeTest-1101475161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:05:04 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-b5c3b504-7d0b-4179-ad95-8bf0ccf61598 tempest-CreateVolumesFromSnapshotTest-1127395155 None] Acquiring lock "cinder-quobyte-e293c981-d5d0-49ee-9bcd-9f8f958cbeef" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 20:05:04 devstack sudo[107090]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e
Jul 02 20:05:04 devstack sudo[107090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:05:04 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-b5c3b504-7d0b-4179-ad95-8bf0ccf61598 tempest-CreateVolumesFromSnapshotTest-1127395155 None] Lock "cinder-quobyte-e293c981-d5d0-49ee-9bcd-9f8f958cbeef" acquired by "delete_volume" :: waited 0.023s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 20:05:04 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2948d07-c316-4bab-80ae-8cde8e2343e1]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 20:05:04 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-b5c3b504-7d0b-4179-ad95-8bf0ccf61598 tempest-CreateVolumesFromSnapshotTest-1127395155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-e293c981-d5d0-49ee-9bcd-9f8f958cbeef {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:05:04 devstack sudo[107095]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-e293c981-d5d0-49ee-9bcd-9f8f958cbeef
Jul 02 20:05:04 devstack sudo[107095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:05:04 devstack sudo[107083]: pam_unix(sudo:session): session closed for user root
Jul 02 20:05:04 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-771e95f0-d136-4b66-86f0-bfcd1de47e74 tempest-VolumeImageDependencyTests-1452431683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f71d6505-83be-4a8b-8c87-2961243ff32a_ny73sfxldevstack@QuobyteHD" returned: 0 in 0.962s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:05:04 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-771e95f0-d136-4b66-86f0-bfcd1de47e74 tempest-VolumeImageDependencyTests-1452431683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f71d6505-83be-4a8b-8c87-2961243ff32a_ny73sfxldevstack@QuobyteHD {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:05:04 devstack sudo[107097]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f71d6505-83be-4a8b-8c87-2961243ff32a_ny73sfxldevstack@QuobyteHD
Jul 02 20:05:04 devstack sudo[107097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:05:04 devstack sudo[107081]: pam_unix(sudo:session): session closed for user root
Jul 02 20:05:04 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-2cea91d7-b488-4aff-bb3e-369a8fbf70e6 tempest-VolumeDependencyTests-1189288576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-7ca68623-8e69-48d9-b453-cd62b2c53823 1073741824" returned: 0 in 1.209s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:05:04 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-2cea91d7-b488-4aff-bb3e-369a8fbf70e6 tempest-VolumeDependencyTests-1189288576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-7ca68623-8e69-48d9-b453-cd62b2c53823 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:05:04 devstack sudo[107099]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-7ca68623-8e69-48d9-b453-cd62b2c53823
Jul 02 20:05:04 devstack sudo[107099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:05:05 devstack sudo[107090]: pam_unix(sudo:session): session closed for user root
Jul 02 20:05:05 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-0a0ac4ff-9da3-4bac-8292-c86c8d842dff tempest-CinderUnicodeTest-1101475161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e" returned: 0 in 0.951s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:05:05 devstack cinder-volume[86639]: DEBUG cinder.manager [None req-0a0ac4ff-9da3-4bac-8292-c86c8d842dff tempest-CinderUnicodeTest-1101475161 None] Notifying Schedulers of capabilities ... {{(pid=86639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 20:05:05 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-0a0ac4ff-9da3-4bac-8292-c86c8d842dff tempest-CinderUnicodeTest-1101475161 None] Deleted volume successfully.
Jul 02 20:05:05 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-0a0ac4ff-9da3-4bac-8292-c86c8d842dff tempest-CinderUnicodeTest-1101475161 None] Lock "cinder-34ec6bc0-000f-4c69-b004-41e91e29566a-delete_volume" released by "delete_volume" :: held 3.119s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 20:05:05 devstack sudo[107097]: pam_unix(sudo:session): session closed for user root
Jul 02 20:05:05 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-771e95f0-d136-4b66-86f0-bfcd1de47e74 tempest-VolumeImageDependencyTests-1452431683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f71d6505-83be-4a8b-8c87-2961243ff32a_ny73sfxldevstack@QuobyteHD" returned: 1 in 0.993s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:05:05 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-771e95f0-d136-4b66-86f0-bfcd1de47e74 tempest-VolumeImageDependencyTests-1452431683 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f71d6505-83be-4a8b-8c87-2961243ff32a_ny73sfxldevstack@QuobyteHD' failed. Not Retrying. {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 02 20:05:05 devstack cinder-volume[86639]: DEBUG cinder.image.image_utils [None req-771e95f0-d136-4b66-86f0-bfcd1de47e74 tempest-VolumeImageDependencyTests-1452431683 None] Temporary image f71d6505-83be-4a8b-8c87-2961243ff32a is fetched for user 4acbd19e898a4f288abf479d2981c127. {{(pid=86639) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jul 02 20:05:05 devstack sudo[107095]: pam_unix(sudo:session): session closed for user root
Jul 02 20:05:05 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-b5c3b504-7d0b-4179-ad95-8bf0ccf61598 tempest-CreateVolumesFromSnapshotTest-1127395155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-e293c981-d5d0-49ee-9bcd-9f8f958cbeef" returned: 0 in 1.218s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:05:05 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-b5c3b504-7d0b-4179-ad95-8bf0ccf61598 tempest-CreateVolumesFromSnapshotTest-1127395155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-e293c981-d5d0-49ee-9bcd-9f8f958cbeef {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:05:05 devstack sudo[107109]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-e293c981-d5d0-49ee-9bcd-9f8f958cbeef
Jul 02 20:05:05 devstack sudo[107109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:05:05 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cc352c4-0d97-42ff-bebe-e12178821a99]: (4, 'raw') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 20:05:05 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-771e95f0-d136-4b66-86f0-bfcd1de47e74 tempest-VolumeImageDependencyTests-1452431683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f71d6505-83be-4a8b-8c87-2961243ff32a_ny73sfxldevstack@QuobyteHD {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:05:05 devstack sudo[107099]: pam_unix(sudo:session): session closed for user root
Jul 02 20:05:05 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-2cea91d7-b488-4aff-bb3e-369a8fbf70e6 tempest-VolumeDependencyTests-1189288576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-7ca68623-8e69-48d9-b453-cd62b2c53823" returned: 0 in 0.946s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:05:05 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-2cea91d7-b488-4aff-bb3e-369a8fbf70e6 tempest-VolumeDependencyTests-1189288576 None] <== create_volume: return (2211ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'} {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 20:05:05 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-2cea91d7-b488-4aff-bb3e-369a8fbf70e6 tempest-VolumeDependencyTests-1189288576 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.214s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 20:05:05 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-2cea91d7-b488-4aff-bb3e-369a8fbf70e6 tempest-VolumeDependencyTests-1189288576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f797c9c1-f100-45ea-b966-c6a8b0734c77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ca68623-8e69-48d9-b453-cd62b2c53823', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:05:05 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-2cea91d7-b488-4aff-bb3e-369a8fbf70e6 tempest-VolumeDependencyTests-1189288576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b426469-aa19-44c9-a553-2e1beaa43615) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:05:05 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-2cea91d7-b488-4aff-bb3e-369a8fbf70e6 tempest-VolumeDependencyTests-1189288576 None] Volume volume-7ca68623-8e69-48d9-b453-cd62b2c53823 (7ca68623-8e69-48d9-b453-cd62b2c53823): created successfully
Jul 02 20:05:05 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-2cea91d7-b488-4aff-bb3e-369a8fbf70e6 tempest-VolumeDependencyTests-1189288576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b426469-aa19-44c9-a553-2e1beaa43615) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:05:05 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-2cea91d7-b488-4aff-bb3e-369a8fbf70e6 tempest-VolumeDependencyTests-1189288576 None] Flow 'volume_create_manager' (787ce6f1-b2ea-45a0-9743-6a0359a42776) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 20:05:05 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-2cea91d7-b488-4aff-bb3e-369a8fbf70e6 tempest-VolumeDependencyTests-1189288576 None] Created volume successfully.
Jul 02 20:05:05 devstack sudo[107111]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f71d6505-83be-4a8b-8c87-2961243ff32a_ny73sfxldevstack@QuobyteHD
Jul 02 20:05:05 devstack sudo[107111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:05:06 devstack sudo[107109]: pam_unix(sudo:session): session closed for user root
Jul 02 20:05:06 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-b5c3b504-7d0b-4179-ad95-8bf0ccf61598 tempest-CreateVolumesFromSnapshotTest-1127395155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-e293c981-d5d0-49ee-9bcd-9f8f958cbeef" returned: 0 in 0.810s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:05:06 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-b5c3b504-7d0b-4179-ad95-8bf0ccf61598 tempest-CreateVolumesFromSnapshotTest-1127395155 None] Lock "cinder-quobyte-e293c981-d5d0-49ee-9bcd-9f8f958cbeef" released by "delete_volume" :: held 2.092s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 20:05:06 devstack cinder-volume[86639]: DEBUG cinder.quota [None req-b5c3b504-7d0b-4179-ad95-8bf0ccf61598 tempest-CreateVolumesFromSnapshotTest-1127395155 None] Created reservations ['9a9d2bd0-ab29-4445-b281-e6a248f02540', 'ca40e7bd-b3c2-4acd-b705-e76d6dd8356c', 'e89a6b68-d2d5-458f-b417-918fd643c6ef', '4dbfd5df-a231-400a-8fab-6ac574939e1e'] {{(pid=86639) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 20:05:06 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-b5c3b504-7d0b-4179-ad95-8bf0ccf61598 tempest-CreateVolumesFromSnapshotTest-1127395155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 20:05:06 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-b5c3b504-7d0b-4179-ad95-8bf0ccf61598 tempest-CreateVolumesFromSnapshotTest-1127395155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 20:05:06 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-b5c3b504-7d0b-4179-ad95-8bf0ccf61598 tempest-CreateVolumesFromSnapshotTest-1127395155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 20:05:06 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-b5c3b504-7d0b-4179-ad95-8bf0ccf61598 tempest-CreateVolumesFromSnapshotTest-1127395155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 20:05:06 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-b5c3b504-7d0b-4179-ad95-8bf0ccf61598 tempest-CreateVolumesFromSnapshotTest-1127395155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 20:05:06 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-b5c3b504-7d0b-4179-ad95-8bf0ccf61598 tempest-CreateVolumesFromSnapshotTest-1127395155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:05:06 devstack sudo[107116]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e
Jul 02 20:05:06 devstack sudo[107116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:05:06 devstack sudo[107111]: pam_unix(sudo:session): session closed for user root
Jul 02 20:05:06 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-771e95f0-d136-4b66-86f0-bfcd1de47e74 tempest-VolumeImageDependencyTests-1452431683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f71d6505-83be-4a8b-8c87-2961243ff32a_ny73sfxldevstack@QuobyteHD" returned: 0 in 0.946s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:05:06 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-771e95f0-d136-4b66-86f0-bfcd1de47e74 tempest-VolumeImageDependencyTests-1452431683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f71d6505-83be-4a8b-8c87-2961243ff32a_ny73sfxldevstack@QuobyteHD {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:05:06 devstack sudo[107118]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f71d6505-83be-4a8b-8c87-2961243ff32a_ny73sfxldevstack@QuobyteHD
Jul 02 20:05:06 devstack sudo[107118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:05:07 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-a453d2e9-f19e-4a06-8300-e9294b79bfe5 tempest-VolumeDependencyTests-1189288576 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 20:05:07 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-a453d2e9-f19e-4a06-8300-e9294b79bfe5 tempest-VolumeDependencyTests-1189288576 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 20:05:07 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-a453d2e9-f19e-4a06-8300-e9294b79bfe5 tempest-VolumeDependencyTests-1189288576 None] Creating offline snapshot 06ebe9cf-3a4f-4ffa-9c31-a0b19099e6a4 of volume 7ca68623-8e69-48d9-b453-cd62b2c53823 {{(pid=86639) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 02 20:05:07 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[e98bf7a1-ffdb-4918-8cb6-a0e48bba6aa0]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 20:05:07 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-a453d2e9-f19e-4a06-8300-e9294b79bfe5 tempest-VolumeDependencyTests-1189288576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-7ca68623-8e69-48d9-b453-cd62b2c53823 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:05:07 devstack sudo[107120]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-7ca68623-8e69-48d9-b453-cd62b2c53823
Jul 02 20:05:07 devstack sudo[107120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:05:07 devstack sudo[107116]: pam_unix(sudo:session): session closed for user root
Jul 02 20:05:07 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-b5c3b504-7d0b-4179-ad95-8bf0ccf61598 tempest-CreateVolumesFromSnapshotTest-1127395155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e" returned: 0 in 0.879s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:05:07 devstack cinder-volume[86639]: DEBUG cinder.manager [None req-b5c3b504-7d0b-4179-ad95-8bf0ccf61598 tempest-CreateVolumesFromSnapshotTest-1127395155 None] Notifying Schedulers of capabilities ... {{(pid=86639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 20:05:07 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-b5c3b504-7d0b-4179-ad95-8bf0ccf61598 tempest-CreateVolumesFromSnapshotTest-1127395155 None] Deleted volume successfully.
Jul 02 20:05:07 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-b5c3b504-7d0b-4179-ad95-8bf0ccf61598 tempest-CreateVolumesFromSnapshotTest-1127395155 None] Lock "cinder-e293c981-d5d0-49ee-9bcd-9f8f958cbeef-delete_volume" released by "delete_volume" :: held 3.250s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 20:05:07 devstack sudo[107118]: pam_unix(sudo:session): session closed for user root
Jul 02 20:05:07 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-771e95f0-d136-4b66-86f0-bfcd1de47e74 tempest-VolumeImageDependencyTests-1452431683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f71d6505-83be-4a8b-8c87-2961243ff32a_ny73sfxldevstack@QuobyteHD" returned: 1 in 0.944s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:05:07 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-771e95f0-d136-4b66-86f0-bfcd1de47e74 tempest-VolumeImageDependencyTests-1452431683 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f71d6505-83be-4a8b-8c87-2961243ff32a_ny73sfxldevstack@QuobyteHD' failed. Not Retrying. {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 02 20:05:07 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-771e95f0-d136-4b66-86f0-bfcd1de47e74 tempest-VolumeImageDependencyTests-1452431683 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 20:05:07 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-be7bcaca-58bf-4ab3-8de0-dcf20df7ad28 tempest-CreateVolumesFromSnapshotTest-1127395155 None] Acquiring lock "cinder-98fc0f7b-f3f8-4e97-83f7-d9e927fcf84d-delete_volume" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 20:05:07 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-be7bcaca-58bf-4ab3-8de0-dcf20df7ad28 tempest-CreateVolumesFromSnapshotTest-1127395155 None] Lock "cinder-98fc0f7b-f3f8-4e97-83f7-d9e927fcf84d-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 20:05:07 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-be7bcaca-58bf-4ab3-8de0-dcf20df7ad28 tempest-CreateVolumesFromSnapshotTest-1127395155 None] Acquiring lock "cinder-quobyte-98fc0f7b-f3f8-4e97-83f7-d9e927fcf84d" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 20:05:07 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-be7bcaca-58bf-4ab3-8de0-dcf20df7ad28 tempest-CreateVolumesFromSnapshotTest-1127395155 None] Lock "cinder-quobyte-98fc0f7b-f3f8-4e97-83f7-d9e927fcf84d" acquired by "delete_volume" :: waited 0.019s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 20:05:07 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[a334d3ca-0b1d-4436-b6c7-72d67a275c36]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 20:05:07 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-be7bcaca-58bf-4ab3-8de0-dcf20df7ad28 tempest-CreateVolumesFromSnapshotTest-1127395155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-98fc0f7b-f3f8-4e97-83f7-d9e927fcf84d {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:05:07 devstack sudo[107126]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-98fc0f7b-f3f8-4e97-83f7-d9e927fcf84d
Jul 02 20:05:07 devstack sudo[107126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:05:08 devstack sudo[107120]: pam_unix(sudo:session): session closed for user root
Jul 02 20:05:08 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-a453d2e9-f19e-4a06-8300-e9294b79bfe5 tempest-VolumeDependencyTests-1189288576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-7ca68623-8e69-48d9-b453-cd62b2c53823" returned: 0 in 1.018s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:05:08 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-a453d2e9-f19e-4a06-8300-e9294b79bfe5 tempest-VolumeDependencyTests-1189288576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-7ca68623-8e69-48d9-b453-cd62b2c53823,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-7ca68623-8e69-48d9-b453-cd62b2c53823.06ebe9cf-3a4f-4ffa-9c31-a0b19099e6a4 1G {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:05:08 devstack sudo[107131]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-7ca68623-8e69-48d9-b453-cd62b2c53823,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-7ca68623-8e69-48d9-b453-cd62b2c53823.06ebe9cf-3a4f-4ffa-9c31-a0b19099e6a4 1G
Jul 02 20:05:08 devstack sudo[107131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:05:08 devstack sudo[107126]: pam_unix(sudo:session): session closed for user root
Jul 02 20:05:08 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-be7bcaca-58bf-4ab3-8de0-dcf20df7ad28 tempest-CreateVolumesFromSnapshotTest-1127395155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-98fc0f7b-f3f8-4e97-83f7-d9e927fcf84d" returned: 0 in 0.898s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:05:08 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-be7bcaca-58bf-4ab3-8de0-dcf20df7ad28 tempest-CreateVolumesFromSnapshotTest-1127395155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-98fc0f7b-f3f8-4e97-83f7-d9e927fcf84d {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:05:08 devstack sudo[107136]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-98fc0f7b-f3f8-4e97-83f7-d9e927fcf84d
Jul 02 20:05:08 devstack sudo[107136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:05:09 devstack sudo[107131]: pam_unix(sudo:session): session closed for user root
Jul 02 20:05:09 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-a453d2e9-f19e-4a06-8300-e9294b79bfe5 tempest-VolumeDependencyTests-1189288576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-7ca68623-8e69-48d9-b453-cd62b2c53823,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-7ca68623-8e69-48d9-b453-cd62b2c53823.06ebe9cf-3a4f-4ffa-9c31-a0b19099e6a4 1G" returned: 0 in 1.014s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:05:09 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-a453d2e9-f19e-4a06-8300-e9294b79bfe5 tempest-VolumeDependencyTests-1189288576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ca68623-8e69-48d9-b453-cd62b2c53823 -F qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-7ca68623-8e69-48d9-b453-cd62b2c53823.06ebe9cf-3a4f-4ffa-9c31-a0b19099e6a4 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:05:09 devstack sudo[107143]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ca68623-8e69-48d9-b453-cd62b2c53823 -F qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-7ca68623-8e69-48d9-b453-cd62b2c53823.06ebe9cf-3a4f-4ffa-9c31-a0b19099e6a4
Jul 02 20:05:09 devstack sudo[107143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:05:09 devstack sudo[107136]: pam_unix(sudo:session): session closed for user root
Jul 02 20:05:09 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-be7bcaca-58bf-4ab3-8de0-dcf20df7ad28 tempest-CreateVolumesFromSnapshotTest-1127395155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-98fc0f7b-f3f8-4e97-83f7-d9e927fcf84d" returned: 0 in 0.764s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:05:09 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-be7bcaca-58bf-4ab3-8de0-dcf20df7ad28 tempest-CreateVolumesFromSnapshotTest-1127395155 None] Lock "cinder-quobyte-98fc0f7b-f3f8-4e97-83f7-d9e927fcf84d" released by "delete_volume" :: held 1.711s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 20:05:09 devstack cinder-volume[86639]: DEBUG cinder.quota [None req-be7bcaca-58bf-4ab3-8de0-dcf20df7ad28 tempest-CreateVolumesFromSnapshotTest-1127395155 None] Created reservations ['e27d5fb3-93eb-49e0-b823-fe79d003dd63', '9e7d52fb-9a12-4ac0-a3c7-28ca9b81f314', 'c567d624-9c97-4c40-a1d7-aca9a7f578d9', 'ac3145ec-5903-4d41-a633-9dd52420757f'] {{(pid=86639) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 20:05:09 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-be7bcaca-58bf-4ab3-8de0-dcf20df7ad28 tempest-CreateVolumesFromSnapshotTest-1127395155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 20:05:09 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-be7bcaca-58bf-4ab3-8de0-dcf20df7ad28 tempest-CreateVolumesFromSnapshotTest-1127395155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 20:05:09 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-be7bcaca-58bf-4ab3-8de0-dcf20df7ad28 tempest-CreateVolumesFromSnapshotTest-1127395155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 20:05:09 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-be7bcaca-58bf-4ab3-8de0-dcf20df7ad28 tempest-CreateVolumesFromSnapshotTest-1127395155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 20:05:09 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-be7bcaca-58bf-4ab3-8de0-dcf20df7ad28 tempest-CreateVolumesFromSnapshotTest-1127395155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 20:05:09 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-be7bcaca-58bf-4ab3-8de0-dcf20df7ad28 tempest-CreateVolumesFromSnapshotTest-1127395155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:05:09 devstack sudo[107145]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e
Jul 02 20:05:09 devstack sudo[107145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:05:09 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-c2261cc4-6cfc-4a01-9443-ed45c313e816 tempest-CreateVolumesFromSnapshotTest-1127395155 None] Acquiring lock "cinder-a0c2aa04-4a57-4ecc-a977-55bf55843dae-delete_volume" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 20:05:09 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-c2261cc4-6cfc-4a01-9443-ed45c313e816 tempest-CreateVolumesFromSnapshotTest-1127395155 None] Lock "cinder-a0c2aa04-4a57-4ecc-a977-55bf55843dae-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 20:05:09 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-c2261cc4-6cfc-4a01-9443-ed45c313e816 tempest-CreateVolumesFromSnapshotTest-1127395155 None] Acquiring lock "cinder-quobyte-a0c2aa04-4a57-4ecc-a977-55bf55843dae" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 20:05:09 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-c2261cc4-6cfc-4a01-9443-ed45c313e816 tempest-CreateVolumesFromSnapshotTest-1127395155 None] Lock "cinder-quobyte-a0c2aa04-4a57-4ecc-a977-55bf55843dae" acquired by "delete_volume" :: waited 0.016s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 20:05:09 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[a23e3adf-6f92-4b9e-9545-8e9bc23abd05]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 20:05:09 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-c2261cc4-6cfc-4a01-9443-ed45c313e816 tempest-CreateVolumesFromSnapshotTest-1127395155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-a0c2aa04-4a57-4ecc-a977-55bf55843dae {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:05:10 devstack sudo[107143]: pam_unix(sudo:session): session closed for user root
Jul 02 20:05:10 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-a453d2e9-f19e-4a06-8300-e9294b79bfe5 tempest-VolumeDependencyTests-1189288576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ca68623-8e69-48d9-b453-cd62b2c53823 -F qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-7ca68623-8e69-48d9-b453-cd62b2c53823.06ebe9cf-3a4f-4ffa-9c31-a0b19099e6a4" returned: 0 in 0.910s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:05:10 devstack cinder-volume[86639]: WARNING cinder.volume.drivers.remotefs [None req-a453d2e9-f19e-4a06-8300-e9294b79bfe5 tempest-VolumeDependencyTests-1189288576 None] /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-7ca68623-8e69-48d9-b453-cd62b2c53823.06ebe9cf-3a4f-4ffa-9c31-a0b19099e6a4 is being set with open permissions: ugo+rw
Jul 02 20:05:10 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-a453d2e9-f19e-4a06-8300-e9294b79bfe5 tempest-VolumeDependencyTests-1189288576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-7ca68623-8e69-48d9-b453-cd62b2c53823.06ebe9cf-3a4f-4ffa-9c31-a0b19099e6a4 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:05:10 devstack sudo[107150]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-a0c2aa04-4a57-4ecc-a977-55bf55843dae
Jul 02 20:05:10 devstack sudo[107150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:05:10 devstack sudo[107151]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-7ca68623-8e69-48d9-b453-cd62b2c53823.06ebe9cf-3a4f-4ffa-9c31-a0b19099e6a4
Jul 02 20:05:10 devstack sudo[107151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:05:10 devstack sudo[107145]: pam_unix(sudo:session): session closed for user root
Jul 02 20:05:10 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-be7bcaca-58bf-4ab3-8de0-dcf20df7ad28 tempest-CreateVolumesFromSnapshotTest-1127395155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e" returned: 0 in 0.823s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:05:10 devstack cinder-volume[86639]: DEBUG cinder.manager [None req-be7bcaca-58bf-4ab3-8de0-dcf20df7ad28 tempest-CreateVolumesFromSnapshotTest-1127395155 None] Notifying Schedulers of capabilities ... {{(pid=86639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 20:05:10 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-be7bcaca-58bf-4ab3-8de0-dcf20df7ad28 tempest-CreateVolumesFromSnapshotTest-1127395155 None] Deleted volume successfully.
Jul 02 20:05:10 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-be7bcaca-58bf-4ab3-8de0-dcf20df7ad28 tempest-CreateVolumesFromSnapshotTest-1127395155 None] Lock "cinder-98fc0f7b-f3f8-4e97-83f7-d9e927fcf84d-delete_volume" released by "delete_volume" :: held 2.783s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 20:05:10 devstack sudo[107151]: pam_unix(sudo:session): session closed for user root
Jul 02 20:05:10 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-a453d2e9-f19e-4a06-8300-e9294b79bfe5 tempest-VolumeDependencyTests-1189288576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-7ca68623-8e69-48d9-b453-cd62b2c53823.06ebe9cf-3a4f-4ffa-9c31-a0b19099e6a4" returned: 0 in 0.786s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:05:10 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-a453d2e9-f19e-4a06-8300-e9294b79bfe5 tempest-VolumeDependencyTests-1189288576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-7ca68623-8e69-48d9-b453-cd62b2c53823.info {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:05:10 devstack sudo[107150]: pam_unix(sudo:session): session closed for user root
Jul 02 20:05:10 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-c2261cc4-6cfc-4a01-9443-ed45c313e816 tempest-CreateVolumesFromSnapshotTest-1127395155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-a0c2aa04-4a57-4ecc-a977-55bf55843dae" returned: 0 in 0.937s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:05:10 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-c2261cc4-6cfc-4a01-9443-ed45c313e816 tempest-CreateVolumesFromSnapshotTest-1127395155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-a0c2aa04-4a57-4ecc-a977-55bf55843dae {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:05:10 devstack sudo[107159]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-7ca68623-8e69-48d9-b453-cd62b2c53823.info
Jul 02 20:05:10 devstack sudo[107159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:05:10 devstack sudo[107160]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-a0c2aa04-4a57-4ecc-a977-55bf55843dae
Jul 02 20:05:10 devstack sudo[107160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:05:11 devstack sudo[107160]: pam_unix(sudo:session): session closed for user root
Jul 02 20:05:11 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-c2261cc4-6cfc-4a01-9443-ed45c313e816 tempest-CreateVolumesFromSnapshotTest-1127395155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-a0c2aa04-4a57-4ecc-a977-55bf55843dae" returned: 0 in 0.776s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:05:11 devstack sudo[107159]: pam_unix(sudo:session): session closed for user root
Jul 02 20:05:11 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-a453d2e9-f19e-4a06-8300-e9294b79bfe5 tempest-VolumeDependencyTests-1189288576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-7ca68623-8e69-48d9-b453-cd62b2c53823.info" returned: 0 in 0.805s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:05:11 devstack cinder-volume[86639]: WARNING cinder.volume.drivers.remotefs [None req-a453d2e9-f19e-4a06-8300-e9294b79bfe5 tempest-VolumeDependencyTests-1189288576 None] /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-7ca68623-8e69-48d9-b453-cd62b2c53823.info is being set with open permissions: ugo+rw
Jul 02 20:05:11 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-a453d2e9-f19e-4a06-8300-e9294b79bfe5 tempest-VolumeDependencyTests-1189288576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-7ca68623-8e69-48d9-b453-cd62b2c53823.info {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:05:11 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-c2261cc4-6cfc-4a01-9443-ed45c313e816 tempest-CreateVolumesFromSnapshotTest-1127395155 None] Lock "cinder-quobyte-a0c2aa04-4a57-4ecc-a977-55bf55843dae" released by "delete_volume" :: held 1.775s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 20:05:11 devstack sudo[107165]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-7ca68623-8e69-48d9-b453-cd62b2c53823.info
Jul 02 20:05:11 devstack sudo[107165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:05:11 devstack cinder-volume[86639]: DEBUG cinder.quota [None req-c2261cc4-6cfc-4a01-9443-ed45c313e816 tempest-CreateVolumesFromSnapshotTest-1127395155 None] Created reservations ['fe70b0be-b0dc-4a05-b361-a5bf2d5a8115', '121d38a1-b4ec-4ccc-9667-a7c5e2d91f03', '511c0fc8-7c7f-4e9a-951b-97c60b8e483b', '5cf46753-a9b9-400e-a727-90b13d1a8370'] {{(pid=86639) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 20:05:11 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-c2261cc4-6cfc-4a01-9443-ed45c313e816 tempest-CreateVolumesFromSnapshotTest-1127395155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 20:05:11 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-c2261cc4-6cfc-4a01-9443-ed45c313e816 tempest-CreateVolumesFromSnapshotTest-1127395155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 20:05:11 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-c2261cc4-6cfc-4a01-9443-ed45c313e816 tempest-CreateVolumesFromSnapshotTest-1127395155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 20:05:11 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-c2261cc4-6cfc-4a01-9443-ed45c313e816 tempest-CreateVolumesFromSnapshotTest-1127395155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 20:05:11 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-c2261cc4-6cfc-4a01-9443-ed45c313e816 tempest-CreateVolumesFromSnapshotTest-1127395155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 20:05:11 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-c2261cc4-6cfc-4a01-9443-ed45c313e816 tempest-CreateVolumesFromSnapshotTest-1127395155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:05:11 devstack sudo[107167]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e
Jul 02 20:05:11 devstack sudo[107167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:05:12 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-29fa2e99-0ac1-48e0-8298-b2e87b57ef95 tempest-CreateVolumesFromSnapshotTest-1127395155 None] Acquiring lock "cinder-79af5d4f-8b2e-4dd2-8745-88662a0f8ba0-delete_volume" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 20:05:12 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-29fa2e99-0ac1-48e0-8298-b2e87b57ef95 tempest-CreateVolumesFromSnapshotTest-1127395155 None] Lock "cinder-79af5d4f-8b2e-4dd2-8745-88662a0f8ba0-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 20:05:12 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-29fa2e99-0ac1-48e0-8298-b2e87b57ef95 tempest-CreateVolumesFromSnapshotTest-1127395155 None] Acquiring lock "cinder-quobyte-79af5d4f-8b2e-4dd2-8745-88662a0f8ba0" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 20:05:12 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-29fa2e99-0ac1-48e0-8298-b2e87b57ef95 tempest-CreateVolumesFromSnapshotTest-1127395155 None] Lock "cinder-quobyte-79af5d4f-8b2e-4dd2-8745-88662a0f8ba0" acquired by "delete_volume" :: waited 0.023s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 20:05:12 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0bfd3a9-8c0f-4a8c-9568-bf10298450ea]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 20:05:12 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-29fa2e99-0ac1-48e0-8298-b2e87b57ef95 tempest-CreateVolumesFromSnapshotTest-1127395155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-79af5d4f-8b2e-4dd2-8745-88662a0f8ba0 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:05:12 devstack sudo[107169]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-79af5d4f-8b2e-4dd2-8745-88662a0f8ba0
Jul 02 20:05:12 devstack sudo[107169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:05:12 devstack sudo[107165]: pam_unix(sudo:session): session closed for user root
Jul 02 20:05:12 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-a453d2e9-f19e-4a06-8300-e9294b79bfe5 tempest-VolumeDependencyTests-1189288576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-7ca68623-8e69-48d9-b453-cd62b2c53823.info" returned: 0 in 0.824s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:05:12 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-a453d2e9-f19e-4a06-8300-e9294b79bfe5 tempest-VolumeDependencyTests-1189288576 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.473s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 20:05:12 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-771e95f0-d136-4b66-86f0-bfcd1de47e74 tempest-VolumeImageDependencyTests-1452431683 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.084s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 20:05:12 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-771e95f0-d136-4b66-86f0-bfcd1de47e74 tempest-VolumeImageDependencyTests-1452431683 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce906cb830>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T18:05:02Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c945ed08-dc6d-4ee3-a3e3-935325ce22f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62d82d7e98624985aa12acf1bf898293',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T18:05:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T18:05:03Z,use_quota=True,user_id='4acbd19e898a4f288abf479d2981c127',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)}" {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 20:05:12 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-771e95f0-d136-4b66-86f0-bfcd1de47e74 tempest-VolumeImageDependencyTests-1452431683 None] Creating volume c945ed08-dc6d-4ee3-a3e3-935325ce22f5 {{(pid=86639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 20:05:12 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-771e95f0-d136-4b66-86f0-bfcd1de47e74 tempest-VolumeImageDependencyTests-1452431683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 20:05:12 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-771e95f0-d136-4b66-86f0-bfcd1de47e74 tempest-VolumeImageDependencyTests-1452431683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 20:05:12 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-771e95f0-d136-4b66-86f0-bfcd1de47e74 tempest-VolumeImageDependencyTests-1452431683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 20:05:12 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-771e95f0-d136-4b66-86f0-bfcd1de47e74 tempest-VolumeImageDependencyTests-1452431683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 20:05:12 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-771e95f0-d136-4b66-86f0-bfcd1de47e74 tempest-VolumeImageDependencyTests-1452431683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 20:05:12 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-771e95f0-d136-4b66-86f0-bfcd1de47e74 tempest-VolumeImageDependencyTests-1452431683 None] Selected osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92 as target Quobyte volume. {{(pid=86639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 20:05:12 devstack cinder-volume[86639]: INFO cinder.volume.drivers.remotefs [None req-771e95f0-d136-4b66-86f0-bfcd1de47e74 tempest-VolumeImageDependencyTests-1452431683 None] casted to osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92
Jul 02 20:05:12 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-771e95f0-d136-4b66-86f0-bfcd1de47e74 tempest-VolumeImageDependencyTests-1452431683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-c945ed08-dc6d-4ee3-a3e3-935325ce22f5 1073741824 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:05:12 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-a453d2e9-f19e-4a06-8300-e9294b79bfe5 tempest-VolumeDependencyTests-1189288576 None] Create snapshot completed successfully
Jul 02 20:05:12 devstack sudo[107173]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-c945ed08-dc6d-4ee3-a3e3-935325ce22f5 1073741824
Jul 02 20:05:12 devstack sudo[107173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:05:12 devstack sudo[107167]: pam_unix(sudo:session): session closed for user root
Jul 02 20:05:12 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-c2261cc4-6cfc-4a01-9443-ed45c313e816 tempest-CreateVolumesFromSnapshotTest-1127395155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e" returned: 0 in 0.878s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:05:12 devstack cinder-volume[86639]: DEBUG cinder.manager [None req-c2261cc4-6cfc-4a01-9443-ed45c313e816 tempest-CreateVolumesFromSnapshotTest-1127395155 None] Notifying Schedulers of capabilities ... {{(pid=86639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 20:05:12 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-c2261cc4-6cfc-4a01-9443-ed45c313e816 tempest-CreateVolumesFromSnapshotTest-1127395155 None] Deleted volume successfully.
Jul 02 20:05:12 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-c2261cc4-6cfc-4a01-9443-ed45c313e816 tempest-CreateVolumesFromSnapshotTest-1127395155 None] Lock "cinder-a0c2aa04-4a57-4ecc-a977-55bf55843dae-delete_volume" released by "delete_volume" :: held 2.983s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 20:05:13 devstack sudo[107169]: pam_unix(sudo:session): session closed for user root
Jul 02 20:05:13 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-29fa2e99-0ac1-48e0-8298-b2e87b57ef95 tempest-CreateVolumesFromSnapshotTest-1127395155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-79af5d4f-8b2e-4dd2-8745-88662a0f8ba0" returned: 0 in 1.116s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:05:13 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-29fa2e99-0ac1-48e0-8298-b2e87b57ef95 tempest-CreateVolumesFromSnapshotTest-1127395155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-79af5d4f-8b2e-4dd2-8745-88662a0f8ba0 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:05:13 devstack sudo[107179]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-79af5d4f-8b2e-4dd2-8745-88662a0f8ba0
Jul 02 20:05:13 devstack sudo[107179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:05:14 devstack sudo[107173]: pam_unix(sudo:session): session closed for user root
Jul 02 20:05:14 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-771e95f0-d136-4b66-86f0-bfcd1de47e74 tempest-VolumeImageDependencyTests-1452431683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-c945ed08-dc6d-4ee3-a3e3-935325ce22f5 1073741824" returned: 0 in 1.461s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:05:14 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-771e95f0-d136-4b66-86f0-bfcd1de47e74 tempest-VolumeImageDependencyTests-1452431683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-c945ed08-dc6d-4ee3-a3e3-935325ce22f5 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:05:14 devstack cinder-volume[86639]: DEBUG cinder.volume.flows.manager.create_volume [None req-52a9145f-fa9f-4920-9ef9-6139dd24aa44 tempest-VolumeDependencyTests-1189288576 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 20:05:14 devstack sudo[107187]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-c945ed08-dc6d-4ee3-a3e3-935325ce22f5
Jul 02 20:05:14 devstack sudo[107187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:05:14 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-52a9145f-fa9f-4920-9ef9-6139dd24aa44 tempest-VolumeDependencyTests-1189288576 None] Flow 'volume_create_manager' (7919d21b-81ed-4005-863d-52ea62e04152) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 20:05:14 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-52a9145f-fa9f-4920-9ef9-6139dd24aa44 tempest-VolumeDependencyTests-1189288576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8b9bf5a-d94d-4fca-9a5c-b445a102bb53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:05:14 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-52a9145f-fa9f-4920-9ef9-6139dd24aa44 tempest-VolumeDependencyTests-1189288576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8b9bf5a-d94d-4fca-9a5c-b445a102bb53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T18:05:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-64047663',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a28fa1e1-e63f-46f9-87da-7392cbcf0b02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6331398c26f5430ab6745cced81e28e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T18:05:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=06ebe9cf-3a4f-4ffa-9c31-a0b19099e6a4,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T18:05:14Z,use_quota=True,user_id='655530ba13194b4997735df3696865f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:05:14 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-52a9145f-fa9f-4920-9ef9-6139dd24aa44 tempest-VolumeDependencyTests-1189288576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06061d3f-2c46-4f2a-b57e-b908a6c50536) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:05:14 devstack sudo[107179]: pam_unix(sudo:session): session closed for user root
Jul 02 20:05:14 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-52a9145f-fa9f-4920-9ef9-6139dd24aa44 tempest-VolumeDependencyTests-1189288576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06061d3f-2c46-4f2a-b57e-b908a6c50536) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:05:14 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-52a9145f-fa9f-4920-9ef9-6139dd24aa44 tempest-VolumeDependencyTests-1189288576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae3b7e48-da76-4f64-8cf5-c108312feeb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:05:14 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-52a9145f-fa9f-4920-9ef9-6139dd24aa44 tempest-VolumeDependencyTests-1189288576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae3b7e48-da76-4f64-8cf5-c108312feeb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'a28fa1e1-e63f-46f9-87da-7392cbcf0b02', 'volume_name': 'volume-a28fa1e1-e63f-46f9-87da-7392cbcf0b02', 'volume_size': 1, 'snapshot_id': '06ebe9cf-3a4f-4ffa-9c31-a0b19099e6a4'}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:05:14 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-52a9145f-fa9f-4920-9ef9-6139dd24aa44 tempest-VolumeDependencyTests-1189288576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc1e82e4-dea2-4368-bd9a-2d82d5b7d30d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:05:14 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-52a9145f-fa9f-4920-9ef9-6139dd24aa44 tempest-VolumeDependencyTests-1189288576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc1e82e4-dea2-4368-bd9a-2d82d5b7d30d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:05:14 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-52a9145f-fa9f-4920-9ef9-6139dd24aa44 tempest-VolumeDependencyTests-1189288576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2048d45f-d0cd-4130-a6ab-1dffd71ceb28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:05:14 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-52a9145f-fa9f-4920-9ef9-6139dd24aa44 tempest-VolumeDependencyTests-1189288576 None] Volume a28fa1e1-e63f-46f9-87da-7392cbcf0b02: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-a28fa1e1-e63f-46f9-87da-7392cbcf0b02', 'volume_size': 1, 'snapshot_id': '06ebe9cf-3a4f-4ffa-9c31-a0b19099e6a4'}
Jul 02 20:05:14 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-29fa2e99-0ac1-48e0-8298-b2e87b57ef95 tempest-CreateVolumesFromSnapshotTest-1127395155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-79af5d4f-8b2e-4dd2-8745-88662a0f8ba0" returned: 0 in 1.041s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:05:14 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-52a9145f-fa9f-4920-9ef9-6139dd24aa44 tempest-VolumeDependencyTests-1189288576 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 20:05:14 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-29fa2e99-0ac1-48e0-8298-b2e87b57ef95 tempest-CreateVolumesFromSnapshotTest-1127395155 None] Lock "cinder-quobyte-79af5d4f-8b2e-4dd2-8745-88662a0f8ba0" released by "delete_volume" :: held 2.229s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 20:05:14 devstack cinder-volume[86639]: DEBUG cinder.quota [None req-29fa2e99-0ac1-48e0-8298-b2e87b57ef95 tempest-CreateVolumesFromSnapshotTest-1127395155 None] Created reservations ['5f94d285-54c5-4aa9-b166-e37b735f30c2', '02c6f956-8419-4d42-bbb9-7c76fc2a16ba', 'ef7eabec-fa85-4973-8387-40519c580594', '2c96f62f-c9ba-4d69-9bce-3b3303f0bcb4'] {{(pid=86639) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 20:05:14 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-29fa2e99-0ac1-48e0-8298-b2e87b57ef95 tempest-CreateVolumesFromSnapshotTest-1127395155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 20:05:14 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-29fa2e99-0ac1-48e0-8298-b2e87b57ef95 tempest-CreateVolumesFromSnapshotTest-1127395155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 20:05:14 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-29fa2e99-0ac1-48e0-8298-b2e87b57ef95 tempest-CreateVolumesFromSnapshotTest-1127395155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 20:05:14 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-29fa2e99-0ac1-48e0-8298-b2e87b57ef95 tempest-CreateVolumesFromSnapshotTest-1127395155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 20:05:14 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-29fa2e99-0ac1-48e0-8298-b2e87b57ef95 tempest-CreateVolumesFromSnapshotTest-1127395155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 20:05:14 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-29fa2e99-0ac1-48e0-8298-b2e87b57ef95 tempest-CreateVolumesFromSnapshotTest-1127395155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:05:14 devstack sudo[107189]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e
Jul 02 20:05:14 devstack sudo[107189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:05:15 devstack sudo[107187]: pam_unix(sudo:session): session closed for user root
Jul 02 20:05:15 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-771e95f0-d136-4b66-86f0-bfcd1de47e74 tempest-VolumeImageDependencyTests-1452431683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-c945ed08-dc6d-4ee3-a3e3-935325ce22f5" returned: 0 in 0.946s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:05:15 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-771e95f0-d136-4b66-86f0-bfcd1de47e74 tempest-VolumeImageDependencyTests-1452431683 None] <== create_volume: return (2615ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'} {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 20:05:15 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-771e95f0-d136-4b66-86f0-bfcd1de47e74 tempest-VolumeImageDependencyTests-1452431683 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.620s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 20:05:15 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-52a9145f-fa9f-4920-9ef9-6139dd24aa44 tempest-VolumeDependencyTests-1189288576 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.736s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 20:05:15 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-52a9145f-fa9f-4920-9ef9-6139dd24aa44 tempest-VolumeDependencyTests-1189288576 None] Acquiring lock "cinder-quobyte-06ebe9cf-3a4f-4ffa-9c31-a0b19099e6a4-a28fa1e1-e63f-46f9-87da-7392cbcf0b02" by "_create_volume_from_snapshot" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 20:05:15 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-52a9145f-fa9f-4920-9ef9-6139dd24aa44 tempest-VolumeDependencyTests-1189288576 None] Lock "cinder-quobyte-06ebe9cf-3a4f-4ffa-9c31-a0b19099e6a4-a28fa1e1-e63f-46f9-87da-7392cbcf0b02" acquired by "_create_volume_from_snapshot" :: waited 0.033s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 20:05:15 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-52a9145f-fa9f-4920-9ef9-6139dd24aa44 tempest-VolumeDependencyTests-1189288576 None] Creating volume a28fa1e1-e63f-46f9-87da-7392cbcf0b02 from snapshot 06ebe9cf-3a4f-4ffa-9c31-a0b19099e6a4 {{(pid=86639) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jul 02 20:05:15 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-52a9145f-fa9f-4920-9ef9-6139dd24aa44 tempest-VolumeDependencyTests-1189288576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 20:05:15 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-52a9145f-fa9f-4920-9ef9-6139dd24aa44 tempest-VolumeDependencyTests-1189288576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 20:05:15 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-52a9145f-fa9f-4920-9ef9-6139dd24aa44 tempest-VolumeDependencyTests-1189288576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 20:05:15 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-52a9145f-fa9f-4920-9ef9-6139dd24aa44 tempest-VolumeDependencyTests-1189288576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 20:05:15 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-52a9145f-fa9f-4920-9ef9-6139dd24aa44 tempest-VolumeDependencyTests-1189288576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 20:05:15 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-52a9145f-fa9f-4920-9ef9-6139dd24aa44 tempest-VolumeDependencyTests-1189288576 None] Selected osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92 as target Quobyte volume. {{(pid=86639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 20:05:15 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-52a9145f-fa9f-4920-9ef9-6139dd24aa44 tempest-VolumeDependencyTests-1189288576 None] Acquiring lock "cinder-quobyte-a28fa1e1-e63f-46f9-87da-7392cbcf0b02" by "_copy_volume_from_snapshot" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 20:05:15 devstack cinder-volume[86639]: DEBUG cinder.volume.volume_utils [None req-771e95f0-d136-4b66-86f0-bfcd1de47e74 tempest-VolumeImageDependencyTests-1452431683 None] Attempting download of f71d6505-83be-4a8b-8c87-2961243ff32a ((None, [{'url': 'file:///opt/stack/data/glance/images/f71d6505-83be-4a8b-8c87-2961243ff32a', 'metadata': {}}])) to volume c945ed08-dc6d-4ee3-a3e3-935325ce22f5. {{(pid=86639) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jul 02 20:05:15 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-52a9145f-fa9f-4920-9ef9-6139dd24aa44 tempest-VolumeDependencyTests-1189288576 None] Lock "cinder-quobyte-a28fa1e1-e63f-46f9-87da-7392cbcf0b02" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 20:05:15 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-52a9145f-fa9f-4920-9ef9-6139dd24aa44 tempest-VolumeDependencyTests-1189288576 None] snapshot: 06ebe9cf-3a4f-4ffa-9c31-a0b19099e6a4, volume: a28fa1e1-e63f-46f9-87da-7392cbcf0b02,  {{(pid=86639) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jul 02 20:05:15 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-52a9145f-fa9f-4920-9ef9-6139dd24aa44 tempest-VolumeDependencyTests-1189288576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 20:05:15 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-52a9145f-fa9f-4920-9ef9-6139dd24aa44 tempest-VolumeDependencyTests-1189288576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 20:05:15 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-52a9145f-fa9f-4920-9ef9-6139dd24aa44 tempest-VolumeDependencyTests-1189288576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 20:05:15 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-52a9145f-fa9f-4920-9ef9-6139dd24aa44 tempest-VolumeDependencyTests-1189288576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 20:05:15 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-52a9145f-fa9f-4920-9ef9-6139dd24aa44 tempest-VolumeDependencyTests-1189288576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 20:05:15 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[867a2574-2aec-40b1-bcdf-604c9a8e0958]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 20:05:15 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-52a9145f-fa9f-4920-9ef9-6139dd24aa44 tempest-VolumeDependencyTests-1189288576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-7ca68623-8e69-48d9-b453-cd62b2c53823.06ebe9cf-3a4f-4ffa-9c31-a0b19099e6a4 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:05:15 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[85769b33-de75-4933-8d85-f15204cf1792]: (4, 'raw') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 20:05:15 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-771e95f0-d136-4b66-86f0-bfcd1de47e74 tempest-VolumeImageDependencyTests-1452431683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f71d6505-83be-4a8b-8c87-2961243ff32a_zb0pvxa2 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:05:15 devstack sudo[107193]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f71d6505-83be-4a8b-8c87-2961243ff32a_zb0pvxa2
Jul 02 20:05:15 devstack sudo[107193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:05:15 devstack sudo[107192]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-7ca68623-8e69-48d9-b453-cd62b2c53823.06ebe9cf-3a4f-4ffa-9c31-a0b19099e6a4
Jul 02 20:05:15 devstack sudo[107192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:05:15 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-2dbc6c29-3b30-44dc-bfae-5f38996c779b tempest-CreateVolumesFromSnapshotTest-1127395155 None] Acquiring lock "cinder-158a8c57-bddf-4c71-86f6-661b6f42fb7e-delete_volume" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 20:05:15 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-2dbc6c29-3b30-44dc-bfae-5f38996c779b tempest-CreateVolumesFromSnapshotTest-1127395155 None] Lock "cinder-158a8c57-bddf-4c71-86f6-661b6f42fb7e-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 20:05:15 devstack sudo[107189]: pam_unix(sudo:session): session closed for user root
Jul 02 20:05:15 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-29fa2e99-0ac1-48e0-8298-b2e87b57ef95 tempest-CreateVolumesFromSnapshotTest-1127395155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e" returned: 0 in 1.110s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:05:15 devstack cinder-volume[86639]: DEBUG cinder.manager [None req-29fa2e99-0ac1-48e0-8298-b2e87b57ef95 tempest-CreateVolumesFromSnapshotTest-1127395155 None] Notifying Schedulers of capabilities ... {{(pid=86639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 20:05:15 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-29fa2e99-0ac1-48e0-8298-b2e87b57ef95 tempest-CreateVolumesFromSnapshotTest-1127395155 None] Deleted volume successfully.
Jul 02 20:05:15 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-2dbc6c29-3b30-44dc-bfae-5f38996c779b tempest-CreateVolumesFromSnapshotTest-1127395155 None] Acquiring lock "cinder-quobyte-158a8c57-bddf-4c71-86f6-661b6f42fb7e" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 20:05:15 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-2dbc6c29-3b30-44dc-bfae-5f38996c779b tempest-CreateVolumesFromSnapshotTest-1127395155 None] Lock "cinder-quobyte-158a8c57-bddf-4c71-86f6-661b6f42fb7e" acquired by "delete_volume" :: waited 0.076s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 20:05:15 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-29fa2e99-0ac1-48e0-8298-b2e87b57ef95 tempest-CreateVolumesFromSnapshotTest-1127395155 None] Lock "cinder-79af5d4f-8b2e-4dd2-8745-88662a0f8ba0-delete_volume" released by "delete_volume" :: held 3.778s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 20:05:15 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[a85a9264-c044-4f5c-bc45-c6b322db5b34]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 20:05:15 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-2dbc6c29-3b30-44dc-bfae-5f38996c779b tempest-CreateVolumesFromSnapshotTest-1127395155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-158a8c57-bddf-4c71-86f6-661b6f42fb7e {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:05:16 devstack sudo[107197]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-158a8c57-bddf-4c71-86f6-661b6f42fb7e
Jul 02 20:05:16 devstack sudo[107197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:05:16 devstack sudo[107193]: pam_unix(sudo:session): session closed for user root
Jul 02 20:05:16 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-771e95f0-d136-4b66-86f0-bfcd1de47e74 tempest-VolumeImageDependencyTests-1452431683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f71d6505-83be-4a8b-8c87-2961243ff32a_zb0pvxa2" returned: 0 in 0.906s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:05:16 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-771e95f0-d136-4b66-86f0-bfcd1de47e74 tempest-VolumeImageDependencyTests-1452431683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f71d6505-83be-4a8b-8c87-2961243ff32a_zb0pvxa2 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:05:16 devstack sudo[107201]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f71d6505-83be-4a8b-8c87-2961243ff32a_zb0pvxa2
Jul 02 20:05:16 devstack sudo[107201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:05:16 devstack sudo[107192]: pam_unix(sudo:session): session closed for user root
Jul 02 20:05:16 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-52a9145f-fa9f-4920-9ef9-6139dd24aa44 tempest-VolumeDependencyTests-1189288576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-7ca68623-8e69-48d9-b453-cd62b2c53823.06ebe9cf-3a4f-4ffa-9c31-a0b19099e6a4" returned: 0 in 1.414s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:05:16 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-52a9145f-fa9f-4920-9ef9-6139dd24aa44 tempest-VolumeDependencyTests-1189288576 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7ca68623-8e69-48d9-b453-cd62b2c53823(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86639) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 02 20:05:16 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-52a9145f-fa9f-4920-9ef9-6139dd24aa44 tempest-VolumeDependencyTests-1189288576 None] will copy from snapshot at /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-7ca68623-8e69-48d9-b453-cd62b2c53823 {{(pid=86639) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jul 02 20:05:16 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-52a9145f-fa9f-4920-9ef9-6139dd24aa44 tempest-VolumeDependencyTests-1189288576 None] Creating direct copy from snapshot {{(pid=86639) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jul 02 20:05:16 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[193c815d-82f4-4424-9264-33bef0739b61]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 20:05:16 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-52a9145f-fa9f-4920-9ef9-6139dd24aa44 tempest-VolumeDependencyTests-1189288576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-7ca68623-8e69-48d9-b453-cd62b2c53823 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:05:16 devstack sudo[107206]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-7ca68623-8e69-48d9-b453-cd62b2c53823
Jul 02 20:05:16 devstack sudo[107206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:05:17 devstack sudo[107197]: pam_unix(sudo:session): session closed for user root
Jul 02 20:05:17 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-2dbc6c29-3b30-44dc-bfae-5f38996c779b tempest-CreateVolumesFromSnapshotTest-1127395155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-158a8c57-bddf-4c71-86f6-661b6f42fb7e" returned: 0 in 1.208s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:05:17 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-2dbc6c29-3b30-44dc-bfae-5f38996c779b tempest-CreateVolumesFromSnapshotTest-1127395155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-158a8c57-bddf-4c71-86f6-661b6f42fb7e {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:05:17 devstack sudo[107211]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-158a8c57-bddf-4c71-86f6-661b6f42fb7e
Jul 02 20:05:17 devstack sudo[107211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:05:17 devstack sudo[107201]: pam_unix(sudo:session): session closed for user root
Jul 02 20:05:17 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-771e95f0-d136-4b66-86f0-bfcd1de47e74 tempest-VolumeImageDependencyTests-1452431683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f71d6505-83be-4a8b-8c87-2961243ff32a_zb0pvxa2" returned: 1 in 1.301s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:05:17 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-771e95f0-d136-4b66-86f0-bfcd1de47e74 tempest-VolumeImageDependencyTests-1452431683 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f71d6505-83be-4a8b-8c87-2961243ff32a_zb0pvxa2' failed. Not Retrying. {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 02 20:05:17 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[f730622e-cdac-4450-b07b-bf176de1d8b9]: (4, 'raw') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 20:05:17 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-771e95f0-d136-4b66-86f0-bfcd1de47e74 tempest-VolumeImageDependencyTests-1452431683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f71d6505-83be-4a8b-8c87-2961243ff32a_ny73sfxldevstack@QuobyteHD {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:05:17 devstack sudo[107215]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f71d6505-83be-4a8b-8c87-2961243ff32a_ny73sfxldevstack@QuobyteHD
Jul 02 20:05:17 devstack sudo[107215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:05:18 devstack sudo[107206]: pam_unix(sudo:session): session closed for user root
Jul 02 20:05:18 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-52a9145f-fa9f-4920-9ef9-6139dd24aa44 tempest-VolumeDependencyTests-1189288576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-7ca68623-8e69-48d9-b453-cd62b2c53823" returned: 0 in 1.414s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:05:18 devstack cinder-volume[86639]: DEBUG cinder.utils [None req-52a9145f-fa9f-4920-9ef9-6139dd24aa44 tempest-VolumeDependencyTests-1189288576 None] Path /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-a28fa1e1-e63f-46f9-87da-7392cbcf0b02 not found in is_blk_device check {{(pid=86639) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 02 20:05:18 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-52a9145f-fa9f-4920-9ef9-6139dd24aa44 tempest-VolumeDependencyTests-1189288576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-7ca68623-8e69-48d9-b453-cd62b2c53823 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-a28fa1e1-e63f-46f9-87da-7392cbcf0b02 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:05:18 devstack sudo[107211]: pam_unix(sudo:session): session closed for user root
Jul 02 20:05:18 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-2dbc6c29-3b30-44dc-bfae-5f38996c779b tempest-CreateVolumesFromSnapshotTest-1127395155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-158a8c57-bddf-4c71-86f6-661b6f42fb7e" returned: 0 in 1.043s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:05:18 devstack sudo[107222]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-7ca68623-8e69-48d9-b453-cd62b2c53823 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-a28fa1e1-e63f-46f9-87da-7392cbcf0b02
Jul 02 20:05:18 devstack sudo[107222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:05:18 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-2dbc6c29-3b30-44dc-bfae-5f38996c779b tempest-CreateVolumesFromSnapshotTest-1127395155 None] Lock "cinder-quobyte-158a8c57-bddf-4c71-86f6-661b6f42fb7e" released by "delete_volume" :: held 2.326s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 20:05:18 devstack cinder-volume[86639]: DEBUG cinder.quota [None req-2dbc6c29-3b30-44dc-bfae-5f38996c779b tempest-CreateVolumesFromSnapshotTest-1127395155 None] Created reservations ['2d0c4f8d-0764-469a-b086-f6c853429474', '6549c61f-e817-4360-b15a-717368e11384', '93f93e84-2120-41ea-a8cf-228c1c23a6f7', '951e9878-80f4-4c8e-bfbf-437b9bcba21f'] {{(pid=86639) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 20:05:18 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-2dbc6c29-3b30-44dc-bfae-5f38996c779b tempest-CreateVolumesFromSnapshotTest-1127395155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 20:05:18 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-2dbc6c29-3b30-44dc-bfae-5f38996c779b tempest-CreateVolumesFromSnapshotTest-1127395155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 20:05:18 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-2dbc6c29-3b30-44dc-bfae-5f38996c779b tempest-CreateVolumesFromSnapshotTest-1127395155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 20:05:18 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-2dbc6c29-3b30-44dc-bfae-5f38996c779b tempest-CreateVolumesFromSnapshotTest-1127395155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 20:05:18 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-2dbc6c29-3b30-44dc-bfae-5f38996c779b tempest-CreateVolumesFromSnapshotTest-1127395155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 20:05:18 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-2dbc6c29-3b30-44dc-bfae-5f38996c779b tempest-CreateVolumesFromSnapshotTest-1127395155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:05:18 devstack sudo[107226]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e
Jul 02 20:05:18 devstack sudo[107226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:05:18 devstack sudo[107215]: pam_unix(sudo:session): session closed for user root
Jul 02 20:05:18 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-771e95f0-d136-4b66-86f0-bfcd1de47e74 tempest-VolumeImageDependencyTests-1452431683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f71d6505-83be-4a8b-8c87-2961243ff32a_ny73sfxldevstack@QuobyteHD" returned: 0 in 0.985s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:05:18 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-771e95f0-d136-4b66-86f0-bfcd1de47e74 tempest-VolumeImageDependencyTests-1452431683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f71d6505-83be-4a8b-8c87-2961243ff32a_ny73sfxldevstack@QuobyteHD {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:05:18 devstack sudo[107228]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f71d6505-83be-4a8b-8c87-2961243ff32a_ny73sfxldevstack@QuobyteHD
Jul 02 20:05:18 devstack sudo[107228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:05:19 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-9764b840-7de1-479d-b803-39bb5c52d2e0 tempest-CreateVolumesFromSnapshotTest-1127395155 None] Acquiring lock "cinder-bffa9e21-b9a5-4230-9d75-b7c8bf602974-delete_snapshot" by "delete_snapshot" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 20:05:19 devstack sudo[107226]: pam_unix(sudo:session): session closed for user root
Jul 02 20:05:19 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-2dbc6c29-3b30-44dc-bfae-5f38996c779b tempest-CreateVolumesFromSnapshotTest-1127395155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e" returned: 0 in 0.817s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:05:19 devstack cinder-volume[86639]: DEBUG cinder.manager [None req-2dbc6c29-3b30-44dc-bfae-5f38996c779b tempest-CreateVolumesFromSnapshotTest-1127395155 None] Notifying Schedulers of capabilities ... {{(pid=86639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 20:05:19 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-2dbc6c29-3b30-44dc-bfae-5f38996c779b tempest-CreateVolumesFromSnapshotTest-1127395155 None] Deleted volume successfully.
Jul 02 20:05:19 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-9764b840-7de1-479d-b803-39bb5c52d2e0 tempest-CreateVolumesFromSnapshotTest-1127395155 None] Lock "cinder-bffa9e21-b9a5-4230-9d75-b7c8bf602974-delete_snapshot" acquired by "delete_snapshot" :: waited 0.052s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 20:05:19 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-9764b840-7de1-479d-b803-39bb5c52d2e0 tempest-CreateVolumesFromSnapshotTest-1127395155 None] Acquiring lock "cinder-quobyte-5522fb92-c1a5-4cf1-b383-71c8a54a3b48" by "delete_snapshot" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 20:05:19 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-2dbc6c29-3b30-44dc-bfae-5f38996c779b tempest-CreateVolumesFromSnapshotTest-1127395155 None] Lock "cinder-158a8c57-bddf-4c71-86f6-661b6f42fb7e-delete_volume" released by "delete_volume" :: held 3.713s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 20:05:19 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-9764b840-7de1-479d-b803-39bb5c52d2e0 tempest-CreateVolumesFromSnapshotTest-1127395155 None] Lock "cinder-quobyte-5522fb92-c1a5-4cf1-b383-71c8a54a3b48" acquired by "delete_snapshot" :: waited 0.075s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 20:05:19 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-9764b840-7de1-479d-b803-39bb5c52d2e0 tempest-CreateVolumesFromSnapshotTest-1127395155 None] Acquiring lock "cinder-quobyte-bffa9e21-b9a5-4230-9d75-b7c8bf602974" by "_delete_snapshot" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 20:05:19 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-9764b840-7de1-479d-b803-39bb5c52d2e0 tempest-CreateVolumesFromSnapshotTest-1127395155 None] Lock "cinder-quobyte-bffa9e21-b9a5-4230-9d75-b7c8bf602974" acquired by "_delete_snapshot" :: waited 0.097s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 20:05:19 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-9764b840-7de1-479d-b803-39bb5c52d2e0 tempest-CreateVolumesFromSnapshotTest-1127395155 None] Deleting offline snapshot bffa9e21-b9a5-4230-9d75-b7c8bf602974 of volume 5522fb92-c1a5-4cf1-b383-71c8a54a3b48 {{(pid=86639) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 02 20:05:19 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-9764b840-7de1-479d-b803-39bb5c52d2e0 tempest-CreateVolumesFromSnapshotTest-1127395155 None] snapshot_file for this snap is: volume-5522fb92-c1a5-4cf1-b383-71c8a54a3b48.bffa9e21-b9a5-4230-9d75-b7c8bf602974 {{(pid=86639) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 02 20:05:19 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c034edc-892e-411e-9a4f-968cacd0d48f]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 20:05:19 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-9764b840-7de1-479d-b803-39bb5c52d2e0 tempest-CreateVolumesFromSnapshotTest-1127395155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-5522fb92-c1a5-4cf1-b383-71c8a54a3b48.bffa9e21-b9a5-4230-9d75-b7c8bf602974 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:05:19 devstack sudo[107228]: pam_unix(sudo:session): session closed for user root
Jul 02 20:05:19 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-771e95f0-d136-4b66-86f0-bfcd1de47e74 tempest-VolumeImageDependencyTests-1452431683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f71d6505-83be-4a8b-8c87-2961243ff32a_ny73sfxldevstack@QuobyteHD" returned: 1 in 1.187s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:05:19 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-771e95f0-d136-4b66-86f0-bfcd1de47e74 tempest-VolumeImageDependencyTests-1452431683 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f71d6505-83be-4a8b-8c87-2961243ff32a_ny73sfxldevstack@QuobyteHD' failed. Not Retrying. {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 02 20:05:19 devstack cinder-volume[86639]: DEBUG cinder.image.image_utils [None req-771e95f0-d136-4b66-86f0-bfcd1de47e74 tempest-VolumeImageDependencyTests-1452431683 None] f71d6505-83be-4a8b-8c87-2961243ff32a was raw, converting to raw {{(pid=86639) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jul 02 20:05:19 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-771e95f0-d136-4b66-86f0-bfcd1de47e74 tempest-VolumeImageDependencyTests-1452431683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_f71d6505-83be-4a8b-8c87-2961243ff32a_ny73sfxldevstack@QuobyteHD /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-c945ed08-dc6d-4ee3-a3e3-935325ce22f5 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:05:19 devstack sudo[107245]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_f71d6505-83be-4a8b-8c87-2961243ff32a_ny73sfxldevstack@QuobyteHD /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-c945ed08-dc6d-4ee3-a3e3-935325ce22f5
Jul 02 20:05:19 devstack sudo[107245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:05:19 devstack sudo[107244]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-5522fb92-c1a5-4cf1-b383-71c8a54a3b48.bffa9e21-b9a5-4230-9d75-b7c8bf602974
Jul 02 20:05:19 devstack sudo[107244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:05:21 devstack sudo[107245]: pam_unix(sudo:session): session closed for user root
Jul 02 20:05:21 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-771e95f0-d136-4b66-86f0-bfcd1de47e74 tempest-VolumeImageDependencyTests-1452431683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_f71d6505-83be-4a8b-8c87-2961243ff32a_ny73sfxldevstack@QuobyteHD /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-c945ed08-dc6d-4ee3-a3e3-935325ce22f5" returned: 0 in 2.094s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:05:21 devstack cinder-volume[86639]: DEBUG cinder.image.image_utils [None req-771e95f0-d136-4b66-86f0-bfcd1de47e74 tempest-VolumeImageDependencyTests-1452431683 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_f71d6505-83be-4a8b-8c87-2961243ff32a_ny73sfxldevstack@QuobyteHD, size 0.00 MB, duration 2.10 sec, destination /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-c945ed08-dc6d-4ee3-a3e3-935325ce22f5 {{(pid=86639) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 02 20:05:21 devstack cinder-volume[86639]: INFO cinder.image.image_utils [None req-771e95f0-d136-4b66-86f0-bfcd1de47e74 tempest-VolumeImageDependencyTests-1452431683 None] Converted 0.00 MB image at 0.00 MB/s
Jul 02 20:05:21 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-771e95f0-d136-4b66-86f0-bfcd1de47e74 tempest-VolumeImageDependencyTests-1452431683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-c945ed08-dc6d-4ee3-a3e3-935325ce22f5 1G {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:05:21 devstack sudo[107244]: pam_unix(sudo:session): session closed for user root
Jul 02 20:05:21 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-9764b840-7de1-479d-b803-39bb5c52d2e0 tempest-CreateVolumesFromSnapshotTest-1127395155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-5522fb92-c1a5-4cf1-b383-71c8a54a3b48.bffa9e21-b9a5-4230-9d75-b7c8bf602974" returned: 0 in 2.280s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:05:21 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-9764b840-7de1-479d-b803-39bb5c52d2e0 tempest-CreateVolumesFromSnapshotTest-1127395155 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5522fb92-c1a5-4cf1-b383-71c8a54a3b48(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86639) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 02 20:05:21 devstack sudo[107255]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-c945ed08-dc6d-4ee3-a3e3-935325ce22f5 1G
Jul 02 20:05:21 devstack sudo[107255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:05:22 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb1cd1a5-5166-4224-907d-161cf164181a]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 20:05:22 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-9764b840-7de1-479d-b803-39bb5c52d2e0 tempest-CreateVolumesFromSnapshotTest-1127395155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-5522fb92-c1a5-4cf1-b383-71c8a54a3b48 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:05:22 devstack sudo[107257]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-5522fb92-c1a5-4cf1-b383-71c8a54a3b48
Jul 02 20:05:22 devstack sudo[107257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:05:23 devstack sudo[107255]: pam_unix(sudo:session): session closed for user root
Jul 02 20:05:23 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-771e95f0-d136-4b66-86f0-bfcd1de47e74 tempest-VolumeImageDependencyTests-1452431683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-c945ed08-dc6d-4ee3-a3e3-935325ce22f5 1G" returned: 0 in 1.729s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:05:23 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[88e9dc88-f192-4387-838c-50494a288ea6]: (4, 'raw') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 20:05:23 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-771e95f0-d136-4b66-86f0-bfcd1de47e74 tempest-VolumeImageDependencyTests-1452431683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-c945ed08-dc6d-4ee3-a3e3-935325ce22f5 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:05:24 devstack sudo[107257]: pam_unix(sudo:session): session closed for user root
Jul 02 20:05:24 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-9764b840-7de1-479d-b803-39bb5c52d2e0 tempest-CreateVolumesFromSnapshotTest-1127395155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-5522fb92-c1a5-4cf1-b383-71c8a54a3b48" returned: 0 in 2.034s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:05:24 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-9764b840-7de1-479d-b803-39bb5c52d2e0 tempest-CreateVolumesFromSnapshotTest-1127395155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-5522fb92-c1a5-4cf1-b383-71c8a54a3b48.bffa9e21-b9a5-4230-9d75-b7c8bf602974 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:05:24 devstack sudo[107264]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-c945ed08-dc6d-4ee3-a3e3-935325ce22f5
Jul 02 20:05:24 devstack sudo[107264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:05:24 devstack sudo[107266]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-5522fb92-c1a5-4cf1-b383-71c8a54a3b48.bffa9e21-b9a5-4230-9d75-b7c8bf602974
Jul 02 20:05:24 devstack sudo[107266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:05:25 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-52a9145f-fa9f-4920-9ef9-6139dd24aa44 tempest-VolumeDependencyTests-1189288576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-7ca68623-8e69-48d9-b453-cd62b2c53823 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-a28fa1e1-e63f-46f9-87da-7392cbcf0b02" returned: 0 in 7.133s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:05:25 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[de953066-70c5-457c-8ac3-9934d06cdda8]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 20:05:25 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-52a9145f-fa9f-4920-9ef9-6139dd24aa44 tempest-VolumeDependencyTests-1189288576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-7ca68623-8e69-48d9-b453-cd62b2c53823 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:05:25 devstack sudo[107271]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-7ca68623-8e69-48d9-b453-cd62b2c53823
Jul 02 20:05:25 devstack sudo[107271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:05:25 devstack sudo[107264]: pam_unix(sudo:session): session closed for user root
Jul 02 20:05:25 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-771e95f0-d136-4b66-86f0-bfcd1de47e74 tempest-VolumeImageDependencyTests-1452431683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-c945ed08-dc6d-4ee3-a3e3-935325ce22f5" returned: 0 in 1.848s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:05:25 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-771e95f0-d136-4b66-86f0-bfcd1de47e74 tempest-VolumeImageDependencyTests-1452431683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-c945ed08-dc6d-4ee3-a3e3-935325ce22f5 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:05:25 devstack sudo[107278]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-c945ed08-dc6d-4ee3-a3e3-935325ce22f5
Jul 02 20:05:25 devstack sudo[107278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:05:25 devstack sudo[107266]: pam_unix(sudo:session): session closed for user root
Jul 02 20:05:25 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-9764b840-7de1-479d-b803-39bb5c52d2e0 tempest-CreateVolumesFromSnapshotTest-1127395155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-5522fb92-c1a5-4cf1-b383-71c8a54a3b48.bffa9e21-b9a5-4230-9d75-b7c8bf602974" returned: 0 in 1.691s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:05:25 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-9764b840-7de1-479d-b803-39bb5c52d2e0 tempest-CreateVolumesFromSnapshotTest-1127395155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-5522fb92-c1a5-4cf1-b383-71c8a54a3b48.bffa9e21-b9a5-4230-9d75-b7c8bf602974 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:05:25 devstack sudo[107280]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-5522fb92-c1a5-4cf1-b383-71c8a54a3b48.bffa9e21-b9a5-4230-9d75-b7c8bf602974
Jul 02 20:05:25 devstack sudo[107280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:05:26 devstack sudo[107278]: pam_unix(sudo:session): session closed for user root
Jul 02 20:05:26 devstack sudo[107271]: pam_unix(sudo:session): session closed for user root
Jul 02 20:05:26 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-771e95f0-d136-4b66-86f0-bfcd1de47e74 tempest-VolumeImageDependencyTests-1452431683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-c945ed08-dc6d-4ee3-a3e3-935325ce22f5" returned: 1 in 0.912s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:05:26 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-771e95f0-d136-4b66-86f0-bfcd1de47e74 tempest-VolumeImageDependencyTests-1452431683 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-c945ed08-dc6d-4ee3-a3e3-935325ce22f5' failed. Not Retrying. {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 02 20:05:26 devstack cinder-volume[86639]: DEBUG cinder.volume.volume_utils [None req-771e95f0-d136-4b66-86f0-bfcd1de47e74 tempest-VolumeImageDependencyTests-1452431683 None] Downloaded image f71d6505-83be-4a8b-8c87-2961243ff32a ((None, [{'url': 'file:///opt/stack/data/glance/images/f71d6505-83be-4a8b-8c87-2961243ff32a', 'metadata': {}}])) to volume c945ed08-dc6d-4ee3-a3e3-935325ce22f5 successfully. {{(pid=86639) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jul 02 20:05:26 devstack cinder-volume[86639]: DEBUG cinder.image.image_utils [None req-771e95f0-d136-4b66-86f0-bfcd1de47e74 tempest-VolumeImageDependencyTests-1452431683 None] Temporary image f71d6505-83be-4a8b-8c87-2961243ff32a for user 4acbd19e898a4f288abf479d2981c127 is deleted. {{(pid=86639) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jul 02 20:05:26 devstack cinder-volume[86639]: DEBUG cinder.volume.volume_utils [None req-771e95f0-d136-4b66-86f0-bfcd1de47e74 tempest-VolumeImageDependencyTests-1452431683 None] Marking volume c945ed08-dc6d-4ee3-a3e3-935325ce22f5 as bootable. {{(pid=86639) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jul 02 20:05:26 devstack sudo[107280]: pam_unix(sudo:session): session closed for user root
Jul 02 20:05:26 devstack cinder-volume[86639]: DEBUG dbcounter [-] [86639] Writing DB stats cinder:SELECT=125,cinder:UPDATE=159,cinder:INSERT=41,cinder:DELETE=18 {{(pid=86639) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 02 20:05:26 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-52a9145f-fa9f-4920-9ef9-6139dd24aa44 tempest-VolumeDependencyTests-1189288576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-7ca68623-8e69-48d9-b453-cd62b2c53823" returned: 0 in 1.171s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:05:26 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-9764b840-7de1-479d-b803-39bb5c52d2e0 tempest-CreateVolumesFromSnapshotTest-1127395155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-5522fb92-c1a5-4cf1-b383-71c8a54a3b48.bffa9e21-b9a5-4230-9d75-b7c8bf602974" returned: 0 in 0.759s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:05:26 devstack cinder-volume[86639]: DEBUG cinder.image.image_utils [None req-52a9145f-fa9f-4920-9ef9-6139dd24aa44 tempest-VolumeDependencyTests-1189288576 None] Image conversion details: src /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-7ca68623-8e69-48d9-b453-cd62b2c53823, size 1024.00 MB, duration 7.14 sec, destination /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-a28fa1e1-e63f-46f9-87da-7392cbcf0b02 {{(pid=86639) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 02 20:05:26 devstack cinder-volume[86639]: INFO cinder.image.image_utils [None req-52a9145f-fa9f-4920-9ef9-6139dd24aa44 tempest-VolumeDependencyTests-1189288576 None] Converted 1024.00 MB image at 143.44 MB/s
Jul 02 20:05:26 devstack cinder-volume[86639]: WARNING cinder.volume.drivers.remotefs [None req-52a9145f-fa9f-4920-9ef9-6139dd24aa44 tempest-VolumeDependencyTests-1189288576 None] /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-a28fa1e1-e63f-46f9-87da-7392cbcf0b02 is being set with open permissions: ugo+rw
Jul 02 20:05:26 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-52a9145f-fa9f-4920-9ef9-6139dd24aa44 tempest-VolumeDependencyTests-1189288576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-a28fa1e1-e63f-46f9-87da-7392cbcf0b02 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:05:26 devstack cinder-volume[86639]: DEBUG dbcounter [-] [86639] Writing DB stats cinder:UPDATE=170,cinder:SELECT=121,cinder:INSERT=45,cinder:DELETE=13 {{(pid=86639) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 02 20:05:26 devstack sudo[107290]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-a28fa1e1-e63f-46f9-87da-7392cbcf0b02
Jul 02 20:05:26 devstack sudo[107290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:05:26 devstack cinder-volume[86639]: DEBUG cinder.volume.flows.manager.create_volume [None req-771e95f0-d136-4b66-86f0-bfcd1de47e74 tempest-VolumeImageDependencyTests-1452431683 None] Copying metadata from image f71d6505-83be-4a8b-8c87-2961243ff32a to c945ed08-dc6d-4ee3-a3e3-935325ce22f5. {{(pid=86639) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jul 02 20:05:26 devstack cinder-volume[86639]: DEBUG cinder.volume.flows.manager.create_volume [None req-771e95f0-d136-4b66-86f0-bfcd1de47e74 tempest-VolumeImageDependencyTests-1452431683 None] Creating volume glance metadata for volume c945ed08-dc6d-4ee3-a3e3-935325ce22f5 backed by image f71d6505-83be-4a8b-8c87-2961243ff32a with: {'image_id': 'f71d6505-83be-4a8b-8c87-2961243ff32a', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'ceb679f2d519f5e27c9bce3d31d5b72e', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86639) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jul 02 20:05:26 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-9764b840-7de1-479d-b803-39bb5c52d2e0 tempest-CreateVolumesFromSnapshotTest-1127395155 None] Lock "cinder-quobyte-bffa9e21-b9a5-4230-9d75-b7c8bf602974" released by "_delete_snapshot" :: held 7.088s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 20:05:26 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-9764b840-7de1-479d-b803-39bb5c52d2e0 tempest-CreateVolumesFromSnapshotTest-1127395155 None] Lock "cinder-quobyte-5522fb92-c1a5-4cf1-b383-71c8a54a3b48" released by "delete_snapshot" :: held 7.230s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 20:05:26 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-771e95f0-d136-4b66-86f0-bfcd1de47e74 tempest-VolumeImageDependencyTests-1452431683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10005dbf-dc43-4724-8239-80d21e9152b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c945ed08-dc6d-4ee3-a3e3-935325ce22f5', 'volume_size': 1, 'image_id': 'f71d6505-83be-4a8b-8c87-2961243ff32a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f71d6505-83be-4a8b-8c87-2961243ff32a', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ceb679f2d519f5e27c9bce3d31d5b72e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '62d82d7e98624985aa12acf1bf898293', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '7465f8f83e57762c7253c4b1f0de55bd2dcc48183ff3cc6fef8c91bc3b5fb93d93c8d04f6fc68227755e2b974b76e3cac137992635c425f65daf6402a16629d3', 'id': 'f71d6505-83be-4a8b-8c87-2961243ff32a', 'created_at': datetime.datetime(2026, 7, 2, 18, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 2, 18, 5, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f71d6505-83be-4a8b-8c87-2961243ff32a/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fce84bd34a0>}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:05:26 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-771e95f0-d136-4b66-86f0-bfcd1de47e74 tempest-VolumeImageDependencyTests-1452431683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f787d426-ed6c-41b6-b221-7889b4a21557) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:05:26 devstack cinder-volume[86639]: DEBUG cinder.quota [None req-9764b840-7de1-479d-b803-39bb5c52d2e0 tempest-CreateVolumesFromSnapshotTest-1127395155 None] Created reservations ['77db35a4-94bc-44e9-aebd-379c68720e38', 'b91f0242-ed5a-4c70-b35d-ed4b613797bb', '3ea5023f-fbe9-4a37-a8c5-dbd3dd6357e9', '9872cc98-0b4d-4243-9df0-b8fa1f9e0947'] {{(pid=86639) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 20:05:26 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-771e95f0-d136-4b66-86f0-bfcd1de47e74 tempest-VolumeImageDependencyTests-1452431683 None] Volume volume-c945ed08-dc6d-4ee3-a3e3-935325ce22f5 (c945ed08-dc6d-4ee3-a3e3-935325ce22f5): created successfully
Jul 02 20:05:26 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-771e95f0-d136-4b66-86f0-bfcd1de47e74 tempest-VolumeImageDependencyTests-1452431683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f787d426-ed6c-41b6-b221-7889b4a21557) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:05:26 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-771e95f0-d136-4b66-86f0-bfcd1de47e74 tempest-VolumeImageDependencyTests-1452431683 None] Flow 'volume_create_manager' (f2f5ba2f-d4ac-4c76-8bff-f0f46ff85a8e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 20:05:26 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-771e95f0-d136-4b66-86f0-bfcd1de47e74 tempest-VolumeImageDependencyTests-1452431683 None] Created volume successfully.
Jul 02 20:05:26 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-9764b840-7de1-479d-b803-39bb5c52d2e0 tempest-CreateVolumesFromSnapshotTest-1127395155 None] Delete snapshot completed successfully.
Jul 02 20:05:26 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-9764b840-7de1-479d-b803-39bb5c52d2e0 tempest-CreateVolumesFromSnapshotTest-1127395155 None] Lock "cinder-bffa9e21-b9a5-4230-9d75-b7c8bf602974-delete_snapshot" released by "delete_snapshot" :: held 7.538s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 20:05:27 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-7234810e-5468-4ffc-836c-c3844b3d9099 tempest-CreateVolumesFromSnapshotTest-1127395155 None] Acquiring lock "cinder-5522fb92-c1a5-4cf1-b383-71c8a54a3b48-delete_volume" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 20:05:27 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-7234810e-5468-4ffc-836c-c3844b3d9099 tempest-CreateVolumesFromSnapshotTest-1127395155 None] Lock "cinder-5522fb92-c1a5-4cf1-b383-71c8a54a3b48-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 20:05:27 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-7234810e-5468-4ffc-836c-c3844b3d9099 tempest-CreateVolumesFromSnapshotTest-1127395155 None] Acquiring lock "cinder-quobyte-5522fb92-c1a5-4cf1-b383-71c8a54a3b48" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 20:05:27 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-7234810e-5468-4ffc-836c-c3844b3d9099 tempest-CreateVolumesFromSnapshotTest-1127395155 None] Lock "cinder-quobyte-5522fb92-c1a5-4cf1-b383-71c8a54a3b48" acquired by "delete_volume" :: waited 0.024s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 20:05:27 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dc44021-79d7-43c7-b781-112f942d9981]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 20:05:27 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-7234810e-5468-4ffc-836c-c3844b3d9099 tempest-CreateVolumesFromSnapshotTest-1127395155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-5522fb92-c1a5-4cf1-b383-71c8a54a3b48 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:05:27 devstack sudo[107290]: pam_unix(sudo:session): session closed for user root
Jul 02 20:05:27 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-52a9145f-fa9f-4920-9ef9-6139dd24aa44 tempest-VolumeDependencyTests-1189288576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-a28fa1e1-e63f-46f9-87da-7392cbcf0b02" returned: 0 in 0.869s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:05:27 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-52a9145f-fa9f-4920-9ef9-6139dd24aa44 tempest-VolumeDependencyTests-1189288576 None] Lock "cinder-quobyte-a28fa1e1-e63f-46f9-87da-7392cbcf0b02" released by "_copy_volume_from_snapshot" :: held 12.155s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 20:05:27 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-52a9145f-fa9f-4920-9ef9-6139dd24aa44 tempest-VolumeDependencyTests-1189288576 None] Lock "cinder-quobyte-06ebe9cf-3a4f-4ffa-9c31-a0b19099e6a4-a28fa1e1-e63f-46f9-87da-7392cbcf0b02" released by "_create_volume_from_snapshot" :: held 12.201s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 20:05:27 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-52a9145f-fa9f-4920-9ef9-6139dd24aa44 tempest-VolumeDependencyTests-1189288576 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 12.236s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 20:05:27 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-52a9145f-fa9f-4920-9ef9-6139dd24aa44 tempest-VolumeDependencyTests-1189288576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2048d45f-d0cd-4130-a6ab-1dffd71ceb28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a28fa1e1-e63f-46f9-87da-7392cbcf0b02', 'volume_size': 1, 'snapshot_id': '06ebe9cf-3a4f-4ffa-9c31-a0b19099e6a4'}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:05:27 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-52a9145f-fa9f-4920-9ef9-6139dd24aa44 tempest-VolumeDependencyTests-1189288576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e5c9830-7700-42c3-b09b-b376db4298af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:05:27 devstack sudo[107293]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-5522fb92-c1a5-4cf1-b383-71c8a54a3b48
Jul 02 20:05:27 devstack sudo[107293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:05:27 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-52a9145f-fa9f-4920-9ef9-6139dd24aa44 tempest-VolumeDependencyTests-1189288576 None] Volume volume-a28fa1e1-e63f-46f9-87da-7392cbcf0b02 (a28fa1e1-e63f-46f9-87da-7392cbcf0b02): created successfully
Jul 02 20:05:27 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-52a9145f-fa9f-4920-9ef9-6139dd24aa44 tempest-VolumeDependencyTests-1189288576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e5c9830-7700-42c3-b09b-b376db4298af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:05:27 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-52a9145f-fa9f-4920-9ef9-6139dd24aa44 tempest-VolumeDependencyTests-1189288576 None] Flow 'volume_create_manager' (7919d21b-81ed-4005-863d-52ea62e04152) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 20:05:27 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-52a9145f-fa9f-4920-9ef9-6139dd24aa44 tempest-VolumeDependencyTests-1189288576 None] Created volume successfully.
Jul 02 20:05:27 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-c84b1e13-aad8-4ada-8b4e-b90d9b7c2009 tempest-VolumeDependencyTests-1189288576 None] Acquiring lock "cinder-06ebe9cf-3a4f-4ffa-9c31-a0b19099e6a4-delete_snapshot" by "delete_snapshot" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 20:05:27 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-740cdd84-d9cc-442e-8e18-9a0a57c8c778 tempest-VolumeImageDependencyTests-1452431683 None] Acquiring lock "cinder-c945ed08-dc6d-4ee3-a3e3-935325ce22f5-delete_volume" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 20:05:27 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-c84b1e13-aad8-4ada-8b4e-b90d9b7c2009 tempest-VolumeDependencyTests-1189288576 None] Lock "cinder-06ebe9cf-3a4f-4ffa-9c31-a0b19099e6a4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.054s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 20:05:27 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-c84b1e13-aad8-4ada-8b4e-b90d9b7c2009 tempest-VolumeDependencyTests-1189288576 None] Acquiring lock "cinder-quobyte-7ca68623-8e69-48d9-b453-cd62b2c53823" by "delete_snapshot" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 20:05:27 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-740cdd84-d9cc-442e-8e18-9a0a57c8c778 tempest-VolumeImageDependencyTests-1452431683 None] Lock "cinder-c945ed08-dc6d-4ee3-a3e3-935325ce22f5-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 20:05:27 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-c84b1e13-aad8-4ada-8b4e-b90d9b7c2009 tempest-VolumeDependencyTests-1189288576 None] Lock "cinder-quobyte-7ca68623-8e69-48d9-b453-cd62b2c53823" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 20:05:27 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-c84b1e13-aad8-4ada-8b4e-b90d9b7c2009 tempest-VolumeDependencyTests-1189288576 None] Acquiring lock "cinder-quobyte-06ebe9cf-3a4f-4ffa-9c31-a0b19099e6a4" by "_delete_snapshot" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 20:05:28 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-740cdd84-d9cc-442e-8e18-9a0a57c8c778 tempest-VolumeImageDependencyTests-1452431683 None] Acquiring lock "cinder-quobyte-c945ed08-dc6d-4ee3-a3e3-935325ce22f5" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 20:05:28 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-c84b1e13-aad8-4ada-8b4e-b90d9b7c2009 tempest-VolumeDependencyTests-1189288576 None] Lock "cinder-quobyte-06ebe9cf-3a4f-4ffa-9c31-a0b19099e6a4" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 20:05:28 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-c84b1e13-aad8-4ada-8b4e-b90d9b7c2009 tempest-VolumeDependencyTests-1189288576 None] Deleting offline snapshot 06ebe9cf-3a4f-4ffa-9c31-a0b19099e6a4 of volume 7ca68623-8e69-48d9-b453-cd62b2c53823 {{(pid=86639) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 02 20:05:28 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-c84b1e13-aad8-4ada-8b4e-b90d9b7c2009 tempest-VolumeDependencyTests-1189288576 None] snapshot_file for this snap is: volume-7ca68623-8e69-48d9-b453-cd62b2c53823.06ebe9cf-3a4f-4ffa-9c31-a0b19099e6a4 {{(pid=86639) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 02 20:05:28 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cb73b37-84b3-47a3-aba1-bb84ab320d6e]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 20:05:28 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-740cdd84-d9cc-442e-8e18-9a0a57c8c778 tempest-VolumeImageDependencyTests-1452431683 None] Lock "cinder-quobyte-c945ed08-dc6d-4ee3-a3e3-935325ce22f5" acquired by "delete_volume" :: waited 0.039s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 20:05:28 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-c84b1e13-aad8-4ada-8b4e-b90d9b7c2009 tempest-VolumeDependencyTests-1189288576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-7ca68623-8e69-48d9-b453-cd62b2c53823.06ebe9cf-3a4f-4ffa-9c31-a0b19099e6a4 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:05:28 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[576827fc-32a5-415b-b9ff-8949f369ddb1]: (4, 'raw') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 20:05:28 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-740cdd84-d9cc-442e-8e18-9a0a57c8c778 tempest-VolumeImageDependencyTests-1452431683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-c945ed08-dc6d-4ee3-a3e3-935325ce22f5 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:05:28 devstack sudo[107295]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-7ca68623-8e69-48d9-b453-cd62b2c53823.06ebe9cf-3a4f-4ffa-9c31-a0b19099e6a4
Jul 02 20:05:28 devstack sudo[107295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:05:28 devstack sudo[107298]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-c945ed08-dc6d-4ee3-a3e3-935325ce22f5
Jul 02 20:05:28 devstack sudo[107298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:05:28 devstack sudo[107293]: pam_unix(sudo:session): session closed for user root
Jul 02 20:05:28 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-7234810e-5468-4ffc-836c-c3844b3d9099 tempest-CreateVolumesFromSnapshotTest-1127395155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-5522fb92-c1a5-4cf1-b383-71c8a54a3b48" returned: 0 in 1.053s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:05:28 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-7234810e-5468-4ffc-836c-c3844b3d9099 tempest-CreateVolumesFromSnapshotTest-1127395155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-5522fb92-c1a5-4cf1-b383-71c8a54a3b48 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:05:28 devstack sudo[107302]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-5522fb92-c1a5-4cf1-b383-71c8a54a3b48
Jul 02 20:05:28 devstack sudo[107302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:05:29 devstack sudo[107295]: pam_unix(sudo:session): session closed for user root
Jul 02 20:05:29 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-c84b1e13-aad8-4ada-8b4e-b90d9b7c2009 tempest-VolumeDependencyTests-1189288576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-7ca68623-8e69-48d9-b453-cd62b2c53823.06ebe9cf-3a4f-4ffa-9c31-a0b19099e6a4" returned: 0 in 1.191s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:05:29 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-c84b1e13-aad8-4ada-8b4e-b90d9b7c2009 tempest-VolumeDependencyTests-1189288576 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7ca68623-8e69-48d9-b453-cd62b2c53823(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86639) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 02 20:05:29 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[9485ea6d-295b-4918-bddf-1982fa07789c]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 20:05:29 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-c84b1e13-aad8-4ada-8b4e-b90d9b7c2009 tempest-VolumeDependencyTests-1189288576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-7ca68623-8e69-48d9-b453-cd62b2c53823 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:05:29 devstack sudo[107298]: pam_unix(sudo:session): session closed for user root
Jul 02 20:05:29 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-740cdd84-d9cc-442e-8e18-9a0a57c8c778 tempest-VolumeImageDependencyTests-1452431683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-c945ed08-dc6d-4ee3-a3e3-935325ce22f5" returned: 0 in 1.282s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:05:29 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-740cdd84-d9cc-442e-8e18-9a0a57c8c778 tempest-VolumeImageDependencyTests-1452431683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-c945ed08-dc6d-4ee3-a3e3-935325ce22f5 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:05:29 devstack sudo[107310]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-7ca68623-8e69-48d9-b453-cd62b2c53823
Jul 02 20:05:29 devstack sudo[107310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:05:29 devstack sudo[107302]: pam_unix(sudo:session): session closed for user root
Jul 02 20:05:29 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-7234810e-5468-4ffc-836c-c3844b3d9099 tempest-CreateVolumesFromSnapshotTest-1127395155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-5522fb92-c1a5-4cf1-b383-71c8a54a3b48" returned: 0 in 1.101s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:05:29 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-7234810e-5468-4ffc-836c-c3844b3d9099 tempest-CreateVolumesFromSnapshotTest-1127395155 None] Lock "cinder-quobyte-5522fb92-c1a5-4cf1-b383-71c8a54a3b48" released by "delete_volume" :: held 2.236s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 20:05:29 devstack sudo[107312]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-c945ed08-dc6d-4ee3-a3e3-935325ce22f5
Jul 02 20:05:29 devstack sudo[107312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:05:29 devstack cinder-volume[86639]: DEBUG cinder.quota [None req-7234810e-5468-4ffc-836c-c3844b3d9099 tempest-CreateVolumesFromSnapshotTest-1127395155 None] Created reservations ['3421f9b8-4540-47e3-b2f6-994adc8babf8', 'd106b4b3-af3f-48b9-8228-efa531b7277b', '41f7cd8c-7a17-42c6-8656-c1e82ebb6b0c', 'e5b0094a-3269-41c3-b213-7654fa0e84e9'] {{(pid=86639) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 20:05:29 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-7234810e-5468-4ffc-836c-c3844b3d9099 tempest-CreateVolumesFromSnapshotTest-1127395155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 20:05:29 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-7234810e-5468-4ffc-836c-c3844b3d9099 tempest-CreateVolumesFromSnapshotTest-1127395155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 20:05:29 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-7234810e-5468-4ffc-836c-c3844b3d9099 tempest-CreateVolumesFromSnapshotTest-1127395155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 20:05:29 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-7234810e-5468-4ffc-836c-c3844b3d9099 tempest-CreateVolumesFromSnapshotTest-1127395155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 20:05:29 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-7234810e-5468-4ffc-836c-c3844b3d9099 tempest-CreateVolumesFromSnapshotTest-1127395155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 20:05:29 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-7234810e-5468-4ffc-836c-c3844b3d9099 tempest-CreateVolumesFromSnapshotTest-1127395155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:05:29 devstack sudo[107315]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e
Jul 02 20:05:29 devstack sudo[107315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:05:30 devstack sudo[107310]: pam_unix(sudo:session): session closed for user root
Jul 02 20:05:30 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-c84b1e13-aad8-4ada-8b4e-b90d9b7c2009 tempest-VolumeDependencyTests-1189288576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-7ca68623-8e69-48d9-b453-cd62b2c53823" returned: 0 in 1.005s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:05:30 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-c84b1e13-aad8-4ada-8b4e-b90d9b7c2009 tempest-VolumeDependencyTests-1189288576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-7ca68623-8e69-48d9-b453-cd62b2c53823.06ebe9cf-3a4f-4ffa-9c31-a0b19099e6a4 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:05:30 devstack sudo[107323]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-7ca68623-8e69-48d9-b453-cd62b2c53823.06ebe9cf-3a4f-4ffa-9c31-a0b19099e6a4
Jul 02 20:05:30 devstack sudo[107323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:05:30 devstack sudo[107312]: pam_unix(sudo:session): session closed for user root
Jul 02 20:05:30 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-740cdd84-d9cc-442e-8e18-9a0a57c8c778 tempest-VolumeImageDependencyTests-1452431683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-c945ed08-dc6d-4ee3-a3e3-935325ce22f5" returned: 1 in 1.027s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:05:30 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-740cdd84-d9cc-442e-8e18-9a0a57c8c778 tempest-VolumeImageDependencyTests-1452431683 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-c945ed08-dc6d-4ee3-a3e3-935325ce22f5' failed. Not Retrying. {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 02 20:05:30 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-740cdd84-d9cc-442e-8e18-9a0a57c8c778 tempest-VolumeImageDependencyTests-1452431683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-c945ed08-dc6d-4ee3-a3e3-935325ce22f5 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:05:30 devstack sudo[107326]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-c945ed08-dc6d-4ee3-a3e3-935325ce22f5
Jul 02 20:05:30 devstack sudo[107326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:05:30 devstack sudo[107315]: pam_unix(sudo:session): session closed for user root
Jul 02 20:05:30 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-7234810e-5468-4ffc-836c-c3844b3d9099 tempest-CreateVolumesFromSnapshotTest-1127395155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e" returned: 0 in 0.862s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:05:30 devstack cinder-volume[86639]: DEBUG cinder.manager [None req-7234810e-5468-4ffc-836c-c3844b3d9099 tempest-CreateVolumesFromSnapshotTest-1127395155 None] Notifying Schedulers of capabilities ... {{(pid=86639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 20:05:30 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-7234810e-5468-4ffc-836c-c3844b3d9099 tempest-CreateVolumesFromSnapshotTest-1127395155 None] Deleted volume successfully.
Jul 02 20:05:30 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-7234810e-5468-4ffc-836c-c3844b3d9099 tempest-CreateVolumesFromSnapshotTest-1127395155 None] Lock "cinder-5522fb92-c1a5-4cf1-b383-71c8a54a3b48-delete_volume" released by "delete_volume" :: held 3.412s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 20:05:31 devstack sudo[107323]: pam_unix(sudo:session): session closed for user root
Jul 02 20:05:31 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-c84b1e13-aad8-4ada-8b4e-b90d9b7c2009 tempest-VolumeDependencyTests-1189288576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-7ca68623-8e69-48d9-b453-cd62b2c53823.06ebe9cf-3a4f-4ffa-9c31-a0b19099e6a4" returned: 0 in 1.035s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:05:31 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-c84b1e13-aad8-4ada-8b4e-b90d9b7c2009 tempest-VolumeDependencyTests-1189288576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-7ca68623-8e69-48d9-b453-cd62b2c53823.06ebe9cf-3a4f-4ffa-9c31-a0b19099e6a4 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:05:31 devstack sudo[107332]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-7ca68623-8e69-48d9-b453-cd62b2c53823.06ebe9cf-3a4f-4ffa-9c31-a0b19099e6a4
Jul 02 20:05:31 devstack sudo[107332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:05:31 devstack sudo[107326]: pam_unix(sudo:session): session closed for user root
Jul 02 20:05:31 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-740cdd84-d9cc-442e-8e18-9a0a57c8c778 tempest-VolumeImageDependencyTests-1452431683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-c945ed08-dc6d-4ee3-a3e3-935325ce22f5" returned: 0 in 0.982s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:05:31 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-740cdd84-d9cc-442e-8e18-9a0a57c8c778 tempest-VolumeImageDependencyTests-1452431683 None] Lock "cinder-quobyte-c945ed08-dc6d-4ee3-a3e3-935325ce22f5" released by "delete_volume" :: held 3.373s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 20:05:31 devstack cinder-volume[86639]: DEBUG cinder.quota [None req-740cdd84-d9cc-442e-8e18-9a0a57c8c778 tempest-VolumeImageDependencyTests-1452431683 None] Created reservations ['e7bfb3a4-b575-4c4d-9c19-fda94ca094cb', 'a3db49d5-2f8e-4623-9479-783e060c73ad', 'c1b2c9db-2bac-4ee8-ae8e-4f2818eed39b', '10a69adc-2f35-4f04-81d8-050bf04f7265'] {{(pid=86639) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 20:05:31 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-740cdd84-d9cc-442e-8e18-9a0a57c8c778 tempest-VolumeImageDependencyTests-1452431683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 20:05:31 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-740cdd84-d9cc-442e-8e18-9a0a57c8c778 tempest-VolumeImageDependencyTests-1452431683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 20:05:31 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-740cdd84-d9cc-442e-8e18-9a0a57c8c778 tempest-VolumeImageDependencyTests-1452431683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 20:05:31 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-740cdd84-d9cc-442e-8e18-9a0a57c8c778 tempest-VolumeImageDependencyTests-1452431683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 20:05:31 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-740cdd84-d9cc-442e-8e18-9a0a57c8c778 tempest-VolumeImageDependencyTests-1452431683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 20:05:31 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-740cdd84-d9cc-442e-8e18-9a0a57c8c778 tempest-VolumeImageDependencyTests-1452431683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:05:31 devstack sudo[107334]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e
Jul 02 20:05:31 devstack sudo[107334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:05:32 devstack sudo[107332]: pam_unix(sudo:session): session closed for user root
Jul 02 20:05:32 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-c84b1e13-aad8-4ada-8b4e-b90d9b7c2009 tempest-VolumeDependencyTests-1189288576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-7ca68623-8e69-48d9-b453-cd62b2c53823.06ebe9cf-3a4f-4ffa-9c31-a0b19099e6a4" returned: 0 in 0.928s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:05:32 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-c84b1e13-aad8-4ada-8b4e-b90d9b7c2009 tempest-VolumeDependencyTests-1189288576 None] Lock "cinder-quobyte-06ebe9cf-3a4f-4ffa-9c31-a0b19099e6a4" released by "_delete_snapshot" :: held 4.344s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 20:05:32 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-c84b1e13-aad8-4ada-8b4e-b90d9b7c2009 tempest-VolumeDependencyTests-1189288576 None] Lock "cinder-quobyte-7ca68623-8e69-48d9-b453-cd62b2c53823" released by "delete_snapshot" :: held 4.397s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 20:05:32 devstack cinder-volume[86639]: DEBUG cinder.quota [None req-c84b1e13-aad8-4ada-8b4e-b90d9b7c2009 tempest-VolumeDependencyTests-1189288576 None] Created reservations ['56dcc376-14bb-42e2-b4ec-27148a01ed89', 'ba0ec7db-2f0b-4eb0-9bad-061ac85df633', 'b775c1cb-a03a-4eeb-9245-dd19e56db2f9', 'eb6f22bf-0c43-454c-a64b-36382523d0fd'] {{(pid=86639) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 20:05:32 devstack sudo[107334]: pam_unix(sudo:session): session closed for user root
Jul 02 20:05:32 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-740cdd84-d9cc-442e-8e18-9a0a57c8c778 tempest-VolumeImageDependencyTests-1452431683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e" returned: 0 in 0.946s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:05:32 devstack cinder-volume[86639]: DEBUG cinder.manager [None req-740cdd84-d9cc-442e-8e18-9a0a57c8c778 tempest-VolumeImageDependencyTests-1452431683 None] Notifying Schedulers of capabilities ... {{(pid=86639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 20:05:32 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-740cdd84-d9cc-442e-8e18-9a0a57c8c778 tempest-VolumeImageDependencyTests-1452431683 None] Deleted volume successfully.
Jul 02 20:05:32 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-c84b1e13-aad8-4ada-8b4e-b90d9b7c2009 tempest-VolumeDependencyTests-1189288576 None] Delete snapshot completed successfully.
Jul 02 20:05:32 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-740cdd84-d9cc-442e-8e18-9a0a57c8c778 tempest-VolumeImageDependencyTests-1452431683 None] Lock "cinder-c945ed08-dc6d-4ee3-a3e3-935325ce22f5-delete_volume" released by "delete_volume" :: held 4.724s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 20:05:32 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-c84b1e13-aad8-4ada-8b4e-b90d9b7c2009 tempest-VolumeDependencyTests-1189288576 None] Lock "cinder-06ebe9cf-3a4f-4ffa-9c31-a0b19099e6a4-delete_snapshot" released by "delete_snapshot" :: held 4.757s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 20:05:33 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-03cb3a8f-c6dc-4412-8bd7-6b379cf3cc43 tempest-VolumeDependencyTests-1189288576 None] Acquiring lock "cinder-7ca68623-8e69-48d9-b453-cd62b2c53823-delete_volume" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 20:05:33 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-03cb3a8f-c6dc-4412-8bd7-6b379cf3cc43 tempest-VolumeDependencyTests-1189288576 None] Lock "cinder-7ca68623-8e69-48d9-b453-cd62b2c53823-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 20:05:33 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-03cb3a8f-c6dc-4412-8bd7-6b379cf3cc43 tempest-VolumeDependencyTests-1189288576 None] Acquiring lock "cinder-quobyte-7ca68623-8e69-48d9-b453-cd62b2c53823" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 20:05:33 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-03cb3a8f-c6dc-4412-8bd7-6b379cf3cc43 tempest-VolumeDependencyTests-1189288576 None] Lock "cinder-quobyte-7ca68623-8e69-48d9-b453-cd62b2c53823" acquired by "delete_volume" :: waited 0.017s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 20:05:33 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ac5264a-36b4-48e7-aa80-0405dbc9161f]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 20:05:33 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-03cb3a8f-c6dc-4412-8bd7-6b379cf3cc43 tempest-VolumeDependencyTests-1189288576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-7ca68623-8e69-48d9-b453-cd62b2c53823 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:05:33 devstack sudo[107338]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-7ca68623-8e69-48d9-b453-cd62b2c53823
Jul 02 20:05:33 devstack sudo[107338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:05:34 devstack sudo[107338]: pam_unix(sudo:session): session closed for user root
Jul 02 20:05:34 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-03cb3a8f-c6dc-4412-8bd7-6b379cf3cc43 tempest-VolumeDependencyTests-1189288576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-7ca68623-8e69-48d9-b453-cd62b2c53823" returned: 0 in 1.051s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:05:34 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-03cb3a8f-c6dc-4412-8bd7-6b379cf3cc43 tempest-VolumeDependencyTests-1189288576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-7ca68623-8e69-48d9-b453-cd62b2c53823 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:05:34 devstack sudo[107350]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-7ca68623-8e69-48d9-b453-cd62b2c53823
Jul 02 20:05:34 devstack sudo[107350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:05:35 devstack sudo[107350]: pam_unix(sudo:session): session closed for user root
Jul 02 20:05:35 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-03cb3a8f-c6dc-4412-8bd7-6b379cf3cc43 tempest-VolumeDependencyTests-1189288576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-7ca68623-8e69-48d9-b453-cd62b2c53823" returned: 0 in 0.930s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:05:35 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-03cb3a8f-c6dc-4412-8bd7-6b379cf3cc43 tempest-VolumeDependencyTests-1189288576 None] Lock "cinder-quobyte-7ca68623-8e69-48d9-b453-cd62b2c53823" released by "delete_volume" :: held 2.084s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 20:05:35 devstack cinder-volume[86639]: DEBUG cinder.quota [None req-03cb3a8f-c6dc-4412-8bd7-6b379cf3cc43 tempest-VolumeDependencyTests-1189288576 None] Created reservations ['1cce36a1-603d-41dd-b9d0-20027d24dfd2', 'e6831023-b84b-4a25-91b9-bec29622896a', '1f0f5903-ad56-4cfd-a64f-992135f95ab8', '025211f0-0f3f-4e1f-8146-8a6aea23536a'] {{(pid=86639) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 20:05:35 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-03cb3a8f-c6dc-4412-8bd7-6b379cf3cc43 tempest-VolumeDependencyTests-1189288576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 20:05:35 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-03cb3a8f-c6dc-4412-8bd7-6b379cf3cc43 tempest-VolumeDependencyTests-1189288576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 20:05:35 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-03cb3a8f-c6dc-4412-8bd7-6b379cf3cc43 tempest-VolumeDependencyTests-1189288576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 20:05:35 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-03cb3a8f-c6dc-4412-8bd7-6b379cf3cc43 tempest-VolumeDependencyTests-1189288576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 20:05:35 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-03cb3a8f-c6dc-4412-8bd7-6b379cf3cc43 tempest-VolumeDependencyTests-1189288576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 20:05:35 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-03cb3a8f-c6dc-4412-8bd7-6b379cf3cc43 tempest-VolumeDependencyTests-1189288576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:05:35 devstack sudo[107364]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e
Jul 02 20:05:35 devstack sudo[107364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:05:36 devstack cinder-volume[86639]: DEBUG cinder.volume.flows.manager.create_volume [None req-d1ad4c30-8f27-40b3-9888-b93071ea22a4 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 20:05:36 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-d1ad4c30-8f27-40b3-9888-b93071ea22a4 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Flow 'volume_create_manager' (d8193d36-47e1-40ff-bbd7-fa26ed51f9be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 20:05:36 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-d1ad4c30-8f27-40b3-9888-b93071ea22a4 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72538d5f-d963-4e3e-8577-bcce05378352) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:05:36 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-d1ad4c30-8f27-40b3-9888-b93071ea22a4 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72538d5f-d963-4e3e-8577-bcce05378352) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T18:05:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-913199972',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2314d9a6-9b28-44e7-9bac-9c626e339f46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='434350bb251644f4ab9debad4dd21938',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T18:05:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T18:05:36Z,use_quota=True,user_id='9b95c7d062894089a549492b257319d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:05:36 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-d1ad4c30-8f27-40b3-9888-b93071ea22a4 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43ef5391-3e2b-4388-a7be-81bc0da43bea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:05:36 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-d1ad4c30-8f27-40b3-9888-b93071ea22a4 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43ef5391-3e2b-4388-a7be-81bc0da43bea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:05:36 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-d1ad4c30-8f27-40b3-9888-b93071ea22a4 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2195003e-acca-4dca-9986-84e2747c243f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:05:36 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-d1ad4c30-8f27-40b3-9888-b93071ea22a4 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2195003e-acca-4dca-9986-84e2747c243f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2314d9a6-9b28-44e7-9bac-9c626e339f46', 'volume_name': 'volume-2314d9a6-9b28-44e7-9bac-9c626e339f46', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:05:36 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-d1ad4c30-8f27-40b3-9888-b93071ea22a4 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59d0ff6b-5bd3-4368-bce1-a218ce4db5b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:05:36 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-d1ad4c30-8f27-40b3-9888-b93071ea22a4 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59d0ff6b-5bd3-4368-bce1-a218ce4db5b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:05:36 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-d1ad4c30-8f27-40b3-9888-b93071ea22a4 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81726312-401d-4959-b6cb-008da1c38592) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:05:36 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-d1ad4c30-8f27-40b3-9888-b93071ea22a4 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Volume 2314d9a6-9b28-44e7-9bac-9c626e339f46: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2314d9a6-9b28-44e7-9bac-9c626e339f46', 'volume_size': 1}
Jul 02 20:05:36 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-d1ad4c30-8f27-40b3-9888-b93071ea22a4 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 20:05:36 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-d1ad4c30-8f27-40b3-9888-b93071ea22a4 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 20:05:36 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-d1ad4c30-8f27-40b3-9888-b93071ea22a4 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce906cb830>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T18:05:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-913199972',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2314d9a6-9b28-44e7-9bac-9c626e339f46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='434350bb251644f4ab9debad4dd21938',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T18:05:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T18:05:36Z,use_quota=True,user_id='9b95c7d062894089a549492b257319d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)}" {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 20:05:36 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-d1ad4c30-8f27-40b3-9888-b93071ea22a4 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Creating volume 2314d9a6-9b28-44e7-9bac-9c626e339f46 {{(pid=86639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 20:05:36 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-d1ad4c30-8f27-40b3-9888-b93071ea22a4 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 20:05:36 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-d1ad4c30-8f27-40b3-9888-b93071ea22a4 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 20:05:36 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-d1ad4c30-8f27-40b3-9888-b93071ea22a4 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 20:05:36 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-d1ad4c30-8f27-40b3-9888-b93071ea22a4 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 20:05:36 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-d1ad4c30-8f27-40b3-9888-b93071ea22a4 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 20:05:36 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-d1ad4c30-8f27-40b3-9888-b93071ea22a4 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Selected osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92 as target Quobyte volume. {{(pid=86639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 20:05:36 devstack cinder-volume[86639]: INFO cinder.volume.drivers.remotefs [None req-d1ad4c30-8f27-40b3-9888-b93071ea22a4 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] casted to osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92
Jul 02 20:05:36 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-d1ad4c30-8f27-40b3-9888-b93071ea22a4 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-2314d9a6-9b28-44e7-9bac-9c626e339f46 1073741824 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:05:36 devstack sudo[107389]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-2314d9a6-9b28-44e7-9bac-9c626e339f46 1073741824
Jul 02 20:05:36 devstack sudo[107389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:05:36 devstack sudo[107364]: pam_unix(sudo:session): session closed for user root
Jul 02 20:05:36 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-03cb3a8f-c6dc-4412-8bd7-6b379cf3cc43 tempest-VolumeDependencyTests-1189288576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e" returned: 0 in 0.856s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:05:36 devstack cinder-volume[86639]: DEBUG cinder.manager [None req-03cb3a8f-c6dc-4412-8bd7-6b379cf3cc43 tempest-VolumeDependencyTests-1189288576 None] Notifying Schedulers of capabilities ... {{(pid=86639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 20:05:36 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-03cb3a8f-c6dc-4412-8bd7-6b379cf3cc43 tempest-VolumeDependencyTests-1189288576 None] Deleted volume successfully.
Jul 02 20:05:36 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-03cb3a8f-c6dc-4412-8bd7-6b379cf3cc43 tempest-VolumeDependencyTests-1189288576 None] Lock "cinder-7ca68623-8e69-48d9-b453-cd62b2c53823-delete_volume" released by "delete_volume" :: held 3.342s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 20:05:36 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-73c43db6-06c2-44a7-b008-ea8b8b459779 tempest-VolumeDependencyTests-1189288576 None] Acquiring lock "cinder-a28fa1e1-e63f-46f9-87da-7392cbcf0b02-delete_volume" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 20:05:36 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-73c43db6-06c2-44a7-b008-ea8b8b459779 tempest-VolumeDependencyTests-1189288576 None] Lock "cinder-a28fa1e1-e63f-46f9-87da-7392cbcf0b02-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 20:05:36 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-73c43db6-06c2-44a7-b008-ea8b8b459779 tempest-VolumeDependencyTests-1189288576 None] Acquiring lock "cinder-quobyte-a28fa1e1-e63f-46f9-87da-7392cbcf0b02" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 20:05:37 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-73c43db6-06c2-44a7-b008-ea8b8b459779 tempest-VolumeDependencyTests-1189288576 None] Lock "cinder-quobyte-a28fa1e1-e63f-46f9-87da-7392cbcf0b02" acquired by "delete_volume" :: waited 0.033s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 20:05:37 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2c88674-b6a4-43e9-940a-13d084578321]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 20:05:37 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-73c43db6-06c2-44a7-b008-ea8b8b459779 tempest-VolumeDependencyTests-1189288576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-a28fa1e1-e63f-46f9-87da-7392cbcf0b02 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:05:37 devstack sudo[107397]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-a28fa1e1-e63f-46f9-87da-7392cbcf0b02
Jul 02 20:05:37 devstack sudo[107397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:05:37 devstack sudo[107389]: pam_unix(sudo:session): session closed for user root
Jul 02 20:05:37 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-d1ad4c30-8f27-40b3-9888-b93071ea22a4 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-2314d9a6-9b28-44e7-9bac-9c626e339f46 1073741824" returned: 0 in 1.124s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:05:37 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-d1ad4c30-8f27-40b3-9888-b93071ea22a4 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-2314d9a6-9b28-44e7-9bac-9c626e339f46 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:05:37 devstack sudo[107400]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-2314d9a6-9b28-44e7-9bac-9c626e339f46
Jul 02 20:05:37 devstack sudo[107400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:05:37 devstack sudo[107397]: pam_unix(sudo:session): session closed for user root
Jul 02 20:05:37 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-73c43db6-06c2-44a7-b008-ea8b8b459779 tempest-VolumeDependencyTests-1189288576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-a28fa1e1-e63f-46f9-87da-7392cbcf0b02" returned: 0 in 0.861s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:05:37 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-73c43db6-06c2-44a7-b008-ea8b8b459779 tempest-VolumeDependencyTests-1189288576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-a28fa1e1-e63f-46f9-87da-7392cbcf0b02 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:05:37 devstack sudo[107405]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-a28fa1e1-e63f-46f9-87da-7392cbcf0b02
Jul 02 20:05:37 devstack sudo[107405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:05:38 devstack sudo[107400]: pam_unix(sudo:session): session closed for user root
Jul 02 20:05:38 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-d1ad4c30-8f27-40b3-9888-b93071ea22a4 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-2314d9a6-9b28-44e7-9bac-9c626e339f46" returned: 0 in 0.674s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:05:38 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-d1ad4c30-8f27-40b3-9888-b93071ea22a4 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] <== create_volume: return (1858ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'} {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 20:05:38 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-d1ad4c30-8f27-40b3-9888-b93071ea22a4 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.860s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 20:05:38 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-d1ad4c30-8f27-40b3-9888-b93071ea22a4 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81726312-401d-4959-b6cb-008da1c38592) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2314d9a6-9b28-44e7-9bac-9c626e339f46', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:05:38 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-d1ad4c30-8f27-40b3-9888-b93071ea22a4 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a937a747-1c5d-490a-974e-34c629f31cd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:05:38 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-d1ad4c30-8f27-40b3-9888-b93071ea22a4 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Volume volume-2314d9a6-9b28-44e7-9bac-9c626e339f46 (2314d9a6-9b28-44e7-9bac-9c626e339f46): created successfully
Jul 02 20:05:38 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-d1ad4c30-8f27-40b3-9888-b93071ea22a4 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a937a747-1c5d-490a-974e-34c629f31cd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:05:38 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-d1ad4c30-8f27-40b3-9888-b93071ea22a4 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Flow 'volume_create_manager' (d8193d36-47e1-40ff-bbd7-fa26ed51f9be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 20:05:38 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-d1ad4c30-8f27-40b3-9888-b93071ea22a4 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Created volume successfully.
Jul 02 20:05:38 devstack cinder-volume[86639]: DEBUG cinder.volume.flows.manager.create_volume [None req-bcbb7db2-1ddd-4acd-933e-7b0d5a27c8c5 tempest-SnapshotDependencyTests-1812892589 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 20:05:38 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-bcbb7db2-1ddd-4acd-933e-7b0d5a27c8c5 tempest-SnapshotDependencyTests-1812892589 None] Flow 'volume_create_manager' (223ec272-30e3-498f-a142-f9ccd72dbb22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 20:05:38 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-bcbb7db2-1ddd-4acd-933e-7b0d5a27c8c5 tempest-SnapshotDependencyTests-1812892589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d6771ef-9595-4ad9-beca-833e17c4a4ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:05:38 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-bcbb7db2-1ddd-4acd-933e-7b0d5a27c8c5 tempest-SnapshotDependencyTests-1812892589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d6771ef-9595-4ad9-beca-833e17c4a4ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T18:05:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1331163669',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82e9bd09-ba4f-4614-b846-f65124c763cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77eb2bff3c1f409fac86fad69a0f4c81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T18:05:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T18:05:38Z,use_quota=True,user_id='05ed2ca5bda34404bf65815bd47e83c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:05:38 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-bcbb7db2-1ddd-4acd-933e-7b0d5a27c8c5 tempest-SnapshotDependencyTests-1812892589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aaf6d72b-d56d-44dc-8e69-a157a5439f7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:05:38 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-bcbb7db2-1ddd-4acd-933e-7b0d5a27c8c5 tempest-SnapshotDependencyTests-1812892589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aaf6d72b-d56d-44dc-8e69-a157a5439f7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:05:38 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-bcbb7db2-1ddd-4acd-933e-7b0d5a27c8c5 tempest-SnapshotDependencyTests-1812892589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (265980d6-de1d-4cb7-bae8-9fd04244901e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:05:38 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-bcbb7db2-1ddd-4acd-933e-7b0d5a27c8c5 tempest-SnapshotDependencyTests-1812892589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (265980d6-de1d-4cb7-bae8-9fd04244901e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '82e9bd09-ba4f-4614-b846-f65124c763cc', 'volume_name': 'volume-82e9bd09-ba4f-4614-b846-f65124c763cc', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:05:38 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-bcbb7db2-1ddd-4acd-933e-7b0d5a27c8c5 tempest-SnapshotDependencyTests-1812892589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98dbe9f0-3a35-4946-8d9c-86a86bd0120f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:05:38 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-bcbb7db2-1ddd-4acd-933e-7b0d5a27c8c5 tempest-SnapshotDependencyTests-1812892589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98dbe9f0-3a35-4946-8d9c-86a86bd0120f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:05:38 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-bcbb7db2-1ddd-4acd-933e-7b0d5a27c8c5 tempest-SnapshotDependencyTests-1812892589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (daaff5a2-97e7-4897-b392-2f3f79cbddfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:05:38 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-bcbb7db2-1ddd-4acd-933e-7b0d5a27c8c5 tempest-SnapshotDependencyTests-1812892589 None] Volume 82e9bd09-ba4f-4614-b846-f65124c763cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-82e9bd09-ba4f-4614-b846-f65124c763cc', 'volume_size': 1}
Jul 02 20:05:38 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-bcbb7db2-1ddd-4acd-933e-7b0d5a27c8c5 tempest-SnapshotDependencyTests-1812892589 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 20:05:38 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-bcbb7db2-1ddd-4acd-933e-7b0d5a27c8c5 tempest-SnapshotDependencyTests-1812892589 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 20:05:38 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-bcbb7db2-1ddd-4acd-933e-7b0d5a27c8c5 tempest-SnapshotDependencyTests-1812892589 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce906cb830>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T18:05:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1331163669',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82e9bd09-ba4f-4614-b846-f65124c763cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77eb2bff3c1f409fac86fad69a0f4c81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T18:05:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T18:05:38Z,use_quota=True,user_id='05ed2ca5bda34404bf65815bd47e83c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)}" {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 20:05:38 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-bcbb7db2-1ddd-4acd-933e-7b0d5a27c8c5 tempest-SnapshotDependencyTests-1812892589 None] Creating volume 82e9bd09-ba4f-4614-b846-f65124c763cc {{(pid=86639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 20:05:38 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-bcbb7db2-1ddd-4acd-933e-7b0d5a27c8c5 tempest-SnapshotDependencyTests-1812892589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 20:05:38 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-bcbb7db2-1ddd-4acd-933e-7b0d5a27c8c5 tempest-SnapshotDependencyTests-1812892589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 20:05:38 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-bcbb7db2-1ddd-4acd-933e-7b0d5a27c8c5 tempest-SnapshotDependencyTests-1812892589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 20:05:38 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-bcbb7db2-1ddd-4acd-933e-7b0d5a27c8c5 tempest-SnapshotDependencyTests-1812892589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 20:05:38 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-bcbb7db2-1ddd-4acd-933e-7b0d5a27c8c5 tempest-SnapshotDependencyTests-1812892589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 20:05:38 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-bcbb7db2-1ddd-4acd-933e-7b0d5a27c8c5 tempest-SnapshotDependencyTests-1812892589 None] Selected osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92 as target Quobyte volume. {{(pid=86639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 20:05:38 devstack cinder-volume[86639]: INFO cinder.volume.drivers.remotefs [None req-bcbb7db2-1ddd-4acd-933e-7b0d5a27c8c5 tempest-SnapshotDependencyTests-1812892589 None] casted to osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92
Jul 02 20:05:38 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-bcbb7db2-1ddd-4acd-933e-7b0d5a27c8c5 tempest-SnapshotDependencyTests-1812892589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-82e9bd09-ba4f-4614-b846-f65124c763cc 1073741824 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:05:38 devstack sudo[107408]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-82e9bd09-ba4f-4614-b846-f65124c763cc 1073741824
Jul 02 20:05:38 devstack sudo[107408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:05:38 devstack sudo[107405]: pam_unix(sudo:session): session closed for user root
Jul 02 20:05:38 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-73c43db6-06c2-44a7-b008-ea8b8b459779 tempest-VolumeDependencyTests-1189288576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-a28fa1e1-e63f-46f9-87da-7392cbcf0b02" returned: 0 in 0.691s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:05:38 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-73c43db6-06c2-44a7-b008-ea8b8b459779 tempest-VolumeDependencyTests-1189288576 None] Lock "cinder-quobyte-a28fa1e1-e63f-46f9-87da-7392cbcf0b02" released by "delete_volume" :: held 1.616s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 20:05:38 devstack cinder-volume[86639]: DEBUG cinder.quota [None req-73c43db6-06c2-44a7-b008-ea8b8b459779 tempest-VolumeDependencyTests-1189288576 None] Created reservations ['2987314f-0513-4409-a26f-c4815639c75d', '45ad9e6b-cd45-4b3f-a904-4074cf107231', '76eba58b-e6fd-4b14-b7ad-9bc1ebc86a21', 'e898b43a-6020-4036-a49b-f9029ffa7cd6'] {{(pid=86639) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 20:05:38 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-73c43db6-06c2-44a7-b008-ea8b8b459779 tempest-VolumeDependencyTests-1189288576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 20:05:38 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-73c43db6-06c2-44a7-b008-ea8b8b459779 tempest-VolumeDependencyTests-1189288576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 20:05:38 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-73c43db6-06c2-44a7-b008-ea8b8b459779 tempest-VolumeDependencyTests-1189288576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 20:05:38 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-73c43db6-06c2-44a7-b008-ea8b8b459779 tempest-VolumeDependencyTests-1189288576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 20:05:38 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-73c43db6-06c2-44a7-b008-ea8b8b459779 tempest-VolumeDependencyTests-1189288576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 20:05:38 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-73c43db6-06c2-44a7-b008-ea8b8b459779 tempest-VolumeDependencyTests-1189288576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:05:38 devstack sudo[107411]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e
Jul 02 20:05:38 devstack sudo[107411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:05:39 devstack sudo[107411]: pam_unix(sudo:session): session closed for user root
Jul 02 20:05:39 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-73c43db6-06c2-44a7-b008-ea8b8b459779 tempest-VolumeDependencyTests-1189288576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e" returned: 0 in 0.699s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:05:39 devstack cinder-volume[86639]: DEBUG cinder.manager [None req-73c43db6-06c2-44a7-b008-ea8b8b459779 tempest-VolumeDependencyTests-1189288576 None] Notifying Schedulers of capabilities ... {{(pid=86639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 20:05:39 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-73c43db6-06c2-44a7-b008-ea8b8b459779 tempest-VolumeDependencyTests-1189288576 None] Deleted volume successfully.
Jul 02 20:05:39 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-73c43db6-06c2-44a7-b008-ea8b8b459779 tempest-VolumeDependencyTests-1189288576 None] Lock "cinder-a28fa1e1-e63f-46f9-87da-7392cbcf0b02-delete_volume" released by "delete_volume" :: held 2.682s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 20:05:39 devstack sudo[107408]: pam_unix(sudo:session): session closed for user root
Jul 02 20:05:39 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-bcbb7db2-1ddd-4acd-933e-7b0d5a27c8c5 tempest-SnapshotDependencyTests-1812892589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-82e9bd09-ba4f-4614-b846-f65124c763cc 1073741824" returned: 0 in 1.011s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:05:39 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-bcbb7db2-1ddd-4acd-933e-7b0d5a27c8c5 tempest-SnapshotDependencyTests-1812892589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-82e9bd09-ba4f-4614-b846-f65124c763cc {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:05:39 devstack sudo[107419]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-82e9bd09-ba4f-4614-b846-f65124c763cc
Jul 02 20:05:39 devstack sudo[107419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:05:39 devstack cinder-volume[86639]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7309ef6-1595-4775-b202-0f0ea5001d10 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 20:05:39 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-e7309ef6-1595-4775-b202-0f0ea5001d10 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Flow 'volume_create_manager' (9df9f5d0-d89f-41a4-86bb-c0dad61fd3cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 20:05:39 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-e7309ef6-1595-4775-b202-0f0ea5001d10 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7aefc61b-3183-4a55-89a7-7a7490299c05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:05:39 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-e7309ef6-1595-4775-b202-0f0ea5001d10 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7aefc61b-3183-4a55-89a7-7a7490299c05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T18:05:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-770493636',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4592a50c-2293-4689-843d-fd81094cd74e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='434350bb251644f4ab9debad4dd21938',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T18:05:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T18:05:40Z,use_quota=True,user_id='9b95c7d062894089a549492b257319d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:05:39 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-e7309ef6-1595-4775-b202-0f0ea5001d10 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23702d55-4cf6-46f5-8ceb-c4fa50e55345) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:05:39 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-e7309ef6-1595-4775-b202-0f0ea5001d10 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23702d55-4cf6-46f5-8ceb-c4fa50e55345) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:05:39 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-e7309ef6-1595-4775-b202-0f0ea5001d10 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23ea75a6-f42c-40c6-8608-4c2c223a3271) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:05:39 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-e7309ef6-1595-4775-b202-0f0ea5001d10 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23ea75a6-f42c-40c6-8608-4c2c223a3271) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4592a50c-2293-4689-843d-fd81094cd74e', 'volume_name': 'volume-4592a50c-2293-4689-843d-fd81094cd74e', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:05:39 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-e7309ef6-1595-4775-b202-0f0ea5001d10 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f7958c4-d9b3-4119-8fb4-209b96cdbe3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:05:39 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-e7309ef6-1595-4775-b202-0f0ea5001d10 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f7958c4-d9b3-4119-8fb4-209b96cdbe3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:05:39 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-e7309ef6-1595-4775-b202-0f0ea5001d10 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7234b64-cbb9-4bcd-b4ca-bb1f5c72e44c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:05:39 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-e7309ef6-1595-4775-b202-0f0ea5001d10 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Volume 4592a50c-2293-4689-843d-fd81094cd74e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4592a50c-2293-4689-843d-fd81094cd74e', 'volume_size': 1}
Jul 02 20:05:39 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-e7309ef6-1595-4775-b202-0f0ea5001d10 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 20:05:40 devstack cinder-volume[86639]: DEBUG cinder.volume.flows.manager.create_volume [None req-057a3c00-3054-44f4-8209-cc0db4309433 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 20:05:40 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-057a3c00-3054-44f4-8209-cc0db4309433 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Flow 'volume_create_manager' (25b13cc7-7140-45aa-820f-7a909f6c7189) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 20:05:40 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-057a3c00-3054-44f4-8209-cc0db4309433 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b34018df-a9aa-495c-8981-c484e52171b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:05:40 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-057a3c00-3054-44f4-8209-cc0db4309433 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b34018df-a9aa-495c-8981-c484e52171b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T18:05:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1553946402',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44257549-66f0-4b08-aa0f-24f2dddaba57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='434350bb251644f4ab9debad4dd21938',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T18:05:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T18:05:40Z,use_quota=True,user_id='9b95c7d062894089a549492b257319d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:05:40 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-057a3c00-3054-44f4-8209-cc0db4309433 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d73b548c-c8c1-4eb6-8b28-6d0e72829fc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:05:40 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-057a3c00-3054-44f4-8209-cc0db4309433 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d73b548c-c8c1-4eb6-8b28-6d0e72829fc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:05:40 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-057a3c00-3054-44f4-8209-cc0db4309433 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8402c367-ad5c-49d5-9cb9-d91756a3cf1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:05:40 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-057a3c00-3054-44f4-8209-cc0db4309433 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8402c367-ad5c-49d5-9cb9-d91756a3cf1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '44257549-66f0-4b08-aa0f-24f2dddaba57', 'volume_name': 'volume-44257549-66f0-4b08-aa0f-24f2dddaba57', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:05:40 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-057a3c00-3054-44f4-8209-cc0db4309433 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ecc94d1-e9ca-4c4a-a8bd-87adcdf26d74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:05:40 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-057a3c00-3054-44f4-8209-cc0db4309433 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ecc94d1-e9ca-4c4a-a8bd-87adcdf26d74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:05:40 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-057a3c00-3054-44f4-8209-cc0db4309433 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7d14c24-26fd-47cd-a360-faeefb6ff77d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:05:40 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-057a3c00-3054-44f4-8209-cc0db4309433 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Volume 44257549-66f0-4b08-aa0f-24f2dddaba57: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-44257549-66f0-4b08-aa0f-24f2dddaba57', 'volume_size': 1}
Jul 02 20:05:40 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-057a3c00-3054-44f4-8209-cc0db4309433 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 20:05:40 devstack sudo[107419]: pam_unix(sudo:session): session closed for user root
Jul 02 20:05:40 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-bcbb7db2-1ddd-4acd-933e-7b0d5a27c8c5 tempest-SnapshotDependencyTests-1812892589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-82e9bd09-ba4f-4614-b846-f65124c763cc" returned: 0 in 0.993s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:05:40 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-bcbb7db2-1ddd-4acd-933e-7b0d5a27c8c5 tempest-SnapshotDependencyTests-1812892589 None] <== create_volume: return (2056ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'} {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 20:05:40 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-bcbb7db2-1ddd-4acd-933e-7b0d5a27c8c5 tempest-SnapshotDependencyTests-1812892589 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.058s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 20:05:40 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-e7309ef6-1595-4775-b202-0f0ea5001d10 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.638s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 20:05:40 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-e7309ef6-1595-4775-b202-0f0ea5001d10 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce906cb830>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T18:05:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-770493636',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4592a50c-2293-4689-843d-fd81094cd74e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='434350bb251644f4ab9debad4dd21938',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T18:05:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T18:05:40Z,use_quota=True,user_id='9b95c7d062894089a549492b257319d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)}" {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 20:05:40 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-e7309ef6-1595-4775-b202-0f0ea5001d10 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Creating volume 4592a50c-2293-4689-843d-fd81094cd74e {{(pid=86639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 20:05:40 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-e7309ef6-1595-4775-b202-0f0ea5001d10 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 20:05:40 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-e7309ef6-1595-4775-b202-0f0ea5001d10 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 20:05:40 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-e7309ef6-1595-4775-b202-0f0ea5001d10 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 20:05:40 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-e7309ef6-1595-4775-b202-0f0ea5001d10 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 20:05:40 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-e7309ef6-1595-4775-b202-0f0ea5001d10 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 20:05:40 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-e7309ef6-1595-4775-b202-0f0ea5001d10 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Selected osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92 as target Quobyte volume. {{(pid=86639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 20:05:40 devstack cinder-volume[86639]: INFO cinder.volume.drivers.remotefs [None req-e7309ef6-1595-4775-b202-0f0ea5001d10 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] casted to osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92
Jul 02 20:05:40 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-e7309ef6-1595-4775-b202-0f0ea5001d10 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-4592a50c-2293-4689-843d-fd81094cd74e 1073741824 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:05:40 devstack sudo[107422]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-4592a50c-2293-4689-843d-fd81094cd74e 1073741824
Jul 02 20:05:40 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-bcbb7db2-1ddd-4acd-933e-7b0d5a27c8c5 tempest-SnapshotDependencyTests-1812892589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (daaff5a2-97e7-4897-b392-2f3f79cbddfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82e9bd09-ba4f-4614-b846-f65124c763cc', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:05:40 devstack sudo[107422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:05:40 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-bcbb7db2-1ddd-4acd-933e-7b0d5a27c8c5 tempest-SnapshotDependencyTests-1812892589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3ef9e3b-d9c7-471c-86f4-316b8242ba38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:05:40 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-bcbb7db2-1ddd-4acd-933e-7b0d5a27c8c5 tempest-SnapshotDependencyTests-1812892589 None] Volume volume-82e9bd09-ba4f-4614-b846-f65124c763cc (82e9bd09-ba4f-4614-b846-f65124c763cc): created successfully
Jul 02 20:05:40 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-bcbb7db2-1ddd-4acd-933e-7b0d5a27c8c5 tempest-SnapshotDependencyTests-1812892589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3ef9e3b-d9c7-471c-86f4-316b8242ba38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:05:40 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-bcbb7db2-1ddd-4acd-933e-7b0d5a27c8c5 tempest-SnapshotDependencyTests-1812892589 None] Flow 'volume_create_manager' (223ec272-30e3-498f-a142-f9ccd72dbb22) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 20:05:40 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-bcbb7db2-1ddd-4acd-933e-7b0d5a27c8c5 tempest-SnapshotDependencyTests-1812892589 None] Created volume successfully.
Jul 02 20:05:40 devstack cinder-volume[86639]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5080f92-8923-4460-a5fb-95bd878d4864 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 20:05:40 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-a5080f92-8923-4460-a5fb-95bd878d4864 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Flow 'volume_create_manager' (89a266e6-024f-4f09-9305-4250554986ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 20:05:40 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-a5080f92-8923-4460-a5fb-95bd878d4864 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f00a30f5-757a-4b5f-8c8b-8cd8cf500c10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:05:40 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-a5080f92-8923-4460-a5fb-95bd878d4864 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f00a30f5-757a-4b5f-8c8b-8cd8cf500c10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T18:05:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1712379836',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28721af2-f9fe-4fa2-85a3-5ededcc6b8ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='434350bb251644f4ab9debad4dd21938',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T18:05:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T18:05:41Z,use_quota=True,user_id='9b95c7d062894089a549492b257319d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:05:40 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-a5080f92-8923-4460-a5fb-95bd878d4864 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbbbf7ca-5b5b-4565-a5a7-4ae19cd004f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:05:40 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-a5080f92-8923-4460-a5fb-95bd878d4864 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbbbf7ca-5b5b-4565-a5a7-4ae19cd004f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:05:40 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-a5080f92-8923-4460-a5fb-95bd878d4864 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7b35702-e4b5-48d7-9759-494009fb803d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:05:40 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-a5080f92-8923-4460-a5fb-95bd878d4864 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7b35702-e4b5-48d7-9759-494009fb803d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '28721af2-f9fe-4fa2-85a3-5ededcc6b8ca', 'volume_name': 'volume-28721af2-f9fe-4fa2-85a3-5ededcc6b8ca', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:05:40 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-a5080f92-8923-4460-a5fb-95bd878d4864 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (070bcf01-fdb0-40c0-8e32-04b5bdc17bec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:05:40 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-a5080f92-8923-4460-a5fb-95bd878d4864 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (070bcf01-fdb0-40c0-8e32-04b5bdc17bec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:05:40 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-a5080f92-8923-4460-a5fb-95bd878d4864 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12ff2532-ff69-443c-8771-082beeaa6f2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:05:40 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-a5080f92-8923-4460-a5fb-95bd878d4864 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Volume 28721af2-f9fe-4fa2-85a3-5ededcc6b8ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-28721af2-f9fe-4fa2-85a3-5ededcc6b8ca', 'volume_size': 1}
Jul 02 20:05:40 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-a5080f92-8923-4460-a5fb-95bd878d4864 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 20:05:41 devstack cinder-volume[86639]: DEBUG cinder.volume.flows.manager.create_volume [None req-39580450-bbc6-4a3b-9830-b44acd88f3e1 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 20:05:41 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-39580450-bbc6-4a3b-9830-b44acd88f3e1 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Flow 'volume_create_manager' (e3ddabf8-c596-439e-a776-2f412a58a477) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 20:05:41 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-39580450-bbc6-4a3b-9830-b44acd88f3e1 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd290e50-cda0-4ffc-860f-b2bba362533b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:05:41 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-39580450-bbc6-4a3b-9830-b44acd88f3e1 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd290e50-cda0-4ffc-860f-b2bba362533b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T18:05:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1575835054',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bde1de1b-2b05-44ff-a8ee-801b931db50b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='434350bb251644f4ab9debad4dd21938',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T18:05:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T18:05:41Z,use_quota=True,user_id='9b95c7d062894089a549492b257319d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:05:41 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-39580450-bbc6-4a3b-9830-b44acd88f3e1 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83713b9d-a997-4a85-afd9-5c6a53a8557c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:05:41 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-39580450-bbc6-4a3b-9830-b44acd88f3e1 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83713b9d-a997-4a85-afd9-5c6a53a8557c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:05:41 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-39580450-bbc6-4a3b-9830-b44acd88f3e1 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97877245-670c-44dd-96e0-2308e427bebd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:05:41 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-39580450-bbc6-4a3b-9830-b44acd88f3e1 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97877245-670c-44dd-96e0-2308e427bebd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bde1de1b-2b05-44ff-a8ee-801b931db50b', 'volume_name': 'volume-bde1de1b-2b05-44ff-a8ee-801b931db50b', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:05:41 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-39580450-bbc6-4a3b-9830-b44acd88f3e1 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84eb8a2b-46b0-41af-8f58-4490791872e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:05:41 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-39580450-bbc6-4a3b-9830-b44acd88f3e1 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84eb8a2b-46b0-41af-8f58-4490791872e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:05:41 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-39580450-bbc6-4a3b-9830-b44acd88f3e1 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80d6a085-9954-48cf-a4d1-13ef34a0f2a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:05:41 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-39580450-bbc6-4a3b-9830-b44acd88f3e1 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Volume bde1de1b-2b05-44ff-a8ee-801b931db50b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bde1de1b-2b05-44ff-a8ee-801b931db50b', 'volume_size': 1}
Jul 02 20:05:41 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-39580450-bbc6-4a3b-9830-b44acd88f3e1 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 20:05:41 devstack cinder-volume[86639]: DEBUG oslo_service.periodic_task [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86639) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 02 20:05:41 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 20:05:41 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 20:05:41 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 20:05:41 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 20:05:41 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 20:05:41 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:05:41 devstack sudo[107427]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e
Jul 02 20:05:41 devstack sudo[107427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:05:41 devstack cinder-volume[86639]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd30c62b-a4e4-4e3a-94b8-e7c825d59f79 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 20:05:41 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-bd30c62b-a4e4-4e3a-94b8-e7c825d59f79 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Flow 'volume_create_manager' (b729f9ee-e2ec-4c4a-b82b-018cde4a7a24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 20:05:41 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-bd30c62b-a4e4-4e3a-94b8-e7c825d59f79 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a97559c-cfcb-4858-9dc8-e7a9ce9ad844) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:05:41 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-bd30c62b-a4e4-4e3a-94b8-e7c825d59f79 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a97559c-cfcb-4858-9dc8-e7a9ce9ad844) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T18:05:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1075179337',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a48f1ecc-6b08-4273-a738-ad65c996f331,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='434350bb251644f4ab9debad4dd21938',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T18:05:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T18:05:42Z,use_quota=True,user_id='9b95c7d062894089a549492b257319d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:05:41 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-bd30c62b-a4e4-4e3a-94b8-e7c825d59f79 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0742066-a062-484a-9ecd-7783ffb2dac1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:05:41 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-bd30c62b-a4e4-4e3a-94b8-e7c825d59f79 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0742066-a062-484a-9ecd-7783ffb2dac1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:05:41 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-bd30c62b-a4e4-4e3a-94b8-e7c825d59f79 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7b9d5cc-33b2-43fe-8f1e-c0a233cc0811) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:05:41 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-bd30c62b-a4e4-4e3a-94b8-e7c825d59f79 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7b9d5cc-33b2-43fe-8f1e-c0a233cc0811) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a48f1ecc-6b08-4273-a738-ad65c996f331', 'volume_name': 'volume-a48f1ecc-6b08-4273-a738-ad65c996f331', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:05:41 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-bd30c62b-a4e4-4e3a-94b8-e7c825d59f79 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2dca939c-d6d9-40df-a4ed-50b13aeb60a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:05:41 devstack sudo[107422]: pam_unix(sudo:session): session closed for user root
Jul 02 20:05:41 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-bd30c62b-a4e4-4e3a-94b8-e7c825d59f79 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2dca939c-d6d9-40df-a4ed-50b13aeb60a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:05:41 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-bd30c62b-a4e4-4e3a-94b8-e7c825d59f79 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1689a7cd-0ed6-4b2d-b881-f56a7939c69b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:05:41 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-bd30c62b-a4e4-4e3a-94b8-e7c825d59f79 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Volume a48f1ecc-6b08-4273-a738-ad65c996f331: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a48f1ecc-6b08-4273-a738-ad65c996f331', 'volume_size': 1}
Jul 02 20:05:41 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-bd30c62b-a4e4-4e3a-94b8-e7c825d59f79 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 20:05:41 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-e7309ef6-1595-4775-b202-0f0ea5001d10 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-4592a50c-2293-4689-843d-fd81094cd74e 1073741824" returned: 0 in 1.162s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:05:41 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-e7309ef6-1595-4775-b202-0f0ea5001d10 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-4592a50c-2293-4689-843d-fd81094cd74e {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:05:41 devstack sudo[107429]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-4592a50c-2293-4689-843d-fd81094cd74e
Jul 02 20:05:41 devstack sudo[107429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:05:41 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-2bc364da-153f-4158-9c27-67200d187a99 tempest-SnapshotDependencyTests-1812892589 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 20:05:42 devstack sudo[107427]: pam_unix(sudo:session): session closed for user root
Jul 02 20:05:42 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e" returned: 0 in 0.737s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:05:42 devstack cinder-volume[86639]: DEBUG cinder.manager [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] Notifying Schedulers of capabilities ... {{(pid=86639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 20:05:42 devstack cinder-volume[86639]: DEBUG oslo_service.periodic_task [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] Running periodic task VolumeManager._thread_info {{(pid=86639) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 02 20:05:42 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] thread count: 28 {{(pid=86639) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 02 20:05:42 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-bf52d689-8ed5-4cdf-a30c-b794de79afc6 None None] thread info: [<_MainThread(MainThread, started 140525261275264)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 140525150678016)>, <Thread(Thread-3 (stat_writer), started daemon 140525150025920)>, <Thread(Rabbit-heartbeat, started daemon 140525150500864)>, <Thread(Thread-5 (_runner), started daemon 140525149847296)>, <Thread(Thread-7 (_runner), started daemon 140525149863424)>, <Thread(fd_logger, started daemon 140525146589376)>, <Thread(privsep_reader, started daemon 140525144562432)>, <Thread(tpool_thread_0, started daemon 140525137151680)>, <Thread(tpool_thread_1, started daemon 140525128758976)>, <Thread(tpool_thread_2, started daemon 140525120349888)>, <Thread(tpool_thread_3, started daemon 140525111940800)>, <Thread(tpool_thread_4, started daemon 140525103531712)>, <Thread(tpool_thread_5, started daemon 140525095122624)>, <Thread(tpool_thread_6, started daemon 140525086713536)>, <Thread(tpool_thread_7, started daemon 140525078304448)>, <Thread(tpool_thread_8, started daemon 140525069895360)>, <Thread(tpool_thread_9, started daemon 140525061486272)>, <Thread(tpool_thread_10, started daemon 140525053077184)>, <Thread(tpool_thread_11, started daemon 140525044668096)>, <Thread(tpool_thread_12, started daemon 140525036259008)>, <Thread(tpool_thread_13, started daemon 140525027849920)>, <Thread(tpool_thread_14, started daemon 140525019440832)>, <Thread(tpool_thread_15, started daemon 140525011031744)>, <Thread(tpool_thread_16, started daemon 140525002622656)>, <Thread(tpool_thread_17, started daemon 140524994213568)>, <Thread(tpool_thread_18, started daemon 140524985804480)>, <Thread(tpool_thread_19, started daemon 140524977395392)>] {{(pid=86639) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 02 20:05:42 devstack sudo[107429]: pam_unix(sudo:session): session closed for user root
Jul 02 20:05:42 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-e7309ef6-1595-4775-b202-0f0ea5001d10 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-4592a50c-2293-4689-843d-fd81094cd74e" returned: 0 in 0.671s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:05:42 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-e7309ef6-1595-4775-b202-0f0ea5001d10 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] <== create_volume: return (1888ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'} {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 20:05:42 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-e7309ef6-1595-4775-b202-0f0ea5001d10 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.895s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 20:05:42 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-057a3c00-3054-44f4-8209-cc0db4309433 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.169s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 20:05:42 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-057a3c00-3054-44f4-8209-cc0db4309433 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce906cb830>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T18:05:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1553946402',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44257549-66f0-4b08-aa0f-24f2dddaba57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='434350bb251644f4ab9debad4dd21938',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T18:05:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T18:05:40Z,use_quota=True,user_id='9b95c7d062894089a549492b257319d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)}" {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 20:05:42 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-057a3c00-3054-44f4-8209-cc0db4309433 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Creating volume 44257549-66f0-4b08-aa0f-24f2dddaba57 {{(pid=86639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 20:05:42 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-057a3c00-3054-44f4-8209-cc0db4309433 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 20:05:42 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-057a3c00-3054-44f4-8209-cc0db4309433 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 20:05:42 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-057a3c00-3054-44f4-8209-cc0db4309433 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 20:05:42 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-057a3c00-3054-44f4-8209-cc0db4309433 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 20:05:42 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-057a3c00-3054-44f4-8209-cc0db4309433 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 20:05:42 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-057a3c00-3054-44f4-8209-cc0db4309433 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Selected osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92 as target Quobyte volume. {{(pid=86639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 20:05:42 devstack cinder-volume[86639]: INFO cinder.volume.drivers.remotefs [None req-057a3c00-3054-44f4-8209-cc0db4309433 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] casted to osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92
Jul 02 20:05:42 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-057a3c00-3054-44f4-8209-cc0db4309433 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-44257549-66f0-4b08-aa0f-24f2dddaba57 1073741824 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:05:42 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-e7309ef6-1595-4775-b202-0f0ea5001d10 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7234b64-cbb9-4bcd-b4ca-bb1f5c72e44c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4592a50c-2293-4689-843d-fd81094cd74e', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:05:42 devstack sudo[107434]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-44257549-66f0-4b08-aa0f-24f2dddaba57 1073741824
Jul 02 20:05:42 devstack sudo[107434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:05:42 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-e7309ef6-1595-4775-b202-0f0ea5001d10 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6e322b5-2934-4439-bd61-b592bc4307f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:05:42 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-e7309ef6-1595-4775-b202-0f0ea5001d10 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Volume volume-4592a50c-2293-4689-843d-fd81094cd74e (4592a50c-2293-4689-843d-fd81094cd74e): created successfully
Jul 02 20:05:42 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-e7309ef6-1595-4775-b202-0f0ea5001d10 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6e322b5-2934-4439-bd61-b592bc4307f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:05:42 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-e7309ef6-1595-4775-b202-0f0ea5001d10 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Flow 'volume_create_manager' (9df9f5d0-d89f-41a4-86bb-c0dad61fd3cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 20:05:42 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-e7309ef6-1595-4775-b202-0f0ea5001d10 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Created volume successfully.
Jul 02 20:05:43 devstack sudo[107434]: pam_unix(sudo:session): session closed for user root
Jul 02 20:05:43 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-057a3c00-3054-44f4-8209-cc0db4309433 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-44257549-66f0-4b08-aa0f-24f2dddaba57 1073741824" returned: 0 in 0.824s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:05:43 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-057a3c00-3054-44f4-8209-cc0db4309433 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-44257549-66f0-4b08-aa0f-24f2dddaba57 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:05:43 devstack sudo[107440]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-44257549-66f0-4b08-aa0f-24f2dddaba57
Jul 02 20:05:43 devstack sudo[107440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:05:43 devstack sudo[107440]: pam_unix(sudo:session): session closed for user root
Jul 02 20:05:43 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-057a3c00-3054-44f4-8209-cc0db4309433 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-44257549-66f0-4b08-aa0f-24f2dddaba57" returned: 0 in 0.661s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:05:43 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-057a3c00-3054-44f4-8209-cc0db4309433 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] <== create_volume: return (1529ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'} {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 20:05:43 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-057a3c00-3054-44f4-8209-cc0db4309433 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.533s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 20:05:43 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-a5080f92-8923-4460-a5fb-95bd878d4864 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.195s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 20:05:43 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-a5080f92-8923-4460-a5fb-95bd878d4864 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce906cb830>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T18:05:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1712379836',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28721af2-f9fe-4fa2-85a3-5ededcc6b8ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='434350bb251644f4ab9debad4dd21938',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T18:05:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T18:05:41Z,use_quota=True,user_id='9b95c7d062894089a549492b257319d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)}" {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 20:05:43 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-a5080f92-8923-4460-a5fb-95bd878d4864 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Creating volume 28721af2-f9fe-4fa2-85a3-5ededcc6b8ca {{(pid=86639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 20:05:43 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-a5080f92-8923-4460-a5fb-95bd878d4864 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 20:05:43 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-a5080f92-8923-4460-a5fb-95bd878d4864 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 20:05:43 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-a5080f92-8923-4460-a5fb-95bd878d4864 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 20:05:43 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-a5080f92-8923-4460-a5fb-95bd878d4864 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 20:05:43 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-a5080f92-8923-4460-a5fb-95bd878d4864 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 20:05:43 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-a5080f92-8923-4460-a5fb-95bd878d4864 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Selected osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92 as target Quobyte volume. {{(pid=86639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 20:05:43 devstack cinder-volume[86639]: INFO cinder.volume.drivers.remotefs [None req-a5080f92-8923-4460-a5fb-95bd878d4864 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] casted to osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92
Jul 02 20:05:43 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-a5080f92-8923-4460-a5fb-95bd878d4864 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-28721af2-f9fe-4fa2-85a3-5ededcc6b8ca 1073741824 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:05:44 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-057a3c00-3054-44f4-8209-cc0db4309433 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7d14c24-26fd-47cd-a360-faeefb6ff77d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44257549-66f0-4b08-aa0f-24f2dddaba57', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:05:44 devstack sudo[107443]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-28721af2-f9fe-4fa2-85a3-5ededcc6b8ca 1073741824
Jul 02 20:05:44 devstack sudo[107443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:05:44 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-057a3c00-3054-44f4-8209-cc0db4309433 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e16db19-ac67-4d4f-8ac8-3e8788bd2ab3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:05:44 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-057a3c00-3054-44f4-8209-cc0db4309433 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Volume volume-44257549-66f0-4b08-aa0f-24f2dddaba57 (44257549-66f0-4b08-aa0f-24f2dddaba57): created successfully
Jul 02 20:05:44 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-057a3c00-3054-44f4-8209-cc0db4309433 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e16db19-ac67-4d4f-8ac8-3e8788bd2ab3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:05:44 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-057a3c00-3054-44f4-8209-cc0db4309433 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Flow 'volume_create_manager' (25b13cc7-7140-45aa-820f-7a909f6c7189) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 20:05:44 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-057a3c00-3054-44f4-8209-cc0db4309433 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Created volume successfully.
Jul 02 20:05:44 devstack sudo[107443]: pam_unix(sudo:session): session closed for user root
Jul 02 20:05:44 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-a5080f92-8923-4460-a5fb-95bd878d4864 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-28721af2-f9fe-4fa2-85a3-5ededcc6b8ca 1073741824" returned: 0 in 0.816s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:05:44 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-a5080f92-8923-4460-a5fb-95bd878d4864 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-28721af2-f9fe-4fa2-85a3-5ededcc6b8ca {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:05:44 devstack sudo[107450]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-28721af2-f9fe-4fa2-85a3-5ededcc6b8ca
Jul 02 20:05:44 devstack sudo[107450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:05:45 devstack sudo[107450]: pam_unix(sudo:session): session closed for user root
Jul 02 20:05:45 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-a5080f92-8923-4460-a5fb-95bd878d4864 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-28721af2-f9fe-4fa2-85a3-5ededcc6b8ca" returned: 0 in 0.620s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:05:45 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-a5080f92-8923-4460-a5fb-95bd878d4864 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] <== create_volume: return (1477ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'} {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 20:05:45 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-a5080f92-8923-4460-a5fb-95bd878d4864 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.480s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 20:05:45 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-39580450-bbc6-4a3b-9830-b44acd88f3e1 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.276s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 20:05:45 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-39580450-bbc6-4a3b-9830-b44acd88f3e1 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce906cb830>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T18:05:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1575835054',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bde1de1b-2b05-44ff-a8ee-801b931db50b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='434350bb251644f4ab9debad4dd21938',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T18:05:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T18:05:41Z,use_quota=True,user_id='9b95c7d062894089a549492b257319d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)}" {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 20:05:45 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-39580450-bbc6-4a3b-9830-b44acd88f3e1 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Creating volume bde1de1b-2b05-44ff-a8ee-801b931db50b {{(pid=86639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 20:05:45 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-39580450-bbc6-4a3b-9830-b44acd88f3e1 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 20:05:45 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-39580450-bbc6-4a3b-9830-b44acd88f3e1 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 20:05:45 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-39580450-bbc6-4a3b-9830-b44acd88f3e1 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 20:05:45 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-39580450-bbc6-4a3b-9830-b44acd88f3e1 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 20:05:45 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-39580450-bbc6-4a3b-9830-b44acd88f3e1 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 20:05:45 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-39580450-bbc6-4a3b-9830-b44acd88f3e1 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Selected osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92 as target Quobyte volume. {{(pid=86639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 20:05:45 devstack cinder-volume[86639]: INFO cinder.volume.drivers.remotefs [None req-39580450-bbc6-4a3b-9830-b44acd88f3e1 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] casted to osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92
Jul 02 20:05:45 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-39580450-bbc6-4a3b-9830-b44acd88f3e1 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-bde1de1b-2b05-44ff-a8ee-801b931db50b 1073741824 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:05:45 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-a5080f92-8923-4460-a5fb-95bd878d4864 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12ff2532-ff69-443c-8771-082beeaa6f2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-28721af2-f9fe-4fa2-85a3-5ededcc6b8ca', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:05:45 devstack sudo[107453]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-bde1de1b-2b05-44ff-a8ee-801b931db50b 1073741824
Jul 02 20:05:45 devstack sudo[107453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:05:45 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-a5080f92-8923-4460-a5fb-95bd878d4864 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a6f8cd1-0ee7-42b7-8814-80eb7c5698da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:05:45 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-a5080f92-8923-4460-a5fb-95bd878d4864 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Volume volume-28721af2-f9fe-4fa2-85a3-5ededcc6b8ca (28721af2-f9fe-4fa2-85a3-5ededcc6b8ca): created successfully
Jul 02 20:05:45 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-a5080f92-8923-4460-a5fb-95bd878d4864 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a6f8cd1-0ee7-42b7-8814-80eb7c5698da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:05:45 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-a5080f92-8923-4460-a5fb-95bd878d4864 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Flow 'volume_create_manager' (89a266e6-024f-4f09-9305-4250554986ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 20:05:45 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-a5080f92-8923-4460-a5fb-95bd878d4864 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Created volume successfully.
Jul 02 20:05:46 devstack sudo[107453]: pam_unix(sudo:session): session closed for user root
Jul 02 20:05:46 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-39580450-bbc6-4a3b-9830-b44acd88f3e1 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-bde1de1b-2b05-44ff-a8ee-801b931db50b 1073741824" returned: 0 in 0.801s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:05:46 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-39580450-bbc6-4a3b-9830-b44acd88f3e1 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-bde1de1b-2b05-44ff-a8ee-801b931db50b {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:05:46 devstack sudo[107459]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-bde1de1b-2b05-44ff-a8ee-801b931db50b
Jul 02 20:05:46 devstack sudo[107459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:05:46 devstack sudo[107459]: pam_unix(sudo:session): session closed for user root
Jul 02 20:05:46 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-39580450-bbc6-4a3b-9830-b44acd88f3e1 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-bde1de1b-2b05-44ff-a8ee-801b931db50b" returned: 0 in 0.609s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:05:46 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-39580450-bbc6-4a3b-9830-b44acd88f3e1 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] <== create_volume: return (1448ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'} {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 20:05:46 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-39580450-bbc6-4a3b-9830-b44acd88f3e1 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.452s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 20:05:46 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-bd30c62b-a4e4-4e3a-94b8-e7c825d59f79 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.196s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 20:05:46 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-bd30c62b-a4e4-4e3a-94b8-e7c825d59f79 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce906cb830>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T18:05:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1075179337',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a48f1ecc-6b08-4273-a738-ad65c996f331,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='434350bb251644f4ab9debad4dd21938',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T18:05:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T18:05:42Z,use_quota=True,user_id='9b95c7d062894089a549492b257319d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)}" {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 20:05:46 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-bd30c62b-a4e4-4e3a-94b8-e7c825d59f79 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Creating volume a48f1ecc-6b08-4273-a738-ad65c996f331 {{(pid=86639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 20:05:46 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-bd30c62b-a4e4-4e3a-94b8-e7c825d59f79 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 20:05:46 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-bd30c62b-a4e4-4e3a-94b8-e7c825d59f79 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 20:05:46 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-bd30c62b-a4e4-4e3a-94b8-e7c825d59f79 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 20:05:46 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-bd30c62b-a4e4-4e3a-94b8-e7c825d59f79 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 20:05:46 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-bd30c62b-a4e4-4e3a-94b8-e7c825d59f79 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 20:05:46 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-bd30c62b-a4e4-4e3a-94b8-e7c825d59f79 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Selected osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92 as target Quobyte volume. {{(pid=86639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 20:05:46 devstack cinder-volume[86639]: INFO cinder.volume.drivers.remotefs [None req-bd30c62b-a4e4-4e3a-94b8-e7c825d59f79 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] casted to osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92
Jul 02 20:05:46 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-bd30c62b-a4e4-4e3a-94b8-e7c825d59f79 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-a48f1ecc-6b08-4273-a738-ad65c996f331 1073741824 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:05:46 devstack sudo[107462]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-a48f1ecc-6b08-4273-a738-ad65c996f331 1073741824
Jul 02 20:05:46 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-39580450-bbc6-4a3b-9830-b44acd88f3e1 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80d6a085-9954-48cf-a4d1-13ef34a0f2a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bde1de1b-2b05-44ff-a8ee-801b931db50b', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:05:46 devstack sudo[107462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:05:46 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-39580450-bbc6-4a3b-9830-b44acd88f3e1 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76bb1ca8-59e5-4afd-ace8-d01f42c1f0c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:05:46 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-39580450-bbc6-4a3b-9830-b44acd88f3e1 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Volume volume-bde1de1b-2b05-44ff-a8ee-801b931db50b (bde1de1b-2b05-44ff-a8ee-801b931db50b): created successfully
Jul 02 20:05:46 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-39580450-bbc6-4a3b-9830-b44acd88f3e1 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76bb1ca8-59e5-4afd-ace8-d01f42c1f0c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:05:46 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-39580450-bbc6-4a3b-9830-b44acd88f3e1 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Flow 'volume_create_manager' (e3ddabf8-c596-439e-a776-2f412a58a477) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 20:05:46 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-39580450-bbc6-4a3b-9830-b44acd88f3e1 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Created volume successfully.
Jul 02 20:05:47 devstack sudo[107462]: pam_unix(sudo:session): session closed for user root
Jul 02 20:05:47 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-bd30c62b-a4e4-4e3a-94b8-e7c825d59f79 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-a48f1ecc-6b08-4273-a738-ad65c996f331 1073741824" returned: 0 in 0.788s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:05:47 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-bd30c62b-a4e4-4e3a-94b8-e7c825d59f79 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-a48f1ecc-6b08-4273-a738-ad65c996f331 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:05:47 devstack sudo[107468]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-a48f1ecc-6b08-4273-a738-ad65c996f331
Jul 02 20:05:47 devstack sudo[107468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:05:48 devstack sudo[107468]: pam_unix(sudo:session): session closed for user root
Jul 02 20:05:48 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-bd30c62b-a4e4-4e3a-94b8-e7c825d59f79 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-a48f1ecc-6b08-4273-a738-ad65c996f331" returned: 0 in 0.614s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:05:48 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-bd30c62b-a4e4-4e3a-94b8-e7c825d59f79 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] <== create_volume: return (1442ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'} {{(pid=86639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 20:05:48 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-bd30c62b-a4e4-4e3a-94b8-e7c825d59f79 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.444s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 20:05:48 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-2bc364da-153f-4158-9c27-67200d187a99 tempest-SnapshotDependencyTests-1812892589 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.455s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 20:05:48 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-bd30c62b-a4e4-4e3a-94b8-e7c825d59f79 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1689a7cd-0ed6-4b2d-b881-f56a7939c69b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a48f1ecc-6b08-4273-a738-ad65c996f331', 'volume_size': 1}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:05:48 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-bd30c62b-a4e4-4e3a-94b8-e7c825d59f79 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9614ddb8-e95a-4f5a-ac9a-07f9fb781daa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:05:48 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-2bc364da-153f-4158-9c27-67200d187a99 tempest-SnapshotDependencyTests-1812892589 None] Creating offline snapshot edee8c4f-9fc7-4839-9ede-5e75a960bf4c of volume 82e9bd09-ba4f-4614-b846-f65124c763cc {{(pid=86639) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 02 20:05:48 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-bd30c62b-a4e4-4e3a-94b8-e7c825d59f79 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Volume volume-a48f1ecc-6b08-4273-a738-ad65c996f331 (a48f1ecc-6b08-4273-a738-ad65c996f331): created successfully
Jul 02 20:05:48 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-bd30c62b-a4e4-4e3a-94b8-e7c825d59f79 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9614ddb8-e95a-4f5a-ac9a-07f9fb781daa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:05:48 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-bd30c62b-a4e4-4e3a-94b8-e7c825d59f79 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Flow 'volume_create_manager' (b729f9ee-e2ec-4c4a-b82b-018cde4a7a24) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 20:05:48 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[e154e0aa-bc49-4875-9c6c-edf69bbf412c]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 20:05:48 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-2bc364da-153f-4158-9c27-67200d187a99 tempest-SnapshotDependencyTests-1812892589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-82e9bd09-ba4f-4614-b846-f65124c763cc {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:05:48 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-bd30c62b-a4e4-4e3a-94b8-e7c825d59f79 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Created volume successfully.
Jul 02 20:05:48 devstack sudo[107471]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-82e9bd09-ba4f-4614-b846-f65124c763cc
Jul 02 20:05:48 devstack sudo[107471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:05:49 devstack sudo[107471]: pam_unix(sudo:session): session closed for user root
Jul 02 20:05:49 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-2bc364da-153f-4158-9c27-67200d187a99 tempest-SnapshotDependencyTests-1812892589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-82e9bd09-ba4f-4614-b846-f65124c763cc" returned: 0 in 0.767s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:05:49 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-2bc364da-153f-4158-9c27-67200d187a99 tempest-SnapshotDependencyTests-1812892589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-82e9bd09-ba4f-4614-b846-f65124c763cc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-82e9bd09-ba4f-4614-b846-f65124c763cc.edee8c4f-9fc7-4839-9ede-5e75a960bf4c 1G {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:05:49 devstack sudo[107476]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-82e9bd09-ba4f-4614-b846-f65124c763cc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-82e9bd09-ba4f-4614-b846-f65124c763cc.edee8c4f-9fc7-4839-9ede-5e75a960bf4c 1G
Jul 02 20:05:49 devstack sudo[107476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:05:49 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-a7439857-c75a-4413-a3c0-89b7f7b78981 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Acquiring lock "cinder-a48f1ecc-6b08-4273-a738-ad65c996f331-delete_volume" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 20:05:49 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-a7439857-c75a-4413-a3c0-89b7f7b78981 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Lock "cinder-a48f1ecc-6b08-4273-a738-ad65c996f331-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 20:05:49 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-a7439857-c75a-4413-a3c0-89b7f7b78981 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Acquiring lock "cinder-quobyte-a48f1ecc-6b08-4273-a738-ad65c996f331" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 20:05:49 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-a7439857-c75a-4413-a3c0-89b7f7b78981 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Lock "cinder-quobyte-a48f1ecc-6b08-4273-a738-ad65c996f331" acquired by "delete_volume" :: waited 0.013s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 20:05:49 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[41367e95-22cc-4214-b3d6-ee474e8e8299]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 20:05:49 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-a7439857-c75a-4413-a3c0-89b7f7b78981 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-a48f1ecc-6b08-4273-a738-ad65c996f331 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:05:49 devstack sudo[107478]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-a48f1ecc-6b08-4273-a738-ad65c996f331
Jul 02 20:05:49 devstack sudo[107478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:05:49 devstack sudo[107476]: pam_unix(sudo:session): session closed for user root
Jul 02 20:05:49 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-2bc364da-153f-4158-9c27-67200d187a99 tempest-SnapshotDependencyTests-1812892589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-82e9bd09-ba4f-4614-b846-f65124c763cc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-82e9bd09-ba4f-4614-b846-f65124c763cc.edee8c4f-9fc7-4839-9ede-5e75a960bf4c 1G" returned: 0 in 0.791s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:05:49 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-2bc364da-153f-4158-9c27-67200d187a99 tempest-SnapshotDependencyTests-1812892589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-82e9bd09-ba4f-4614-b846-f65124c763cc -F qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-82e9bd09-ba4f-4614-b846-f65124c763cc.edee8c4f-9fc7-4839-9ede-5e75a960bf4c {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:05:50 devstack sudo[107485]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-82e9bd09-ba4f-4614-b846-f65124c763cc -F qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-82e9bd09-ba4f-4614-b846-f65124c763cc.edee8c4f-9fc7-4839-9ede-5e75a960bf4c
Jul 02 20:05:50 devstack sudo[107485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:05:50 devstack sudo[107478]: pam_unix(sudo:session): session closed for user root
Jul 02 20:05:50 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-a7439857-c75a-4413-a3c0-89b7f7b78981 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-a48f1ecc-6b08-4273-a738-ad65c996f331" returned: 0 in 0.791s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:05:50 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-a7439857-c75a-4413-a3c0-89b7f7b78981 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-a48f1ecc-6b08-4273-a738-ad65c996f331 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:05:50 devstack sudo[107489]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-a48f1ecc-6b08-4273-a738-ad65c996f331
Jul 02 20:05:50 devstack sudo[107489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:05:50 devstack sudo[107485]: pam_unix(sudo:session): session closed for user root
Jul 02 20:05:50 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-2bc364da-153f-4158-9c27-67200d187a99 tempest-SnapshotDependencyTests-1812892589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-82e9bd09-ba4f-4614-b846-f65124c763cc -F qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-82e9bd09-ba4f-4614-b846-f65124c763cc.edee8c4f-9fc7-4839-9ede-5e75a960bf4c" returned: 0 in 0.660s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:05:50 devstack cinder-volume[86639]: WARNING cinder.volume.drivers.remotefs [None req-2bc364da-153f-4158-9c27-67200d187a99 tempest-SnapshotDependencyTests-1812892589 None] /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-82e9bd09-ba4f-4614-b846-f65124c763cc.edee8c4f-9fc7-4839-9ede-5e75a960bf4c is being set with open permissions: ugo+rw
Jul 02 20:05:50 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-2bc364da-153f-4158-9c27-67200d187a99 tempest-SnapshotDependencyTests-1812892589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-82e9bd09-ba4f-4614-b846-f65124c763cc.edee8c4f-9fc7-4839-9ede-5e75a960bf4c {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:05:50 devstack sudo[107494]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-82e9bd09-ba4f-4614-b846-f65124c763cc.edee8c4f-9fc7-4839-9ede-5e75a960bf4c
Jul 02 20:05:50 devstack sudo[107494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:05:50 devstack sudo[107489]: pam_unix(sudo:session): session closed for user root
Jul 02 20:05:50 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-a7439857-c75a-4413-a3c0-89b7f7b78981 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-a48f1ecc-6b08-4273-a738-ad65c996f331" returned: 0 in 0.669s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:05:50 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-a7439857-c75a-4413-a3c0-89b7f7b78981 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Lock "cinder-quobyte-a48f1ecc-6b08-4273-a738-ad65c996f331" released by "delete_volume" :: held 1.505s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 20:05:50 devstack cinder-volume[86639]: DEBUG cinder.quota [None req-a7439857-c75a-4413-a3c0-89b7f7b78981 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Created reservations ['444dd232-7974-4ebe-91d3-aa8238d1384b', 'cb5d6e8c-3ca1-4754-ab9d-e6e50a21f64e', 'a8a2bb3f-5ed6-4d88-9b12-a25e21021204', 'ae0ca367-1a68-4e52-a23e-60070f6e32b5'] {{(pid=86639) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 20:05:50 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-a7439857-c75a-4413-a3c0-89b7f7b78981 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 20:05:50 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-a7439857-c75a-4413-a3c0-89b7f7b78981 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 20:05:50 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-a7439857-c75a-4413-a3c0-89b7f7b78981 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 20:05:50 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-a7439857-c75a-4413-a3c0-89b7f7b78981 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 20:05:50 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-a7439857-c75a-4413-a3c0-89b7f7b78981 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 20:05:50 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-a7439857-c75a-4413-a3c0-89b7f7b78981 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:05:50 devstack sudo[107497]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e
Jul 02 20:05:50 devstack sudo[107497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:05:51 devstack sudo[107494]: pam_unix(sudo:session): session closed for user root
Jul 02 20:05:51 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-2bc364da-153f-4158-9c27-67200d187a99 tempest-SnapshotDependencyTests-1812892589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-82e9bd09-ba4f-4614-b846-f65124c763cc.edee8c4f-9fc7-4839-9ede-5e75a960bf4c" returned: 0 in 0.618s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:05:51 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-2bc364da-153f-4158-9c27-67200d187a99 tempest-SnapshotDependencyTests-1812892589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-82e9bd09-ba4f-4614-b846-f65124c763cc.info {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:05:51 devstack sudo[107500]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-82e9bd09-ba4f-4614-b846-f65124c763cc.info
Jul 02 20:05:51 devstack sudo[107500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:05:51 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-026562bf-ac15-4304-ad4f-2409f9092971 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Acquiring lock "cinder-bde1de1b-2b05-44ff-a8ee-801b931db50b-delete_volume" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 20:05:51 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-026562bf-ac15-4304-ad4f-2409f9092971 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Lock "cinder-bde1de1b-2b05-44ff-a8ee-801b931db50b-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 20:05:51 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-026562bf-ac15-4304-ad4f-2409f9092971 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Acquiring lock "cinder-quobyte-bde1de1b-2b05-44ff-a8ee-801b931db50b" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 20:05:51 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-026562bf-ac15-4304-ad4f-2409f9092971 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Lock "cinder-quobyte-bde1de1b-2b05-44ff-a8ee-801b931db50b" acquired by "delete_volume" :: waited 0.016s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 20:05:51 devstack sudo[107497]: pam_unix(sudo:session): session closed for user root
Jul 02 20:05:51 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-a7439857-c75a-4413-a3c0-89b7f7b78981 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e" returned: 0 in 0.660s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:05:51 devstack cinder-volume[86639]: DEBUG cinder.manager [None req-a7439857-c75a-4413-a3c0-89b7f7b78981 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Notifying Schedulers of capabilities ... {{(pid=86639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 20:05:51 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-a7439857-c75a-4413-a3c0-89b7f7b78981 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Deleted volume successfully.
Jul 02 20:05:51 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[60b83e10-bded-4144-8066-c9d9380ec601]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 20:05:51 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-026562bf-ac15-4304-ad4f-2409f9092971 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-bde1de1b-2b05-44ff-a8ee-801b931db50b {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:05:51 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-a7439857-c75a-4413-a3c0-89b7f7b78981 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Lock "cinder-a48f1ecc-6b08-4273-a738-ad65c996f331-delete_volume" released by "delete_volume" :: held 2.363s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 20:05:51 devstack sudo[107503]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-bde1de1b-2b05-44ff-a8ee-801b931db50b
Jul 02 20:05:51 devstack sudo[107503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:05:52 devstack sudo[107500]: pam_unix(sudo:session): session closed for user root
Jul 02 20:05:52 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-2bc364da-153f-4158-9c27-67200d187a99 tempest-SnapshotDependencyTests-1812892589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-82e9bd09-ba4f-4614-b846-f65124c763cc.info" returned: 0 in 0.717s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:05:52 devstack cinder-volume[86639]: WARNING cinder.volume.drivers.remotefs [None req-2bc364da-153f-4158-9c27-67200d187a99 tempest-SnapshotDependencyTests-1812892589 None] /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-82e9bd09-ba4f-4614-b846-f65124c763cc.info is being set with open permissions: ugo+rw
Jul 02 20:05:52 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-2bc364da-153f-4158-9c27-67200d187a99 tempest-SnapshotDependencyTests-1812892589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-82e9bd09-ba4f-4614-b846-f65124c763cc.info {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:05:52 devstack sudo[107507]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-82e9bd09-ba4f-4614-b846-f65124c763cc.info
Jul 02 20:05:52 devstack sudo[107507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:05:52 devstack sudo[107503]: pam_unix(sudo:session): session closed for user root
Jul 02 20:05:52 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-026562bf-ac15-4304-ad4f-2409f9092971 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-bde1de1b-2b05-44ff-a8ee-801b931db50b" returned: 0 in 0.786s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:05:52 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-026562bf-ac15-4304-ad4f-2409f9092971 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-bde1de1b-2b05-44ff-a8ee-801b931db50b {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:05:52 devstack sudo[107513]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-bde1de1b-2b05-44ff-a8ee-801b931db50b
Jul 02 20:05:52 devstack sudo[107513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:05:52 devstack sudo[107507]: pam_unix(sudo:session): session closed for user root
Jul 02 20:05:52 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-2bc364da-153f-4158-9c27-67200d187a99 tempest-SnapshotDependencyTests-1812892589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-82e9bd09-ba4f-4614-b846-f65124c763cc.info" returned: 0 in 0.650s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:05:52 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-2bc364da-153f-4158-9c27-67200d187a99 tempest-SnapshotDependencyTests-1812892589 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.320s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 20:05:52 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-2bc364da-153f-4158-9c27-67200d187a99 tempest-SnapshotDependencyTests-1812892589 None] Create snapshot completed successfully
Jul 02 20:05:53 devstack sudo[107513]: pam_unix(sudo:session): session closed for user root
Jul 02 20:05:53 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-026562bf-ac15-4304-ad4f-2409f9092971 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-bde1de1b-2b05-44ff-a8ee-801b931db50b" returned: 0 in 0.659s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:05:53 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-026562bf-ac15-4304-ad4f-2409f9092971 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Lock "cinder-quobyte-bde1de1b-2b05-44ff-a8ee-801b931db50b" released by "delete_volume" :: held 1.496s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 20:05:53 devstack cinder-volume[86639]: DEBUG cinder.quota [None req-026562bf-ac15-4304-ad4f-2409f9092971 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Created reservations ['aa38513a-33e0-4395-8a24-956ee9129e42', '9d279acd-cf01-46ba-8973-d351ed27650d', '754d278e-112a-420b-a5fa-6863b42eb8d6', '546162ee-a1bb-4223-82b7-19ffe2dbc9bf'] {{(pid=86639) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 20:05:53 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-026562bf-ac15-4304-ad4f-2409f9092971 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 20:05:53 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-026562bf-ac15-4304-ad4f-2409f9092971 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 20:05:53 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-026562bf-ac15-4304-ad4f-2409f9092971 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 20:05:53 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-026562bf-ac15-4304-ad4f-2409f9092971 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 20:05:53 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-026562bf-ac15-4304-ad4f-2409f9092971 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 20:05:53 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-026562bf-ac15-4304-ad4f-2409f9092971 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:05:53 devstack sudo[107517]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e
Jul 02 20:05:53 devstack sudo[107517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:05:53 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-c0ede6c4-6f01-46da-8729-86728a55e430 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Acquiring lock "cinder-28721af2-f9fe-4fa2-85a3-5ededcc6b8ca-delete_volume" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 20:05:53 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-c0ede6c4-6f01-46da-8729-86728a55e430 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Lock "cinder-28721af2-f9fe-4fa2-85a3-5ededcc6b8ca-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 20:05:53 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-c0ede6c4-6f01-46da-8729-86728a55e430 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Acquiring lock "cinder-quobyte-28721af2-f9fe-4fa2-85a3-5ededcc6b8ca" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 20:05:53 devstack sudo[107517]: pam_unix(sudo:session): session closed for user root
Jul 02 20:05:53 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-026562bf-ac15-4304-ad4f-2409f9092971 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e" returned: 0 in 0.691s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:05:53 devstack cinder-volume[86639]: DEBUG cinder.manager [None req-026562bf-ac15-4304-ad4f-2409f9092971 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Notifying Schedulers of capabilities ... {{(pid=86639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 20:05:53 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-026562bf-ac15-4304-ad4f-2409f9092971 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Deleted volume successfully.
Jul 02 20:05:53 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-c0ede6c4-6f01-46da-8729-86728a55e430 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Lock "cinder-quobyte-28721af2-f9fe-4fa2-85a3-5ededcc6b8ca" acquired by "delete_volume" :: waited 0.031s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 20:05:53 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-026562bf-ac15-4304-ad4f-2409f9092971 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Lock "cinder-bde1de1b-2b05-44ff-a8ee-801b931db50b-delete_volume" released by "delete_volume" :: held 2.404s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 20:05:53 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[79ff6994-4e15-4ab8-ad33-a88b32ff4190]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 20:05:53 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-c0ede6c4-6f01-46da-8729-86728a55e430 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-28721af2-f9fe-4fa2-85a3-5ededcc6b8ca {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:05:54 devstack sudo[107520]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-28721af2-f9fe-4fa2-85a3-5ededcc6b8ca
Jul 02 20:05:54 devstack sudo[107520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:05:54 devstack cinder-volume[86639]: DEBUG cinder.volume.flows.manager.create_volume [None req-49f252ef-48e4-49d1-95e0-b53dff61b2b6 tempest-SnapshotDependencyTests-1812892589 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 20:05:54 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-49f252ef-48e4-49d1-95e0-b53dff61b2b6 tempest-SnapshotDependencyTests-1812892589 None] Flow 'volume_create_manager' (10c5166b-f3db-488c-9752-704ebd40d7a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 20:05:54 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-49f252ef-48e4-49d1-95e0-b53dff61b2b6 tempest-SnapshotDependencyTests-1812892589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (699764e4-92e0-481c-ae50-b77f3dbebe37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:05:54 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-49f252ef-48e4-49d1-95e0-b53dff61b2b6 tempest-SnapshotDependencyTests-1812892589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (699764e4-92e0-481c-ae50-b77f3dbebe37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T18:05:54Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c828c142-426a-4810-ae0b-b7d52955ef6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77eb2bff3c1f409fac86fad69a0f4c81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T18:05:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=edee8c4f-9fc7-4839-9ede-5e75a960bf4c,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T18:05:54Z,use_quota=True,user_id='05ed2ca5bda34404bf65815bd47e83c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a20b240f-aec6-41ba-83ec-5fe050527bcb),volume_type_id=a20b240f-aec6-41ba-83ec-5fe050527bcb)' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:05:54 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-49f252ef-48e4-49d1-95e0-b53dff61b2b6 tempest-SnapshotDependencyTests-1812892589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1f09789-cac5-4dcc-8ef1-f5b2905008bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:05:54 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-49f252ef-48e4-49d1-95e0-b53dff61b2b6 tempest-SnapshotDependencyTests-1812892589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1f09789-cac5-4dcc-8ef1-f5b2905008bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:05:54 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-49f252ef-48e4-49d1-95e0-b53dff61b2b6 tempest-SnapshotDependencyTests-1812892589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a4b99a9-f799-4c1b-b46d-3778cec1db94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:05:54 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-49f252ef-48e4-49d1-95e0-b53dff61b2b6 tempest-SnapshotDependencyTests-1812892589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a4b99a9-f799-4c1b-b46d-3778cec1db94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'c828c142-426a-4810-ae0b-b7d52955ef6d', 'volume_name': 'volume-c828c142-426a-4810-ae0b-b7d52955ef6d', 'volume_size': 1, 'snapshot_id': 'edee8c4f-9fc7-4839-9ede-5e75a960bf4c'}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:05:54 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-49f252ef-48e4-49d1-95e0-b53dff61b2b6 tempest-SnapshotDependencyTests-1812892589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (828ed25d-e8f3-4b52-955f-4047f5e4ba77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:05:54 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-49f252ef-48e4-49d1-95e0-b53dff61b2b6 tempest-SnapshotDependencyTests-1812892589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (828ed25d-e8f3-4b52-955f-4047f5e4ba77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:05:54 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-49f252ef-48e4-49d1-95e0-b53dff61b2b6 tempest-SnapshotDependencyTests-1812892589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d5db57c-70b6-48e1-8b2c-746fb5b37d59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:05:54 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-49f252ef-48e4-49d1-95e0-b53dff61b2b6 tempest-SnapshotDependencyTests-1812892589 None] Volume c828c142-426a-4810-ae0b-b7d52955ef6d: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-c828c142-426a-4810-ae0b-b7d52955ef6d', 'volume_size': 1, 'snapshot_id': 'edee8c4f-9fc7-4839-9ede-5e75a960bf4c'}
Jul 02 20:05:54 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-49f252ef-48e4-49d1-95e0-b53dff61b2b6 tempest-SnapshotDependencyTests-1812892589 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 20:05:54 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-49f252ef-48e4-49d1-95e0-b53dff61b2b6 tempest-SnapshotDependencyTests-1812892589 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 20:05:54 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-49f252ef-48e4-49d1-95e0-b53dff61b2b6 tempest-SnapshotDependencyTests-1812892589 None] Acquiring lock "cinder-quobyte-edee8c4f-9fc7-4839-9ede-5e75a960bf4c-c828c142-426a-4810-ae0b-b7d52955ef6d" by "_create_volume_from_snapshot" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 20:05:54 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-49f252ef-48e4-49d1-95e0-b53dff61b2b6 tempest-SnapshotDependencyTests-1812892589 None] Lock "cinder-quobyte-edee8c4f-9fc7-4839-9ede-5e75a960bf4c-c828c142-426a-4810-ae0b-b7d52955ef6d" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 20:05:54 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-49f252ef-48e4-49d1-95e0-b53dff61b2b6 tempest-SnapshotDependencyTests-1812892589 None] Creating volume c828c142-426a-4810-ae0b-b7d52955ef6d from snapshot edee8c4f-9fc7-4839-9ede-5e75a960bf4c {{(pid=86639) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jul 02 20:05:54 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-49f252ef-48e4-49d1-95e0-b53dff61b2b6 tempest-SnapshotDependencyTests-1812892589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 20:05:54 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-49f252ef-48e4-49d1-95e0-b53dff61b2b6 tempest-SnapshotDependencyTests-1812892589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 20:05:54 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-49f252ef-48e4-49d1-95e0-b53dff61b2b6 tempest-SnapshotDependencyTests-1812892589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 20:05:54 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-49f252ef-48e4-49d1-95e0-b53dff61b2b6 tempest-SnapshotDependencyTests-1812892589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 20:05:54 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-49f252ef-48e4-49d1-95e0-b53dff61b2b6 tempest-SnapshotDependencyTests-1812892589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 20:05:54 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-49f252ef-48e4-49d1-95e0-b53dff61b2b6 tempest-SnapshotDependencyTests-1812892589 None] Selected osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92 as target Quobyte volume. {{(pid=86639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 20:05:54 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-49f252ef-48e4-49d1-95e0-b53dff61b2b6 tempest-SnapshotDependencyTests-1812892589 None] Acquiring lock "cinder-quobyte-c828c142-426a-4810-ae0b-b7d52955ef6d" by "_copy_volume_from_snapshot" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 20:05:54 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-49f252ef-48e4-49d1-95e0-b53dff61b2b6 tempest-SnapshotDependencyTests-1812892589 None] Lock "cinder-quobyte-c828c142-426a-4810-ae0b-b7d52955ef6d" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 20:05:54 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-49f252ef-48e4-49d1-95e0-b53dff61b2b6 tempest-SnapshotDependencyTests-1812892589 None] snapshot: edee8c4f-9fc7-4839-9ede-5e75a960bf4c, volume: c828c142-426a-4810-ae0b-b7d52955ef6d,  {{(pid=86639) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jul 02 20:05:54 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-49f252ef-48e4-49d1-95e0-b53dff61b2b6 tempest-SnapshotDependencyTests-1812892589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 20:05:54 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-49f252ef-48e4-49d1-95e0-b53dff61b2b6 tempest-SnapshotDependencyTests-1812892589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 20:05:54 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-49f252ef-48e4-49d1-95e0-b53dff61b2b6 tempest-SnapshotDependencyTests-1812892589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 20:05:54 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-49f252ef-48e4-49d1-95e0-b53dff61b2b6 tempest-SnapshotDependencyTests-1812892589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 20:05:54 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-49f252ef-48e4-49d1-95e0-b53dff61b2b6 tempest-SnapshotDependencyTests-1812892589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 20:05:54 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7db6d91-455d-4993-8c81-3e0a814d8438]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 20:05:54 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-49f252ef-48e4-49d1-95e0-b53dff61b2b6 tempest-SnapshotDependencyTests-1812892589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-82e9bd09-ba4f-4614-b846-f65124c763cc.edee8c4f-9fc7-4839-9ede-5e75a960bf4c {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:05:54 devstack sudo[107523]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-82e9bd09-ba4f-4614-b846-f65124c763cc.edee8c4f-9fc7-4839-9ede-5e75a960bf4c
Jul 02 20:05:54 devstack sudo[107523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:05:54 devstack sudo[107520]: pam_unix(sudo:session): session closed for user root
Jul 02 20:05:54 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-c0ede6c4-6f01-46da-8729-86728a55e430 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-28721af2-f9fe-4fa2-85a3-5ededcc6b8ca" returned: 0 in 0.830s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:05:54 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-c0ede6c4-6f01-46da-8729-86728a55e430 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-28721af2-f9fe-4fa2-85a3-5ededcc6b8ca {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:05:54 devstack sudo[107528]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-28721af2-f9fe-4fa2-85a3-5ededcc6b8ca
Jul 02 20:05:54 devstack sudo[107528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:05:55 devstack sudo[107523]: pam_unix(sudo:session): session closed for user root
Jul 02 20:05:55 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-49f252ef-48e4-49d1-95e0-b53dff61b2b6 tempest-SnapshotDependencyTests-1812892589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-82e9bd09-ba4f-4614-b846-f65124c763cc.edee8c4f-9fc7-4839-9ede-5e75a960bf4c" returned: 0 in 0.773s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:05:55 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-49f252ef-48e4-49d1-95e0-b53dff61b2b6 tempest-SnapshotDependencyTests-1812892589 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-82e9bd09-ba4f-4614-b846-f65124c763cc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86639) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 02 20:05:55 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-49f252ef-48e4-49d1-95e0-b53dff61b2b6 tempest-SnapshotDependencyTests-1812892589 None] will copy from snapshot at /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-82e9bd09-ba4f-4614-b846-f65124c763cc {{(pid=86639) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jul 02 20:05:55 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-49f252ef-48e4-49d1-95e0-b53dff61b2b6 tempest-SnapshotDependencyTests-1812892589 None] Creating direct copy from snapshot {{(pid=86639) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jul 02 20:05:55 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[d71ba7cb-eaae-4dbb-afc1-ad029a6052b0]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 20:05:55 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-49f252ef-48e4-49d1-95e0-b53dff61b2b6 tempest-SnapshotDependencyTests-1812892589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-82e9bd09-ba4f-4614-b846-f65124c763cc {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:05:55 devstack sudo[107534]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-82e9bd09-ba4f-4614-b846-f65124c763cc
Jul 02 20:05:55 devstack sudo[107534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:05:55 devstack sudo[107528]: pam_unix(sudo:session): session closed for user root
Jul 02 20:05:55 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-c0ede6c4-6f01-46da-8729-86728a55e430 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-28721af2-f9fe-4fa2-85a3-5ededcc6b8ca" returned: 0 in 0.685s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:05:55 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-c0ede6c4-6f01-46da-8729-86728a55e430 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Lock "cinder-quobyte-28721af2-f9fe-4fa2-85a3-5ededcc6b8ca" released by "delete_volume" :: held 1.565s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 20:05:55 devstack cinder-volume[86639]: DEBUG cinder.quota [None req-c0ede6c4-6f01-46da-8729-86728a55e430 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Created reservations ['d4785793-9b4a-4bbc-9918-acfbb52c839a', '51db138b-a984-4800-920c-3c2ad236a1c6', '9254ea58-c8ae-4db9-8a2e-7a1692e2f3ff', '90f83690-3a0e-4385-8081-541ecdfc152f'] {{(pid=86639) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 20:05:55 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-c0ede6c4-6f01-46da-8729-86728a55e430 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 20:05:55 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-c0ede6c4-6f01-46da-8729-86728a55e430 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 20:05:55 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-c0ede6c4-6f01-46da-8729-86728a55e430 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 20:05:55 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-c0ede6c4-6f01-46da-8729-86728a55e430 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 20:05:55 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-c0ede6c4-6f01-46da-8729-86728a55e430 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 20:05:55 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-c0ede6c4-6f01-46da-8729-86728a55e430 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:05:55 devstack sudo[107538]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e
Jul 02 20:05:55 devstack sudo[107538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:05:55 devstack sudo[107534]: pam_unix(sudo:session): session closed for user root
Jul 02 20:05:55 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-49f252ef-48e4-49d1-95e0-b53dff61b2b6 tempest-SnapshotDependencyTests-1812892589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-82e9bd09-ba4f-4614-b846-f65124c763cc" returned: 0 in 0.738s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:05:55 devstack cinder-volume[86639]: DEBUG cinder.utils [None req-49f252ef-48e4-49d1-95e0-b53dff61b2b6 tempest-SnapshotDependencyTests-1812892589 None] Path /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-c828c142-426a-4810-ae0b-b7d52955ef6d not found in is_blk_device check {{(pid=86639) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 02 20:05:55 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-49f252ef-48e4-49d1-95e0-b53dff61b2b6 tempest-SnapshotDependencyTests-1812892589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-82e9bd09-ba4f-4614-b846-f65124c763cc /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-c828c142-426a-4810-ae0b-b7d52955ef6d {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:05:55 devstack sudo[107543]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-82e9bd09-ba4f-4614-b846-f65124c763cc /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-c828c142-426a-4810-ae0b-b7d52955ef6d
Jul 02 20:05:55 devstack sudo[107543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:05:56 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-a832f094-9f0a-4563-9e4a-805fa20f4f2c tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Acquiring lock "cinder-44257549-66f0-4b08-aa0f-24f2dddaba57-delete_volume" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 20:05:56 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-a832f094-9f0a-4563-9e4a-805fa20f4f2c tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Lock "cinder-44257549-66f0-4b08-aa0f-24f2dddaba57-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 20:05:56 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-a832f094-9f0a-4563-9e4a-805fa20f4f2c tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Acquiring lock "cinder-quobyte-44257549-66f0-4b08-aa0f-24f2dddaba57" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 20:05:56 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-a832f094-9f0a-4563-9e4a-805fa20f4f2c tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Lock "cinder-quobyte-44257549-66f0-4b08-aa0f-24f2dddaba57" acquired by "delete_volume" :: waited 0.015s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 20:05:56 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[c292c2bf-601b-454b-847b-255a98ee1c5c]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 20:05:56 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-a832f094-9f0a-4563-9e4a-805fa20f4f2c tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-44257549-66f0-4b08-aa0f-24f2dddaba57 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:05:56 devstack sudo[107545]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-44257549-66f0-4b08-aa0f-24f2dddaba57
Jul 02 20:05:56 devstack sudo[107545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:05:56 devstack sudo[107538]: pam_unix(sudo:session): session closed for user root
Jul 02 20:05:56 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-c0ede6c4-6f01-46da-8729-86728a55e430 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e" returned: 0 in 0.817s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:05:56 devstack cinder-volume[86639]: DEBUG cinder.manager [None req-c0ede6c4-6f01-46da-8729-86728a55e430 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Notifying Schedulers of capabilities ... {{(pid=86639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 20:05:56 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-c0ede6c4-6f01-46da-8729-86728a55e430 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Deleted volume successfully.
Jul 02 20:05:56 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-c0ede6c4-6f01-46da-8729-86728a55e430 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Lock "cinder-28721af2-f9fe-4fa2-85a3-5ededcc6b8ca-delete_volume" released by "delete_volume" :: held 2.637s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 20:05:58 devstack sudo[107545]: pam_unix(sudo:session): session closed for user root
Jul 02 20:05:58 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-a832f094-9f0a-4563-9e4a-805fa20f4f2c tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-44257549-66f0-4b08-aa0f-24f2dddaba57" returned: 0 in 2.013s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:05:58 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-a832f094-9f0a-4563-9e4a-805fa20f4f2c tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-44257549-66f0-4b08-aa0f-24f2dddaba57 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:05:58 devstack sudo[107563]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-44257549-66f0-4b08-aa0f-24f2dddaba57
Jul 02 20:05:58 devstack sudo[107563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:05:59 devstack sudo[107563]: pam_unix(sudo:session): session closed for user root
Jul 02 20:05:59 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-a832f094-9f0a-4563-9e4a-805fa20f4f2c tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-44257549-66f0-4b08-aa0f-24f2dddaba57" returned: 0 in 1.482s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:05:59 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-a832f094-9f0a-4563-9e4a-805fa20f4f2c tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Lock "cinder-quobyte-44257549-66f0-4b08-aa0f-24f2dddaba57" released by "delete_volume" :: held 3.576s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 20:05:59 devstack cinder-volume[86639]: DEBUG cinder.quota [None req-a832f094-9f0a-4563-9e4a-805fa20f4f2c tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Created reservations ['20f7ae3c-06c2-4150-ac70-9c61d8feebc3', '4ead9335-f203-4e1f-9f47-877463ee7ad1', '7e4c1f57-0b6f-461d-9ec0-5f34072bb29f', 'fcaa772f-aec4-4c13-8811-86f53b6762da'] {{(pid=86639) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 20:05:59 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-a832f094-9f0a-4563-9e4a-805fa20f4f2c tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 20:05:59 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-a832f094-9f0a-4563-9e4a-805fa20f4f2c tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 20:05:59 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-a832f094-9f0a-4563-9e4a-805fa20f4f2c tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 20:05:59 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-a832f094-9f0a-4563-9e4a-805fa20f4f2c tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 20:05:59 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-a832f094-9f0a-4563-9e4a-805fa20f4f2c tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 20:05:59 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-a832f094-9f0a-4563-9e4a-805fa20f4f2c tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:06:00 devstack sudo[107566]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e
Jul 02 20:06:00 devstack sudo[107566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:06:00 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-c454ca8d-83aa-4666-95dd-a5c4d6038575 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Acquiring lock "cinder-4592a50c-2293-4689-843d-fd81094cd74e-delete_volume" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 20:06:01 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-c454ca8d-83aa-4666-95dd-a5c4d6038575 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Lock "cinder-4592a50c-2293-4689-843d-fd81094cd74e-delete_volume" acquired by "delete_volume" :: waited 0.073s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 20:06:01 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-c454ca8d-83aa-4666-95dd-a5c4d6038575 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Acquiring lock "cinder-quobyte-4592a50c-2293-4689-843d-fd81094cd74e" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 20:06:01 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-c454ca8d-83aa-4666-95dd-a5c4d6038575 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Lock "cinder-quobyte-4592a50c-2293-4689-843d-fd81094cd74e" acquired by "delete_volume" :: waited 0.022s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 20:06:01 devstack sudo[107566]: pam_unix(sudo:session): session closed for user root
Jul 02 20:06:01 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-a832f094-9f0a-4563-9e4a-805fa20f4f2c tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e" returned: 0 in 1.204s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:06:01 devstack cinder-volume[86639]: DEBUG cinder.manager [None req-a832f094-9f0a-4563-9e4a-805fa20f4f2c tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Notifying Schedulers of capabilities ... {{(pid=86639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 20:06:01 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-a832f094-9f0a-4563-9e4a-805fa20f4f2c tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Deleted volume successfully.
Jul 02 20:06:01 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e438686-1ea8-4aa6-a2a2-31a78f81f848]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 20:06:01 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-c454ca8d-83aa-4666-95dd-a5c4d6038575 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-4592a50c-2293-4689-843d-fd81094cd74e {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:06:01 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-a832f094-9f0a-4563-9e4a-805fa20f4f2c tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Lock "cinder-44257549-66f0-4b08-aa0f-24f2dddaba57-delete_volume" released by "delete_volume" :: held 5.116s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 20:06:01 devstack sudo[107543]: pam_unix(sudo:session): session closed for user root
Jul 02 20:06:01 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-49f252ef-48e4-49d1-95e0-b53dff61b2b6 tempest-SnapshotDependencyTests-1812892589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-82e9bd09-ba4f-4614-b846-f65124c763cc /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-c828c142-426a-4810-ae0b-b7d52955ef6d" returned: 0 in 5.447s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:06:01 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c9390b4-9361-45a8-b0a3-0734c1ee9368]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 20:06:01 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-49f252ef-48e4-49d1-95e0-b53dff61b2b6 tempest-SnapshotDependencyTests-1812892589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-82e9bd09-ba4f-4614-b846-f65124c763cc {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:06:01 devstack sudo[107569]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-4592a50c-2293-4689-843d-fd81094cd74e
Jul 02 20:06:01 devstack sudo[107569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:06:01 devstack sudo[107570]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-82e9bd09-ba4f-4614-b846-f65124c763cc
Jul 02 20:06:01 devstack sudo[107570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:06:01 devstack sudo[107569]: pam_unix(sudo:session): session closed for user root
Jul 02 20:06:01 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-c454ca8d-83aa-4666-95dd-a5c4d6038575 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-4592a50c-2293-4689-843d-fd81094cd74e" returned: 0 in 0.806s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:06:01 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-c454ca8d-83aa-4666-95dd-a5c4d6038575 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-4592a50c-2293-4689-843d-fd81094cd74e {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:06:02 devstack sudo[107578]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-4592a50c-2293-4689-843d-fd81094cd74e
Jul 02 20:06:02 devstack sudo[107578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:06:02 devstack sudo[107570]: pam_unix(sudo:session): session closed for user root
Jul 02 20:06:02 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-49f252ef-48e4-49d1-95e0-b53dff61b2b6 tempest-SnapshotDependencyTests-1812892589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-82e9bd09-ba4f-4614-b846-f65124c763cc" returned: 0 in 0.996s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:06:02 devstack cinder-volume[86639]: DEBUG cinder.image.image_utils [None req-49f252ef-48e4-49d1-95e0-b53dff61b2b6 tempest-SnapshotDependencyTests-1812892589 None] Image conversion details: src /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-82e9bd09-ba4f-4614-b846-f65124c763cc, size 1024.00 MB, duration 5.45 sec, destination /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-c828c142-426a-4810-ae0b-b7d52955ef6d {{(pid=86639) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 02 20:06:02 devstack cinder-volume[86639]: INFO cinder.image.image_utils [None req-49f252ef-48e4-49d1-95e0-b53dff61b2b6 tempest-SnapshotDependencyTests-1812892589 None] Converted 1024.00 MB image at 187.95 MB/s
Jul 02 20:06:02 devstack cinder-volume[86639]: WARNING cinder.volume.drivers.remotefs [None req-49f252ef-48e4-49d1-95e0-b53dff61b2b6 tempest-SnapshotDependencyTests-1812892589 None] /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-c828c142-426a-4810-ae0b-b7d52955ef6d is being set with open permissions: ugo+rw
Jul 02 20:06:02 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-49f252ef-48e4-49d1-95e0-b53dff61b2b6 tempest-SnapshotDependencyTests-1812892589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-c828c142-426a-4810-ae0b-b7d52955ef6d {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:06:02 devstack sudo[107581]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-c828c142-426a-4810-ae0b-b7d52955ef6d
Jul 02 20:06:02 devstack sudo[107581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:06:02 devstack sudo[107578]: pam_unix(sudo:session): session closed for user root
Jul 02 20:06:02 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-c454ca8d-83aa-4666-95dd-a5c4d6038575 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-4592a50c-2293-4689-843d-fd81094cd74e" returned: 0 in 0.699s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:06:02 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-c454ca8d-83aa-4666-95dd-a5c4d6038575 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Lock "cinder-quobyte-4592a50c-2293-4689-843d-fd81094cd74e" released by "delete_volume" :: held 1.561s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 20:06:02 devstack cinder-volume[86639]: DEBUG cinder.quota [None req-c454ca8d-83aa-4666-95dd-a5c4d6038575 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Created reservations ['ca492a44-77ab-4d83-8a82-ad9a0d8396d4', 'aff360c8-45eb-429c-9911-e26abe410adc', '43ca2cda-13d2-464a-91c9-0ad6f925c503', 'cd250f84-6a73-46b6-9343-c9f6e900eb01'] {{(pid=86639) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 20:06:02 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-c454ca8d-83aa-4666-95dd-a5c4d6038575 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 20:06:02 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-c454ca8d-83aa-4666-95dd-a5c4d6038575 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 20:06:02 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-c454ca8d-83aa-4666-95dd-a5c4d6038575 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 20:06:02 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-c454ca8d-83aa-4666-95dd-a5c4d6038575 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 20:06:02 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-c454ca8d-83aa-4666-95dd-a5c4d6038575 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 20:06:02 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-c454ca8d-83aa-4666-95dd-a5c4d6038575 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:06:02 devstack sudo[107585]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e
Jul 02 20:06:02 devstack sudo[107585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:06:02 devstack sudo[107581]: pam_unix(sudo:session): session closed for user root
Jul 02 20:06:02 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-49f252ef-48e4-49d1-95e0-b53dff61b2b6 tempest-SnapshotDependencyTests-1812892589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-c828c142-426a-4810-ae0b-b7d52955ef6d" returned: 0 in 0.689s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:06:02 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-49f252ef-48e4-49d1-95e0-b53dff61b2b6 tempest-SnapshotDependencyTests-1812892589 None] Lock "cinder-quobyte-c828c142-426a-4810-ae0b-b7d52955ef6d" released by "_copy_volume_from_snapshot" :: held 8.782s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 20:06:02 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-49f252ef-48e4-49d1-95e0-b53dff61b2b6 tempest-SnapshotDependencyTests-1812892589 None] Lock "cinder-quobyte-edee8c4f-9fc7-4839-9ede-5e75a960bf4c-c828c142-426a-4810-ae0b-b7d52955ef6d" released by "_create_volume_from_snapshot" :: held 8.819s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 20:06:02 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-49f252ef-48e4-49d1-95e0-b53dff61b2b6 tempest-SnapshotDependencyTests-1812892589 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.837s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 20:06:02 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-49f252ef-48e4-49d1-95e0-b53dff61b2b6 tempest-SnapshotDependencyTests-1812892589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d5db57c-70b6-48e1-8b2c-746fb5b37d59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c828c142-426a-4810-ae0b-b7d52955ef6d', 'volume_size': 1, 'snapshot_id': 'edee8c4f-9fc7-4839-9ede-5e75a960bf4c'}' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:06:03 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-49f252ef-48e4-49d1-95e0-b53dff61b2b6 tempest-SnapshotDependencyTests-1812892589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b696e0f0-2316-436e-831a-d76b02f122bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 20:06:03 devstack cinder-volume[86639]: INFO cinder.volume.flows.manager.create_volume [None req-49f252ef-48e4-49d1-95e0-b53dff61b2b6 tempest-SnapshotDependencyTests-1812892589 None] Volume volume-c828c142-426a-4810-ae0b-b7d52955ef6d (c828c142-426a-4810-ae0b-b7d52955ef6d): created successfully
Jul 02 20:06:03 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-49f252ef-48e4-49d1-95e0-b53dff61b2b6 tempest-SnapshotDependencyTests-1812892589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b696e0f0-2316-436e-831a-d76b02f122bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 20:06:03 devstack cinder-volume[86639]: DEBUG cinder.volume.manager [None req-49f252ef-48e4-49d1-95e0-b53dff61b2b6 tempest-SnapshotDependencyTests-1812892589 None] Flow 'volume_create_manager' (10c5166b-f3db-488c-9752-704ebd40d7a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 20:06:03 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-49f252ef-48e4-49d1-95e0-b53dff61b2b6 tempest-SnapshotDependencyTests-1812892589 None] Created volume successfully.
Jul 02 20:06:03 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-db4ca191-f8fb-4af8-8b67-207d96420bbc tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Acquiring lock "cinder-2314d9a6-9b28-44e7-9bac-9c626e339f46-delete_volume" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 20:06:03 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-db4ca191-f8fb-4af8-8b67-207d96420bbc tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Lock "cinder-2314d9a6-9b28-44e7-9bac-9c626e339f46-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 20:06:03 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-db4ca191-f8fb-4af8-8b67-207d96420bbc tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Acquiring lock "cinder-quobyte-2314d9a6-9b28-44e7-9bac-9c626e339f46" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 20:06:03 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-db4ca191-f8fb-4af8-8b67-207d96420bbc tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Lock "cinder-quobyte-2314d9a6-9b28-44e7-9bac-9c626e339f46" acquired by "delete_volume" :: waited 0.019s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 20:06:03 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5156fcb-5f46-4d40-b10b-b2e3688c2f04]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 20:06:03 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-db4ca191-f8fb-4af8-8b67-207d96420bbc tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-2314d9a6-9b28-44e7-9bac-9c626e339f46 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:06:03 devstack sudo[107588]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-2314d9a6-9b28-44e7-9bac-9c626e339f46
Jul 02 20:06:03 devstack sudo[107588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:06:03 devstack sudo[107585]: pam_unix(sudo:session): session closed for user root
Jul 02 20:06:03 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-c454ca8d-83aa-4666-95dd-a5c4d6038575 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e" returned: 0 in 0.721s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:06:03 devstack cinder-volume[86639]: DEBUG cinder.manager [None req-c454ca8d-83aa-4666-95dd-a5c4d6038575 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Notifying Schedulers of capabilities ... {{(pid=86639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 20:06:03 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-c454ca8d-83aa-4666-95dd-a5c4d6038575 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Deleted volume successfully.
Jul 02 20:06:03 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-c454ca8d-83aa-4666-95dd-a5c4d6038575 tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Lock "cinder-4592a50c-2293-4689-843d-fd81094cd74e-delete_volume" released by "delete_volume" :: held 2.516s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 20:06:04 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-32dc0de4-a602-4d26-9b6c-e7c5e0366d91 tempest-SnapshotDependencyTests-1812892589 None] Acquiring lock "cinder-edee8c4f-9fc7-4839-9ede-5e75a960bf4c-delete_snapshot" by "delete_snapshot" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 20:06:04 devstack sudo[107588]: pam_unix(sudo:session): session closed for user root
Jul 02 20:06:04 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-db4ca191-f8fb-4af8-8b67-207d96420bbc tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-2314d9a6-9b28-44e7-9bac-9c626e339f46" returned: 0 in 0.817s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:06:04 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-db4ca191-f8fb-4af8-8b67-207d96420bbc tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-2314d9a6-9b28-44e7-9bac-9c626e339f46 {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:06:04 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-32dc0de4-a602-4d26-9b6c-e7c5e0366d91 tempest-SnapshotDependencyTests-1812892589 None] Lock "cinder-edee8c4f-9fc7-4839-9ede-5e75a960bf4c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 20:06:04 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-32dc0de4-a602-4d26-9b6c-e7c5e0366d91 tempest-SnapshotDependencyTests-1812892589 None] Acquiring lock "cinder-quobyte-82e9bd09-ba4f-4614-b846-f65124c763cc" by "delete_snapshot" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 20:06:04 devstack sudo[107594]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-2314d9a6-9b28-44e7-9bac-9c626e339f46
Jul 02 20:06:04 devstack sudo[107594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:06:04 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-32dc0de4-a602-4d26-9b6c-e7c5e0366d91 tempest-SnapshotDependencyTests-1812892589 None] Lock "cinder-quobyte-82e9bd09-ba4f-4614-b846-f65124c763cc" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 20:06:04 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-32dc0de4-a602-4d26-9b6c-e7c5e0366d91 tempest-SnapshotDependencyTests-1812892589 None] Acquiring lock "cinder-quobyte-edee8c4f-9fc7-4839-9ede-5e75a960bf4c" by "_delete_snapshot" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 20:06:04 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-32dc0de4-a602-4d26-9b6c-e7c5e0366d91 tempest-SnapshotDependencyTests-1812892589 None] Lock "cinder-quobyte-edee8c4f-9fc7-4839-9ede-5e75a960bf4c" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 20:06:04 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-32dc0de4-a602-4d26-9b6c-e7c5e0366d91 tempest-SnapshotDependencyTests-1812892589 None] Deleting offline snapshot edee8c4f-9fc7-4839-9ede-5e75a960bf4c of volume 82e9bd09-ba4f-4614-b846-f65124c763cc {{(pid=86639) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 02 20:06:04 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-32dc0de4-a602-4d26-9b6c-e7c5e0366d91 tempest-SnapshotDependencyTests-1812892589 None] snapshot_file for this snap is: volume-82e9bd09-ba4f-4614-b846-f65124c763cc.edee8c4f-9fc7-4839-9ede-5e75a960bf4c {{(pid=86639) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 02 20:06:04 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[507bfb80-5c3e-4db8-8a06-b29226c87ffd]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 20:06:04 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-32dc0de4-a602-4d26-9b6c-e7c5e0366d91 tempest-SnapshotDependencyTests-1812892589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-82e9bd09-ba4f-4614-b846-f65124c763cc.edee8c4f-9fc7-4839-9ede-5e75a960bf4c {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:06:04 devstack sudo[107596]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-82e9bd09-ba4f-4614-b846-f65124c763cc.edee8c4f-9fc7-4839-9ede-5e75a960bf4c
Jul 02 20:06:04 devstack sudo[107596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:06:04 devstack sudo[107594]: pam_unix(sudo:session): session closed for user root
Jul 02 20:06:04 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-db4ca191-f8fb-4af8-8b67-207d96420bbc tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-2314d9a6-9b28-44e7-9bac-9c626e339f46" returned: 0 in 0.668s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:06:04 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-db4ca191-f8fb-4af8-8b67-207d96420bbc tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Lock "cinder-quobyte-2314d9a6-9b28-44e7-9bac-9c626e339f46" released by "delete_volume" :: held 1.532s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 20:06:04 devstack cinder-volume[86639]: DEBUG cinder.quota [None req-db4ca191-f8fb-4af8-8b67-207d96420bbc tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Created reservations ['f65722cd-306f-4617-9263-e00de29418ab', '742a4ec8-a38f-4417-9b59-8b5bfec2ad5a', '8113f0fc-9b89-4222-977a-820b403ca0ce', '0b8f1633-1a63-44c0-af50-ce9af00830f5'] {{(pid=86639) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 20:06:05 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-db4ca191-f8fb-4af8-8b67-207d96420bbc tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 20:06:05 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-db4ca191-f8fb-4af8-8b67-207d96420bbc tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 20:06:05 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-db4ca191-f8fb-4af8-8b67-207d96420bbc tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 20:06:05 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-db4ca191-f8fb-4af8-8b67-207d96420bbc tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 20:06:05 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-db4ca191-f8fb-4af8-8b67-207d96420bbc tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 20:06:05 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-db4ca191-f8fb-4af8-8b67-207d96420bbc tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:06:05 devstack sudo[107603]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e
Jul 02 20:06:05 devstack sudo[107603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:06:05 devstack sudo[107596]: pam_unix(sudo:session): session closed for user root
Jul 02 20:06:05 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-32dc0de4-a602-4d26-9b6c-e7c5e0366d91 tempest-SnapshotDependencyTests-1812892589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-82e9bd09-ba4f-4614-b846-f65124c763cc.edee8c4f-9fc7-4839-9ede-5e75a960bf4c" returned: 0 in 0.812s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:06:05 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.remotefs [None req-32dc0de4-a602-4d26-9b6c-e7c5e0366d91 tempest-SnapshotDependencyTests-1812892589 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-82e9bd09-ba4f-4614-b846-f65124c763cc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86639) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 02 20:06:05 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b854cc7-7cf5-457f-8c71-0558fb2fb805]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 20:06:05 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-32dc0de4-a602-4d26-9b6c-e7c5e0366d91 tempest-SnapshotDependencyTests-1812892589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-82e9bd09-ba4f-4614-b846-f65124c763cc {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:06:05 devstack sudo[107605]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-82e9bd09-ba4f-4614-b846-f65124c763cc
Jul 02 20:06:05 devstack sudo[107605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:06:05 devstack sudo[107603]: pam_unix(sudo:session): session closed for user root
Jul 02 20:06:05 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-db4ca191-f8fb-4af8-8b67-207d96420bbc tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e" returned: 0 in 0.674s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:06:05 devstack cinder-volume[86639]: DEBUG cinder.manager [None req-db4ca191-f8fb-4af8-8b67-207d96420bbc tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Notifying Schedulers of capabilities ... {{(pid=86639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 20:06:05 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-db4ca191-f8fb-4af8-8b67-207d96420bbc tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Deleted volume successfully.
Jul 02 20:06:05 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-db4ca191-f8fb-4af8-8b67-207d96420bbc tempest-CreateVolumesFromSourceVolumeTest-2079521339 None] Lock "cinder-2314d9a6-9b28-44e7-9bac-9c626e339f46-delete_volume" released by "delete_volume" :: held 2.424s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 20:06:06 devstack sudo[107605]: pam_unix(sudo:session): session closed for user root
Jul 02 20:06:06 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-32dc0de4-a602-4d26-9b6c-e7c5e0366d91 tempest-SnapshotDependencyTests-1812892589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-82e9bd09-ba4f-4614-b846-f65124c763cc" returned: 0 in 0.901s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:06:06 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-32dc0de4-a602-4d26-9b6c-e7c5e0366d91 tempest-SnapshotDependencyTests-1812892589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-82e9bd09-ba4f-4614-b846-f65124c763cc.edee8c4f-9fc7-4839-9ede-5e75a960bf4c {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:06:06 devstack sudo[107611]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-82e9bd09-ba4f-4614-b846-f65124c763cc.edee8c4f-9fc7-4839-9ede-5e75a960bf4c
Jul 02 20:06:06 devstack sudo[107611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:06:06 devstack sudo[107611]: pam_unix(sudo:session): session closed for user root
Jul 02 20:06:06 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-32dc0de4-a602-4d26-9b6c-e7c5e0366d91 tempest-SnapshotDependencyTests-1812892589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-82e9bd09-ba4f-4614-b846-f65124c763cc.edee8c4f-9fc7-4839-9ede-5e75a960bf4c" returned: 0 in 0.859s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:06:06 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-32dc0de4-a602-4d26-9b6c-e7c5e0366d91 tempest-SnapshotDependencyTests-1812892589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-82e9bd09-ba4f-4614-b846-f65124c763cc.edee8c4f-9fc7-4839-9ede-5e75a960bf4c {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:06:06 devstack sudo[107618]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-82e9bd09-ba4f-4614-b846-f65124c763cc.edee8c4f-9fc7-4839-9ede-5e75a960bf4c
Jul 02 20:06:06 devstack sudo[107618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:06:07 devstack sudo[107618]: pam_unix(sudo:session): session closed for user root
Jul 02 20:06:07 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-32dc0de4-a602-4d26-9b6c-e7c5e0366d91 tempest-SnapshotDependencyTests-1812892589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-82e9bd09-ba4f-4614-b846-f65124c763cc.edee8c4f-9fc7-4839-9ede-5e75a960bf4c" returned: 0 in 0.698s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:06:07 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-32dc0de4-a602-4d26-9b6c-e7c5e0366d91 tempest-SnapshotDependencyTests-1812892589 None] Lock "cinder-quobyte-edee8c4f-9fc7-4839-9ede-5e75a960bf4c" released by "_delete_snapshot" :: held 3.382s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 20:06:07 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-32dc0de4-a602-4d26-9b6c-e7c5e0366d91 tempest-SnapshotDependencyTests-1812892589 None] Lock "cinder-quobyte-82e9bd09-ba4f-4614-b846-f65124c763cc" released by "delete_snapshot" :: held 3.405s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 20:06:07 devstack cinder-volume[86639]: DEBUG cinder.quota [None req-32dc0de4-a602-4d26-9b6c-e7c5e0366d91 tempest-SnapshotDependencyTests-1812892589 None] Created reservations ['3d016114-6c97-441b-8ea3-61b3e9b0ff27', 'fd999f5d-d3ea-4fe5-a2ef-8033df314253', '09ecf7e2-ad63-46c4-9c48-2f64807fd741', 'a73ced42-fa2a-4413-aab4-cf7f79cbb265'] {{(pid=86639) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 20:06:07 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-32dc0de4-a602-4d26-9b6c-e7c5e0366d91 tempest-SnapshotDependencyTests-1812892589 None] Delete snapshot completed successfully.
Jul 02 20:06:07 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-32dc0de4-a602-4d26-9b6c-e7c5e0366d91 tempest-SnapshotDependencyTests-1812892589 None] Lock "cinder-edee8c4f-9fc7-4839-9ede-5e75a960bf4c-delete_snapshot" released by "delete_snapshot" :: held 3.616s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 20:06:08 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-f7b77369-dc84-4488-9691-ea38cdf319e9 tempest-SnapshotDependencyTests-1812892589 None] Acquiring lock "cinder-82e9bd09-ba4f-4614-b846-f65124c763cc-delete_volume" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 20:06:08 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-f7b77369-dc84-4488-9691-ea38cdf319e9 tempest-SnapshotDependencyTests-1812892589 None] Lock "cinder-82e9bd09-ba4f-4614-b846-f65124c763cc-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 20:06:08 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-f7b77369-dc84-4488-9691-ea38cdf319e9 tempest-SnapshotDependencyTests-1812892589 None] Acquiring lock "cinder-quobyte-82e9bd09-ba4f-4614-b846-f65124c763cc" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 20:06:08 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-f7b77369-dc84-4488-9691-ea38cdf319e9 tempest-SnapshotDependencyTests-1812892589 None] Lock "cinder-quobyte-82e9bd09-ba4f-4614-b846-f65124c763cc" acquired by "delete_volume" :: waited 0.017s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 20:06:08 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[755c6e83-9eda-4352-a53c-5c0e87b658a1]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 20:06:08 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-f7b77369-dc84-4488-9691-ea38cdf319e9 tempest-SnapshotDependencyTests-1812892589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-82e9bd09-ba4f-4614-b846-f65124c763cc {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:06:08 devstack sudo[107621]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-82e9bd09-ba4f-4614-b846-f65124c763cc
Jul 02 20:06:08 devstack sudo[107621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:06:09 devstack sudo[107621]: pam_unix(sudo:session): session closed for user root
Jul 02 20:06:09 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-f7b77369-dc84-4488-9691-ea38cdf319e9 tempest-SnapshotDependencyTests-1812892589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-82e9bd09-ba4f-4614-b846-f65124c763cc" returned: 0 in 0.811s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:06:09 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-f7b77369-dc84-4488-9691-ea38cdf319e9 tempest-SnapshotDependencyTests-1812892589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-82e9bd09-ba4f-4614-b846-f65124c763cc {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:06:09 devstack sudo[107626]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-82e9bd09-ba4f-4614-b846-f65124c763cc
Jul 02 20:06:09 devstack sudo[107626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:06:10 devstack sudo[107626]: pam_unix(sudo:session): session closed for user root
Jul 02 20:06:10 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-f7b77369-dc84-4488-9691-ea38cdf319e9 tempest-SnapshotDependencyTests-1812892589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-82e9bd09-ba4f-4614-b846-f65124c763cc" returned: 0 in 0.698s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:06:10 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-f7b77369-dc84-4488-9691-ea38cdf319e9 tempest-SnapshotDependencyTests-1812892589 None] Lock "cinder-quobyte-82e9bd09-ba4f-4614-b846-f65124c763cc" released by "delete_volume" :: held 1.563s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 20:06:10 devstack cinder-volume[86639]: DEBUG cinder.quota [None req-f7b77369-dc84-4488-9691-ea38cdf319e9 tempest-SnapshotDependencyTests-1812892589 None] Created reservations ['b39a6ed2-c48d-4dc9-ac4d-b1fefdb6e531', '7f117e54-328a-4839-a9bb-68ff523acce2', 'bff35fc5-2be0-4ece-8be8-22f7b8c7ef33', 'eee08126-616d-4612-bdfd-03a17e0bd27e'] {{(pid=86639) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 20:06:10 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-f7b77369-dc84-4488-9691-ea38cdf319e9 tempest-SnapshotDependencyTests-1812892589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 20:06:10 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-f7b77369-dc84-4488-9691-ea38cdf319e9 tempest-SnapshotDependencyTests-1812892589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 20:06:10 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-f7b77369-dc84-4488-9691-ea38cdf319e9 tempest-SnapshotDependencyTests-1812892589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 20:06:10 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-f7b77369-dc84-4488-9691-ea38cdf319e9 tempest-SnapshotDependencyTests-1812892589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 20:06:10 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-f7b77369-dc84-4488-9691-ea38cdf319e9 tempest-SnapshotDependencyTests-1812892589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 20:06:10 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-f7b77369-dc84-4488-9691-ea38cdf319e9 tempest-SnapshotDependencyTests-1812892589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:06:10 devstack sudo[107629]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e
Jul 02 20:06:10 devstack sudo[107629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:06:10 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-938a20f8-7997-4d08-973c-2ea689cfc32b tempest-SnapshotDependencyTests-1812892589 None] Acquiring lock "cinder-c828c142-426a-4810-ae0b-b7d52955ef6d-delete_volume" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 20:06:10 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-938a20f8-7997-4d08-973c-2ea689cfc32b tempest-SnapshotDependencyTests-1812892589 None] Lock "cinder-c828c142-426a-4810-ae0b-b7d52955ef6d-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 20:06:10 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-938a20f8-7997-4d08-973c-2ea689cfc32b tempest-SnapshotDependencyTests-1812892589 None] Acquiring lock "cinder-quobyte-c828c142-426a-4810-ae0b-b7d52955ef6d" by "delete_volume" {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 20:06:10 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-938a20f8-7997-4d08-973c-2ea689cfc32b tempest-SnapshotDependencyTests-1812892589 None] Lock "cinder-quobyte-c828c142-426a-4810-ae0b-b7d52955ef6d" acquired by "delete_volume" :: waited 0.036s {{(pid=86639) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 20:06:10 devstack cinder-volume[86639]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d985513-c32d-41f1-b51d-618e08e33723]: (4, 'qcow2') {{(pid=87992) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 20:06:10 devstack sudo[107629]: pam_unix(sudo:session): session closed for user root
Jul 02 20:06:10 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-938a20f8-7997-4d08-973c-2ea689cfc32b tempest-SnapshotDependencyTests-1812892589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-c828c142-426a-4810-ae0b-b7d52955ef6d {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:06:10 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-f7b77369-dc84-4488-9691-ea38cdf319e9 tempest-SnapshotDependencyTests-1812892589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e" returned: 0 in 0.678s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:06:10 devstack cinder-volume[86639]: DEBUG cinder.manager [None req-f7b77369-dc84-4488-9691-ea38cdf319e9 tempest-SnapshotDependencyTests-1812892589 None] Notifying Schedulers of capabilities ... {{(pid=86639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 20:06:10 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-f7b77369-dc84-4488-9691-ea38cdf319e9 tempest-SnapshotDependencyTests-1812892589 None] Deleted volume successfully.
Jul 02 20:06:10 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-f7b77369-dc84-4488-9691-ea38cdf319e9 tempest-SnapshotDependencyTests-1812892589 None] Lock "cinder-82e9bd09-ba4f-4614-b846-f65124c763cc-delete_volume" released by "delete_volume" :: held 2.447s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 20:06:10 devstack sudo[107632]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-c828c142-426a-4810-ae0b-b7d52955ef6d
Jul 02 20:06:10 devstack sudo[107632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:06:11 devstack sudo[107632]: pam_unix(sudo:session): session closed for user root
Jul 02 20:06:11 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-938a20f8-7997-4d08-973c-2ea689cfc32b tempest-SnapshotDependencyTests-1812892589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-c828c142-426a-4810-ae0b-b7d52955ef6d" returned: 0 in 0.792s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:06:11 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-938a20f8-7997-4d08-973c-2ea689cfc32b tempest-SnapshotDependencyTests-1812892589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-c828c142-426a-4810-ae0b-b7d52955ef6d {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:06:11 devstack sudo[107637]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-c828c142-426a-4810-ae0b-b7d52955ef6d
Jul 02 20:06:11 devstack sudo[107637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:06:12 devstack sudo[107637]: pam_unix(sudo:session): session closed for user root
Jul 02 20:06:12 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-938a20f8-7997-4d08-973c-2ea689cfc32b tempest-SnapshotDependencyTests-1812892589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e/volume-c828c142-426a-4810-ae0b-b7d52955ef6d" returned: 0 in 0.691s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:06:12 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-938a20f8-7997-4d08-973c-2ea689cfc32b tempest-SnapshotDependencyTests-1812892589 None] Lock "cinder-quobyte-c828c142-426a-4810-ae0b-b7d52955ef6d" released by "delete_volume" :: held 1.539s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 20:06:12 devstack cinder-volume[86639]: DEBUG cinder.quota [None req-938a20f8-7997-4d08-973c-2ea689cfc32b tempest-SnapshotDependencyTests-1812892589 None] Created reservations ['1572b45e-52e9-4707-8e6a-e5795b9b5c7c', 'ee40217a-2bb8-4e62-8c6a-70914bb1256f', '5631ba62-83d2-4306-9b75-8be7a0f1f119', '8b51c6e9-4818-4be1-b060-7139230ba7e6'] {{(pid=86639) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 20:06:12 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-938a20f8-7997-4d08-973c-2ea689cfc32b tempest-SnapshotDependencyTests-1812892589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 20:06:12 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-938a20f8-7997-4d08-973c-2ea689cfc32b tempest-SnapshotDependencyTests-1812892589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 20:06:12 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-938a20f8-7997-4d08-973c-2ea689cfc32b tempest-SnapshotDependencyTests-1812892589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92': None} {{(pid=86639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 20:06:12 devstack cinder-volume[86639]: DEBUG cinder.volume.drivers.quobyte [None req-938a20f8-7997-4d08-973c-2ea689cfc32b tempest-SnapshotDependencyTests-1812892589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f239dfc-c0de-428e-aad4-078692dcca92'] {{(pid=86639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 20:06:12 devstack cinder-volume[86639]: DEBUG oslo_concurrency.lockutils [None req-938a20f8-7997-4d08-973c-2ea689cfc32b tempest-SnapshotDependencyTests-1812892589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 20:06:12 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-938a20f8-7997-4d08-973c-2ea689cfc32b tempest-SnapshotDependencyTests-1812892589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 20:06:12 devstack sudo[107641]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e
Jul 02 20:06:12 devstack sudo[107641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 20:06:13 devstack sudo[107641]: pam_unix(sudo:session): session closed for user root
Jul 02 20:06:13 devstack cinder-volume[86639]: DEBUG oslo_concurrency.processutils [None req-938a20f8-7997-4d08-973c-2ea689cfc32b tempest-SnapshotDependencyTests-1812892589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52dbe78c2fafa656c63ca3d133d7fa7e" returned: 0 in 0.680s {{(pid=86639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 20:06:13 devstack cinder-volume[86639]: DEBUG cinder.manager [None req-938a20f8-7997-4d08-973c-2ea689cfc32b tempest-SnapshotDependencyTests-1812892589 None] Notifying Schedulers of capabilities ... {{(pid=86639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 20:06:13 devstack cinder-volume[86639]: INFO cinder.volume.manager [None req-938a20f8-7997-4d08-973c-2ea689cfc32b tempest-SnapshotDependencyTests-1812892589 None] Deleted volume successfully.
Jul 02 20:06:13 devstack cinder-volume[86639]: DEBUG cinder.coordination [None req-938a20f8-7997-4d08-973c-2ea689cfc32b tempest-SnapshotDependencyTests-1812892589 None] Lock "cinder-c828c142-426a-4810-ae0b-b7d52955ef6d-delete_volume" released by "delete_volume" :: held 2.461s {{(pid=86639) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 20:06:22 devstack cinder-volume[86639]: DEBUG dbcounter [-] [86639] Writing DB stats cinder:SELECT=103,cinder:INSERT=42,cinder:UPDATE=141,cinder:DELETE=12 {{(pid=86639) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 02 20:06:23 devstack cinder-volume[86639]: DEBUG dbcounter [-] [86639] Writing DB stats cinder:SELECT=99,cinder:INSERT=34,cinder:UPDATE=139,cinder:DELETE=11 {{(pid=86639) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}